2024-11-01T16:31:38.0490914Z Current runner version: '2.320.0' 2024-11-01T16:31:38.0497806Z Runner name: 'i-02f620357bfb2a39d' 2024-11-01T16:31:38.0498570Z Runner group name: 'Default' 2024-11-01T16:31:38.0499513Z Machine name: 'ip-10-0-46-81' 2024-11-01T16:31:38.0517831Z Testing runner upgrade compatibility 2024-11-01T16:31:38.2672248Z ##[group]GITHUB_TOKEN Permissions 2024-11-01T16:31:38.2674487Z Actions: read 2024-11-01T16:31:38.2675115Z Attestations: read 2024-11-01T16:31:38.2675630Z Checks: read 2024-11-01T16:31:38.2676093Z Contents: read 2024-11-01T16:31:38.2676578Z Deployments: read 2024-11-01T16:31:38.2677082Z Discussions: read 2024-11-01T16:31:38.2677618Z Issues: read 2024-11-01T16:31:38.2678137Z Metadata: read 2024-11-01T16:31:38.2678618Z Packages: read 2024-11-01T16:31:38.2679052Z Pages: read 2024-11-01T16:31:38.2679559Z PullRequests: read 2024-11-01T16:31:38.2680080Z RepositoryProjects: read 2024-11-01T16:31:38.2680706Z SecurityEvents: read 2024-11-01T16:31:38.2681222Z Statuses: read 2024-11-01T16:31:38.2681858Z ##[endgroup] 2024-11-01T16:31:38.2685480Z Secret source: Actions 2024-11-01T16:31:38.2686166Z Prepare workflow directory 2024-11-01T16:31:38.3674412Z Prepare all required actions 2024-11-01T16:31:38.3859867Z Getting action download info 2024-11-01T16:31:38.5584095Z Download action repository 'pytorch/test-infra@main' (SHA:49fb39b5efb49007791d74b09885044cd64544bf) 2024-11-01T16:31:38.8965264Z Download action repository 'pytorch/pytorch@main' (SHA:b57b4b7f9b168389def15ea06a4dcf9e5f6f4f04) 2024-11-01T16:31:42.0811965Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-11-01T16:31:42.2313670Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-11-01T16:31:42.5626096Z Getting action download info 2024-11-01T16:31:42.6920496Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-11-01T16:31:42.8549182Z Getting action download info 2024-11-01T16:31:42.9619792Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2024-11-01T16:31:43.1165038Z Getting action download info 2024-11-01T16:31:43.3551260Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-11-01T16:31:43.4971813Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/138766/merge (368da7510f5d755034681777a4e5ae6d33c07b38) 2024-11-01T16:31:43.4974580Z ##[group] Inputs 2024-11-01T16:31:43.4975016Z build-environment: linux-jammy-py3.9-gcc11 2024-11-01T16:31:43.4978730Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]} 2024-11-01T16:31:43.4982911Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:31:43.4983906Z sync-tag: 2024-11-01T16:31:43.4984671Z timeout-minutes: 240 2024-11-01T16:31:43.4985003Z use-gha: 2024-11-01T16:31:43.4985287Z dashboard-tag: 2024-11-01T16:31:43.4985598Z s3-bucket: gha-artifacts 2024-11-01T16:31:43.4985953Z aws-role-to-assume: 2024-11-01T16:31:43.4986277Z ##[endgroup] 2024-11-01T16:31:43.4987280Z Complete job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:31:43.5618958Z A job started hook has been configured by the self-hosted runner administrator 2024-11-01T16:31:43.5771288Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-11-01T16:31:43.5781486Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:31:43.5782034Z ##[endgroup] 2024-11-01T16:31:44.8158020Z Runner Type: linux.2xlarge 2024-11-01T16:31:44.8158564Z Instance Type: c5.2xlarge 2024-11-01T16:31:44.8158913Z AMI Name: unknown 2024-11-01T16:31:44.8159662Z AMI ID: ami-0fff1b9a61dec8a5f 2024-11-01T16:31:51.2009471Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-11-01T16:31:51.2042143Z with: 2024-11-01T16:31:51.2043016Z github-secret: *** 2024-11-01T16:31:51.2043997Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-11-01T16:31:51.2045039Z activate-with-label: false 2024-11-01T16:31:51.2045417Z label: with-ssh 2024-11-01T16:31:51.2045732Z remove-existing-keys: true 2024-11-01T16:31:51.2046094Z fail-silently: true 2024-11-01T16:31:51.2046402Z env: 2024-11-01T16:31:51.2046653Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:31:51.2046992Z ##[endgroup] 2024-11-01T16:31:51.2994838Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-11-01T16:31:51.5494232Z Grabbing public ssh keys from https://github.com/c00w.keys 2024-11-01T16:31:51.6080503Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-11-01T16:31:51.6095544Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-11-01T16:31:51.6120923Z Login using: ssh ec2-user@ec2-54-162-121-102.compute-1.amazonaws.com 2024-11-01T16:31:51.6122311Z All testing is done inside the container, to start an interactive session run: 2024-11-01T16:31:51.6123853Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-11-01T16:31:51.6242147Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-11-01T16:31:51.6242713Z with: 2024-11-01T16:31:51.6242982Z submodules: recursive 2024-11-01T16:31:51.6243311Z fetch-depth: 0 2024-11-01T16:31:51.6243591Z env: 2024-11-01T16:31:51.6243836Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:31:51.6244169Z ##[endgroup] 2024-11-01T16:31:51.6448061Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:31:51.6449409Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:31:51.6459664Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:31:51.6460189Z env: 2024-11-01T16:31:51.6460455Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:31:51.6460791Z ##[endgroup] 2024-11-01T16:31:51.6586509Z ##[group]Run retry () { 2024-11-01T16:31:51.6586929Z retry () { 2024-11-01T16:31:51.6587443Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-11-01T16:31:51.6587996Z } 2024-11-01T16:31:51.6588302Z echo "${GITHUB_WORKSPACE}" 2024-11-01T16:31:51.6588835Z if [ -z "${NO_SUDO}" ]; then 2024-11-01T16:31:51.6589320Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-11-01T16:31:51.6589779Z else 2024-11-01T16:31:51.6590124Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-11-01T16:31:51.6590555Z fi 2024-11-01T16:31:51.6590856Z mkdir "${GITHUB_WORKSPACE}" 2024-11-01T16:31:51.6596814Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:31:51.6597316Z env: 2024-11-01T16:31:51.6597578Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:31:51.6597898Z NO_SUDO: 2024-11-01T16:31:51.6598313Z ##[endgroup] 2024-11-01T16:31:51.6622632Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T16:31:51.8117976Z ##[group]Run malfet/checkout@silent-checkout 2024-11-01T16:31:51.8118604Z with: 2024-11-01T16:31:51.8118930Z ref: d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:31:51.8119368Z fetch-depth: 0 2024-11-01T16:31:51.8119673Z submodules: recursive 2024-11-01T16:31:51.8120002Z quiet-checkout: true 2024-11-01T16:31:51.8120338Z repository: pytorch/pytorch 2024-11-01T16:31:51.8120831Z token: *** 2024-11-01T16:31:51.8121106Z ssh-strict: true 2024-11-01T16:31:51.8121411Z persist-credentials: true 2024-11-01T16:31:51.8121761Z clean: true 2024-11-01T16:31:51.8122070Z sparse-checkout-cone-mode: true 2024-11-01T16:31:51.8122453Z lfs: false 2024-11-01T16:31:51.8122741Z set-safe-directory: true 2024-11-01T16:31:51.8123057Z env: 2024-11-01T16:31:51.8123315Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:31:51.8123650Z ##[endgroup] 2024-11-01T16:31:51.9155620Z Syncing repository: pytorch/pytorch 2024-11-01T16:31:51.9157461Z ##[group]Getting Git version info 2024-11-01T16:31:51.9158332Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-11-01T16:31:51.9159446Z [command]/usr/bin/git version 2024-11-01T16:31:51.9159811Z git version 2.40.1 2024-11-01T16:31:51.9161179Z ##[endgroup] 2024-11-01T16:31:51.9173668Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/6eb5aab2-b4a1-4562-bd5a-0e7e2b8752ab' before making global git config changes 2024-11-01T16:31:51.9174968Z Adding repository directory to the temporary git global config as a safe directory 2024-11-01T16:31:51.9176168Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T16:31:51.9215399Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-11-01T16:31:51.9219144Z ##[group]Initializing the repository 2024-11-01T16:31:51.9221991Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T16:31:51.9254523Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-11-01T16:31:51.9255709Z hint: is subject to change. To configure the initial branch name to use in all 2024-11-01T16:31:51.9256592Z hint: of your new repositories, which will suppress this warning, call: 2024-11-01T16:31:51.9257164Z hint: 2024-11-01T16:31:51.9257634Z hint: git config --global init.defaultBranch 2024-11-01T16:31:51.9258193Z hint: 2024-11-01T16:31:51.9258730Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-11-01T16:31:51.9259829Z hint: 'development'. The just-created branch can be renamed via this command: 2024-11-01T16:31:51.9260420Z hint: 2024-11-01T16:31:51.9260734Z hint: git branch -m 2024-11-01T16:31:51.9261602Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-11-01T16:31:51.9265187Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-11-01T16:31:51.9296765Z ##[endgroup] 2024-11-01T16:31:51.9297370Z ##[group]Disabling automatic garbage collection 2024-11-01T16:31:51.9300145Z [command]/usr/bin/git config --local gc.auto 0 2024-11-01T16:31:51.9330021Z ##[endgroup] 2024-11-01T16:31:51.9330545Z ##[group]Setting up auth 2024-11-01T16:31:51.9335716Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-11-01T16:31:51.9366981Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-11-01T16:31:51.9641555Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-11-01T16:31:51.9674308Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-11-01T16:31:51.9937298Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-11-01T16:31:51.9983336Z ##[endgroup] 2024-11-01T16:31:51.9984127Z ##[group]Fetching the repository 2024-11-01T16:31:51.9990456Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-11-01T16:31:54.9183774Z remote: Enumerating objects: 1053425 2024-11-01T16:31:54.9184367Z remote: Enumerating objects: 1053893, done. 2024-11-01T16:31:54.9185507Z remote: Counting objects: 0% (1/468) 2024-11-01T16:31:54.9186009Z remote: Counting objects: 1% (5/468) 2024-11-01T16:31:54.9187013Z remote: Counting objects: 2% (10/468) 2024-11-01T16:31:54.9188116Z remote: Counting objects: 3% (15/468) 2024-11-01T16:31:54.9189382Z remote: Counting objects: 4% (19/468) 2024-11-01T16:31:54.9190369Z remote: Counting objects: 5% (24/468) 2024-11-01T16:31:54.9190962Z remote: Counting objects: 6% (29/468) 2024-11-01T16:31:54.9191453Z remote: Counting objects: 7% (33/468) 2024-11-01T16:31:54.9192402Z remote: Counting objects: 8% (38/468) 2024-11-01T16:31:54.9192900Z remote: Counting objects: 9% (43/468) 2024-11-01T16:31:54.9193386Z remote: Counting objects: 10% (47/468) 2024-11-01T16:31:54.9193876Z remote: Counting objects: 11% (52/468) 2024-11-01T16:31:54.9194348Z remote: Counting objects: 12% (57/468) 2024-11-01T16:31:54.9194833Z remote: Counting objects: 13% (61/468) 2024-11-01T16:31:54.9195316Z remote: Counting objects: 14% (66/468) 2024-11-01T16:31:54.9195801Z remote: Counting objects: 15% (71/468) 2024-11-01T16:31:54.9196283Z remote: Counting objects: 16% (75/468) 2024-11-01T16:31:54.9196765Z remote: Counting objects: 17% (80/468) 2024-11-01T16:31:54.9197233Z remote: Counting objects: 18% (85/468) 2024-11-01T16:31:54.9197718Z remote: Counting objects: 19% (89/468) 2024-11-01T16:31:54.9198204Z remote: Counting objects: 20% (94/468) 2024-11-01T16:31:54.9199014Z remote: Counting objects: 21% (99/468) 2024-11-01T16:31:54.9199525Z remote: Counting objects: 22% (103/468) 2024-11-01T16:31:54.9200019Z remote: Counting objects: 23% (108/468) 2024-11-01T16:31:54.9200521Z remote: Counting objects: 24% (113/468) 2024-11-01T16:31:54.9201021Z remote: Counting objects: 25% (117/468) 2024-11-01T16:31:54.9201518Z remote: Counting objects: 26% (122/468) 2024-11-01T16:31:54.9202012Z remote: Counting objects: 27% (127/468) 2024-11-01T16:31:54.9202503Z remote: Counting objects: 28% (132/468) 2024-11-01T16:31:54.9202984Z remote: Counting objects: 29% (136/468) 2024-11-01T16:31:54.9203484Z remote: Counting objects: 30% (141/468) 2024-11-01T16:31:54.9203980Z remote: Counting objects: 31% (146/468) 2024-11-01T16:31:54.9204473Z remote: Counting objects: 32% (150/468) 2024-11-01T16:31:54.9204969Z remote: Counting objects: 33% (155/468) 2024-11-01T16:31:54.9205451Z remote: Counting objects: 34% (160/468) 2024-11-01T16:31:54.9205953Z remote: Counting objects: 35% (164/468) 2024-11-01T16:31:54.9206451Z remote: Counting objects: 36% (169/468) 2024-11-01T16:31:54.9206941Z remote: Counting objects: 37% (174/468) 2024-11-01T16:31:54.9207435Z remote: Counting objects: 38% (178/468) 2024-11-01T16:31:54.9207928Z remote: Counting objects: 39% (183/468) 2024-11-01T16:31:54.9208408Z remote: Counting objects: 40% (188/468) 2024-11-01T16:31:54.9208903Z remote: Counting objects: 41% (192/468) 2024-11-01T16:31:54.9209399Z remote: Counting objects: 42% (197/468) 2024-11-01T16:31:54.9209893Z remote: Counting objects: 43% (202/468) 2024-11-01T16:31:54.9210385Z remote: Counting objects: 44% (206/468) 2024-11-01T16:31:54.9210875Z remote: Counting objects: 45% (211/468) 2024-11-01T16:31:54.9211353Z remote: Counting objects: 46% (216/468) 2024-11-01T16:31:54.9211858Z remote: Counting objects: 47% (220/468) 2024-11-01T16:31:54.9212479Z remote: Counting objects: 48% (225/468) 2024-11-01T16:31:54.9212974Z remote: Counting objects: 49% (230/468) 2024-11-01T16:31:54.9213524Z remote: Counting objects: 50% (234/468) 2024-11-01T16:31:54.9214005Z remote: Counting objects: 51% (239/468) 2024-11-01T16:31:54.9214504Z remote: Counting objects: 52% (244/468) 2024-11-01T16:31:54.9215001Z remote: Counting objects: 53% (249/468) 2024-11-01T16:31:54.9215495Z remote: Counting objects: 54% (253/468) 2024-11-01T16:31:54.9215993Z remote: Counting objects: 55% (258/468) 2024-11-01T16:31:54.9216488Z remote: Counting objects: 56% (263/468) 2024-11-01T16:31:54.9216971Z remote: Counting objects: 57% (267/468) 2024-11-01T16:31:54.9217469Z remote: Counting objects: 58% (272/468) 2024-11-01T16:31:54.9217962Z remote: Counting objects: 59% (277/468) 2024-11-01T16:31:54.9218461Z remote: Counting objects: 60% (281/468) 2024-11-01T16:31:54.9218959Z remote: Counting objects: 61% (286/468) 2024-11-01T16:31:54.9219435Z remote: Counting objects: 62% (291/468) 2024-11-01T16:31:54.9219964Z remote: Counting objects: 63% (295/468) 2024-11-01T16:31:54.9220885Z remote: Counting objects: 64% (300/468) 2024-11-01T16:31:54.9221367Z remote: Counting objects: 65% (305/468) 2024-11-01T16:31:54.9221866Z remote: Counting objects: 66% (309/468) 2024-11-01T16:31:54.9222362Z remote: Counting objects: 67% (314/468) 2024-11-01T16:31:54.9222861Z remote: Counting objects: 68% (319/468) 2024-11-01T16:31:54.9223360Z remote: Counting objects: 69% (323/468) 2024-11-01T16:31:54.9223853Z remote: Counting objects: 70% (328/468) 2024-11-01T16:31:54.9224332Z remote: Counting objects: 71% (333/468) 2024-11-01T16:31:54.9224824Z remote: Counting objects: 72% (337/468) 2024-11-01T16:31:54.9225422Z remote: Counting objects: 73% (342/468) 2024-11-01T16:31:54.9225927Z remote: Counting objects: 74% (347/468) 2024-11-01T16:31:54.9226420Z remote: Counting objects: 75% (351/468) 2024-11-01T16:31:54.9226897Z remote: Counting objects: 76% (356/468) 2024-11-01T16:31:54.9227392Z remote: Counting objects: 77% (361/468) 2024-11-01T16:31:54.9227886Z remote: Counting objects: 78% (366/468) 2024-11-01T16:31:54.9228376Z remote: Counting objects: 79% (370/468) 2024-11-01T16:31:54.9228944Z remote: Counting objects: 80% (375/468) 2024-11-01T16:31:54.9229438Z remote: Counting objects: 81% (380/468) 2024-11-01T16:31:54.9229918Z remote: Counting objects: 82% (384/468) 2024-11-01T16:31:54.9230416Z remote: Counting objects: 83% (389/468) 2024-11-01T16:31:54.9230910Z remote: Counting objects: 84% (394/468) 2024-11-01T16:31:54.9231404Z remote: Counting objects: 85% (398/468) 2024-11-01T16:31:54.9231898Z remote: Counting objects: 86% (403/468) 2024-11-01T16:31:54.9232390Z remote: Counting objects: 87% (408/468) 2024-11-01T16:31:54.9232878Z remote: Counting objects: 88% (412/468) 2024-11-01T16:31:54.9233371Z remote: Counting objects: 89% (417/468) 2024-11-01T16:31:54.9233892Z remote: Counting objects: 90% (422/468) 2024-11-01T16:31:54.9234411Z remote: Counting objects: 91% (426/468) 2024-11-01T16:31:54.9234901Z remote: Counting objects: 92% (431/468) 2024-11-01T16:31:54.9235378Z remote: Counting objects: 93% (436/468) 2024-11-01T16:31:54.9235928Z remote: Counting objects: 94% (440/468) 2024-11-01T16:31:54.9236420Z remote: Counting objects: 95% (445/468) 2024-11-01T16:31:54.9236911Z remote: Counting objects: 96% (450/468) 2024-11-01T16:31:54.9237411Z remote: Counting objects: 97% (454/468) 2024-11-01T16:31:54.9237899Z remote: Counting objects: 98% (459/468) 2024-11-01T16:31:54.9238391Z remote: Counting objects: 99% (464/468) 2024-11-01T16:31:54.9238989Z remote: Counting objects: 100% (468/468) 2024-11-01T16:31:54.9239522Z remote: Counting objects: 100% (468/468), done. 2024-11-01T16:31:54.9240303Z remote: Compressing objects: 0% (1/252) 2024-11-01T16:31:54.9240913Z remote: Compressing objects: 1% (3/252) 2024-11-01T16:31:54.9241430Z remote: Compressing objects: 2% (6/252) 2024-11-01T16:31:54.9432721Z remote: Compressing objects: 3% (8/252) 2024-11-01T16:31:54.9525465Z remote: Compressing objects: 4% (11/252) 2024-11-01T16:31:54.9647521Z remote: Compressing objects: 5% (13/252) 2024-11-01T16:31:54.9707340Z remote: Compressing objects: 6% (16/252) 2024-11-01T16:31:54.9909932Z remote: Compressing objects: 7% (18/252) 2024-11-01T16:31:55.0004864Z remote: Compressing objects: 8% (21/252) 2024-11-01T16:31:55.0180477Z remote: Compressing objects: 9% (23/252) 2024-11-01T16:31:55.0250378Z remote: Compressing objects: 10% (26/252) 2024-11-01T16:31:55.0310086Z remote: Compressing objects: 11% (28/252) 2024-11-01T16:31:55.0321376Z remote: Compressing objects: 12% (31/252) 2024-11-01T16:31:55.0322383Z remote: Compressing objects: 13% (33/252) 2024-11-01T16:31:55.0322924Z remote: Compressing objects: 14% (36/252) 2024-11-01T16:31:55.0323449Z remote: Compressing objects: 15% (38/252) 2024-11-01T16:31:55.0323975Z remote: Compressing objects: 16% (41/252) 2024-11-01T16:31:55.0324594Z remote: Compressing objects: 17% (43/252) 2024-11-01T16:31:55.0325118Z remote: Compressing objects: 18% (46/252) 2024-11-01T16:31:55.0325643Z remote: Compressing objects: 19% (48/252) 2024-11-01T16:31:55.0326247Z remote: Compressing objects: 20% (51/252) 2024-11-01T16:31:55.0326773Z remote: Compressing objects: 21% (53/252) 2024-11-01T16:31:55.0327299Z remote: Compressing objects: 22% (56/252) 2024-11-01T16:31:55.0329417Z remote: Compressing objects: 23% (58/252) 2024-11-01T16:31:55.0332876Z remote: Compressing objects: 24% (61/252) 2024-11-01T16:31:55.0335034Z remote: Compressing objects: 25% (63/252) 2024-11-01T16:31:55.0336409Z remote: Compressing objects: 26% (66/252) 2024-11-01T16:31:55.0337582Z remote: Compressing objects: 27% (69/252) 2024-11-01T16:31:55.0338919Z remote: Compressing objects: 28% (71/252) 2024-11-01T16:31:55.0340391Z remote: Compressing objects: 29% (74/252) 2024-11-01T16:31:55.0342633Z remote: Compressing objects: 30% (76/252) 2024-11-01T16:31:55.0343777Z remote: Compressing objects: 31% (79/252) 2024-11-01T16:31:55.0345209Z remote: Compressing objects: 32% (81/252) 2024-11-01T16:31:55.0345739Z remote: Compressing objects: 33% (84/252) 2024-11-01T16:31:55.0348206Z remote: Compressing objects: 34% (86/252) 2024-11-01T16:31:55.0349440Z remote: Compressing objects: 35% (89/252) 2024-11-01T16:31:55.0352420Z remote: Compressing objects: 36% (91/252) 2024-11-01T16:31:55.0353490Z remote: Compressing objects: 37% (94/252) 2024-11-01T16:31:55.0360724Z remote: Compressing objects: 38% (96/252) 2024-11-01T16:31:55.0361658Z remote: Compressing objects: 39% (99/252) 2024-11-01T16:31:55.0363878Z remote: Compressing objects: 40% (101/252) 2024-11-01T16:31:55.0372080Z remote: Compressing objects: 41% (104/252) 2024-11-01T16:31:55.0377472Z remote: Compressing objects: 42% (106/252) 2024-11-01T16:31:55.0380543Z remote: Compressing objects: 43% (109/252) 2024-11-01T16:31:55.0381643Z remote: Compressing objects: 44% (111/252) 2024-11-01T16:31:55.0382797Z remote: Compressing objects: 45% (114/252) 2024-11-01T16:31:55.0384335Z remote: Compressing objects: 46% (116/252) 2024-11-01T16:31:55.0385723Z remote: Compressing objects: 47% (119/252) 2024-11-01T16:31:55.0387195Z remote: Compressing objects: 48% (121/252) 2024-11-01T16:31:55.0390850Z remote: Compressing objects: 49% (124/252) 2024-11-01T16:31:55.0391884Z remote: Compressing objects: 50% (126/252) 2024-11-01T16:31:55.0396012Z remote: Compressing objects: 51% (129/252) 2024-11-01T16:31:55.0398340Z remote: Compressing objects: 52% (132/252) 2024-11-01T16:31:55.0399532Z remote: Compressing objects: 53% (134/252) 2024-11-01T16:31:55.0400936Z remote: Compressing objects: 54% (137/252) 2024-11-01T16:31:55.0401967Z remote: Compressing objects: 55% (139/252) 2024-11-01T16:31:55.0403532Z remote: Compressing objects: 56% (142/252) 2024-11-01T16:31:55.0404562Z remote: Compressing objects: 57% (144/252) 2024-11-01T16:31:55.0405169Z remote: Compressing objects: 58% (147/252) 2024-11-01T16:31:55.0405679Z remote: Compressing objects: 59% (149/252) 2024-11-01T16:31:55.0406293Z remote: Compressing objects: 60% (152/252) 2024-11-01T16:31:55.0406830Z remote: Compressing objects: 61% (154/252) 2024-11-01T16:31:55.0407367Z remote: Compressing objects: 62% (157/252) 2024-11-01T16:31:55.0407966Z remote: Compressing objects: 63% (159/252) 2024-11-01T16:31:55.0408479Z remote: Compressing objects: 64% (162/252) 2024-11-01T16:31:55.0409075Z remote: Compressing objects: 65% (164/252) 2024-11-01T16:31:55.0409607Z remote: Compressing objects: 66% (167/252) 2024-11-01T16:31:55.0410207Z remote: Compressing objects: 67% (169/252) 2024-11-01T16:31:55.0410737Z remote: Compressing objects: 68% (172/252) 2024-11-01T16:31:55.0411327Z remote: Compressing objects: 69% (174/252) 2024-11-01T16:31:55.0411844Z remote: Compressing objects: 70% (177/252) 2024-11-01T16:31:55.0412384Z remote: Compressing objects: 71% (179/252) 2024-11-01T16:31:55.0412976Z remote: Compressing objects: 72% (182/252) 2024-11-01T16:31:55.0413550Z remote: Compressing objects: 73% (184/252) 2024-11-01T16:31:55.0414620Z remote: Compressing objects: 74% (187/252) 2024-11-01T16:31:55.0415302Z remote: Compressing objects: 75% (189/252) 2024-11-01T16:31:55.0415819Z remote: Compressing objects: 76% (192/252) 2024-11-01T16:31:55.0416422Z remote: Compressing objects: 77% (195/252) 2024-11-01T16:31:55.0416946Z remote: Compressing objects: 78% (197/252) 2024-11-01T16:31:55.0417482Z remote: Compressing objects: 79% (200/252) 2024-11-01T16:31:55.0418094Z remote: Compressing objects: 80% (202/252) 2024-11-01T16:31:55.0418624Z remote: Compressing objects: 81% (205/252) 2024-11-01T16:31:55.0419297Z remote: Compressing objects: 82% (207/252) 2024-11-01T16:31:55.0419824Z remote: Compressing objects: 83% (210/252) 2024-11-01T16:31:55.0420439Z remote: Compressing objects: 84% (212/252) 2024-11-01T16:31:55.0420961Z remote: Compressing objects: 85% (215/252) 2024-11-01T16:31:55.0421663Z remote: Compressing objects: 86% (217/252) 2024-11-01T16:31:55.0422286Z remote: Compressing objects: 87% (220/252) 2024-11-01T16:31:55.0423169Z remote: Compressing objects: 88% (222/252) 2024-11-01T16:31:55.0424015Z remote: Compressing objects: 89% (225/252) 2024-11-01T16:31:55.0424844Z remote: Compressing objects: 90% (227/252) 2024-11-01T16:31:55.0425653Z remote: Compressing objects: 91% (230/252) 2024-11-01T16:31:55.0426283Z remote: Compressing objects: 92% (232/252) 2024-11-01T16:31:55.0427247Z remote: Compressing objects: 93% (235/252) 2024-11-01T16:31:55.0427897Z remote: Compressing objects: 94% (237/252) 2024-11-01T16:31:55.0428502Z remote: Compressing objects: 95% (240/252) 2024-11-01T16:31:55.0429035Z remote: Compressing objects: 96% (242/252) 2024-11-01T16:31:55.0429547Z remote: Compressing objects: 97% (245/252) 2024-11-01T16:31:55.0430091Z remote: Compressing objects: 98% (247/252) 2024-11-01T16:31:55.0430629Z remote: Compressing objects: 99% (250/252) 2024-11-01T16:31:55.0431502Z remote: Compressing objects: 100% (252/252) 2024-11-01T16:31:55.0432181Z remote: Compressing objects: 100% (252/252), done. 2024-11-01T16:32:16.4571866Z remote: Total 1053893 (delta 269), reused 370 (delta 215), pack-reused 1053425 (from 1) 2024-11-01T16:32:45.9314596Z [command]/usr/bin/git rev-parse --verify --quiet d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea^{object} 2024-11-01T16:32:45.9343423Z d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:32:45.9347897Z ##[endgroup] 2024-11-01T16:32:45.9348492Z ##[group]Determining the checkout info 2024-11-01T16:32:45.9349786Z ##[endgroup] 2024-11-01T16:32:45.9350287Z ##[group]Checking out the ref 2024-11-01T16:32:45.9353050Z [command]/usr/bin/git checkout --quiet --force d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:32:47.3558816Z ##[endgroup] 2024-11-01T16:32:47.3561455Z ##[group]Setting up auth for fetching submodules 2024-11-01T16:32:47.3564294Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-11-01T16:32:47.3636155Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-11-01T16:32:47.3705889Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-11-01T16:32:47.3707848Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-11-01T16:32:47.3732376Z ##[endgroup] 2024-11-01T16:32:47.3732940Z ##[group]Fetching submodules 2024-11-01T16:32:47.3736479Z [command]/usr/bin/git submodule sync --recursive 2024-11-01T16:32:47.4034399Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-11-01T16:32:47.4320450Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-11-01T16:32:47.4322296Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-11-01T16:32:47.4324190Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-11-01T16:32:47.4325885Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-11-01T16:32:47.4327678Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2024-11-01T16:32:47.4330849Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-11-01T16:32:47.4333219Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-11-01T16:32:47.4336734Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-11-01T16:32:47.4339893Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2024-11-01T16:32:47.4342968Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-11-01T16:32:47.4346130Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-11-01T16:32:47.4349696Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-11-01T16:32:47.4353160Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-11-01T16:32:47.4356849Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-11-01T16:32:47.4361042Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-11-01T16:32:47.4364946Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-11-01T16:32:47.4370445Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-11-01T16:32:47.4374733Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:32:47.4378775Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-11-01T16:32:47.4383173Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-11-01T16:32:47.4387603Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-11-01T16:32:47.4392369Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-11-01T16:32:47.4397013Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-11-01T16:32:47.4401774Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-11-01T16:32:47.4406518Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-11-01T16:32:47.4411440Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-11-01T16:32:47.4416409Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-11-01T16:32:47.4421897Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-11-01T16:32:47.4426912Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-11-01T16:32:47.4432742Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-11-01T16:32:47.4438144Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-11-01T16:32:47.4443712Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-11-01T16:32:47.4449422Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-11-01T16:32:47.4456798Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-11-01T16:32:47.4463253Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-11-01T16:32:47.4469454Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-11-01T16:32:47.4501173Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-11-01T16:32:47.7970299Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-11-01T16:32:48.0013068Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-11-01T16:32:48.1774832Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-11-01T16:32:48.4262315Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2024-11-01T16:32:48.8020213Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-11-01T16:32:51.1279230Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-11-01T16:33:04.6925732Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-11-01T16:33:05.1460023Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2024-11-01T16:33:06.8726023Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-11-01T16:33:07.4362652Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-11-01T16:33:08.0601943Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-11-01T16:33:09.1929666Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-11-01T16:33:11.4133735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-11-01T16:33:17.0069732Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-11-01T16:33:18.9601306Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-11-01T16:33:20.7863927Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-11-01T16:33:22.1720430Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-11-01T16:33:22.5867183Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-11-01T16:33:22.9350735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-11-01T16:33:24.0906623Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-11-01T16:33:24.5016509Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-11-01T16:33:24.7580304Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-11-01T16:33:26.2664694Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-11-01T16:33:27.0582167Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-11-01T16:33:27.4315384Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-11-01T16:33:33.7848314Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-11-01T16:33:36.0979661Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-11-01T16:33:45.6836967Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-11-01T16:33:45.9388339Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-11-01T16:33:56.4973562Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-11-01T16:33:56.6688232Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-11-01T16:33:56.8787074Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-11-01T16:33:58.0471194Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-11-01T16:33:58.3586896Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-11-01T16:33:59.0802007Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-11-01T16:33:59.5341713Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-11-01T16:33:59.5462359Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-11-01T16:33:59.5551703Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-11-01T16:33:59.5790540Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-11-01T16:33:59.6084984Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2024-11-01T16:33:59.6469575Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-11-01T16:34:00.4382998Z Submodule path 'third_party/XNNPACK': checked out '87ee0b46b834f67bad9025d4a82ed5654f3403d3' 2024-11-01T16:34:00.4616975Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-11-01T16:34:00.6665370Z Submodule path 'third_party/composable_kernel': checked out 'cedccd59c94cb0c74e7ec0d0f6c791aed081febc' 2024-11-01T16:34:00.7139305Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-11-01T16:34:00.8098900Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2024-11-01T16:34:00.8437596Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45' 2024-11-01T16:34:01.3387110Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-11-01T16:34:01.5888384Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-11-01T16:34:01.6822499Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-11-01T16:34:01.6841069Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:34:01.6843261Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:34:01.6845903Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:34:01.6848489Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:34:01.6851300Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:34:01.6879294Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-11-01T16:34:02.8040102Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-11-01T16:34:03.4349807Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-11-01T16:34:05.6665550Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-11-01T16:34:06.8309714Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-11-01T16:34:07.1997913Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-11-01T16:34:07.2955365Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-11-01T16:34:07.6956241Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-11-01T16:34:07.7593214Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-11-01T16:34:07.7720480Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-11-01T16:34:07.8885509Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-11-01T16:34:07.9276873Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-11-01T16:34:07.9680945Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-11-01T16:34:07.9937084Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-11-01T16:34:08.0389829Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-11-01T16:34:08.0523127Z Submodule path 'third_party/ideep': checked out '41d636c2bbcea6bff0faf97cdb65a48cdde987af' 2024-11-01T16:34:08.0537572Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-11-01T16:34:08.0562553Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-11-01T16:34:22.1754407Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af' 2024-11-01T16:34:22.1932775Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-11-01T16:34:22.2794053Z Submodule path 'third_party/kineto': checked out 'ed052ea024b9468908d558b15cd3f7584fb0f492' 2024-11-01T16:34:22.2812768Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:34:22.2814695Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:34:22.2816565Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:34:22.2844225Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-11-01T16:34:22.8690058Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-11-01T16:34:24.2783128Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-11-01T16:34:25.5063329Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-11-01T16:34:25.5079085Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:34:25.5081847Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:34:25.5083949Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:34:25.5086776Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:34:25.5089482Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:34:25.5092535Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:34:25.5095498Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:34:25.5098649Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:34:25.5126364Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-11-01T16:34:26.3274491Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-11-01T16:34:26.7198828Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-11-01T16:34:28.1145618Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-11-01T16:34:28.4240225Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-11-01T16:34:29.0664661Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-11-01T16:34:30.2574701Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-11-01T16:34:36.6561109Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-11-01T16:34:37.0558905Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-11-01T16:34:37.0736409Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-11-01T16:34:37.1094105Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-11-01T16:34:37.1223690Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-11-01T16:34:37.1237665Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:34:37.1263789Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-11-01T16:34:37.4391889Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-11-01T16:34:37.4574903Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-11-01T16:34:37.4981600Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-11-01T16:34:37.6018734Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-11-01T16:34:37.6195885Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-11-01T16:34:37.6621427Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-11-01T16:34:37.7219584Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-11-01T16:34:37.7597000Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-11-01T16:34:37.7902669Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-11-01T16:34:37.8932550Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-11-01T16:34:38.2430204Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2024-11-01T16:34:38.2465140Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-11-01T16:34:38.2490658Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-11-01T16:34:39.4297562Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-11-01T16:34:39.4972628Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-11-01T16:34:39.4991032Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:34:39.4993289Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:34:39.4995708Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:34:39.4998053Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:34:39.5000978Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:34:39.5003581Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:34:39.5006597Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:34:39.5009405Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:34:39.5036062Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-11-01T16:34:39.9189436Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-11-01T16:34:41.0532353Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-11-01T16:34:41.3735178Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-11-01T16:34:47.6822149Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-11-01T16:34:47.9729097Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-11-01T16:34:48.1688750Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-11-01T16:34:48.4648172Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-11-01T16:34:54.9990091Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-11-01T16:34:55.0391073Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-11-01T16:34:55.0552328Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-11-01T16:34:55.1531884Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-11-01T16:34:55.1665554Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-11-01T16:34:55.1808651Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-11-01T16:34:55.1960987Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-11-01T16:34:55.1975087Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:34:55.1977322Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:34:55.2001712Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-11-01T16:34:57.3675670Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-11-01T16:34:58.7067127Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-11-01T16:34:58.7527510Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-11-01T16:34:59.2050201Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-11-01T16:34:59.2167397Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-11-01T16:34:59.5010136Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-11-01T16:34:59.5032032Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:34:59.5035388Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-11-01T16:34:59.5060365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-11-01T16:34:59.9755516Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-11-01T16:35:01.1333630Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-11-01T16:35:01.2059739Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-11-01T16:35:01.2149906Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-11-01T16:35:01.2273397Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-11-01T16:35:01.2625991Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2024-11-01T16:35:01.2910487Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-11-01T16:35:01.3328067Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-11-01T16:35:01.3592468Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-11-01T16:35:01.3609033Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:01.3610964Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:01.3613847Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:01.3616493Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:01.3642813Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-11-01T16:35:02.5240725Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-11-01T16:35:02.7748363Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-11-01T16:35:04.1772273Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-11-01T16:35:05.2865329Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-11-01T16:35:05.3018195Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-11-01T16:35:05.3712395Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-11-01T16:35:05.3997554Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-11-01T16:35:05.4013050Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:05.4038535Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-11-01T16:35:05.6285345Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-11-01T16:35:05.6317403Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-11-01T16:35:05.6605281Z Entering 'android/libs/fbjni' 2024-11-01T16:35:05.6644811Z Entering 'third_party/FP16' 2024-11-01T16:35:05.6684763Z Entering 'third_party/FXdiv' 2024-11-01T16:35:05.6723104Z Entering 'third_party/NNPACK' 2024-11-01T16:35:05.6761661Z Entering 'third_party/NVTX' 2024-11-01T16:35:05.6800767Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T16:35:05.6838537Z Entering 'third_party/XNNPACK' 2024-11-01T16:35:05.6894572Z Entering 'third_party/benchmark' 2024-11-01T16:35:05.6932456Z Entering 'third_party/composable_kernel' 2024-11-01T16:35:05.6977654Z Entering 'third_party/cpp-httplib' 2024-11-01T16:35:05.7016755Z Entering 'third_party/cpuinfo' 2024-11-01T16:35:05.7072885Z Entering 'third_party/cudnn_frontend' 2024-11-01T16:35:05.7111617Z Entering 'third_party/cutlass' 2024-11-01T16:35:05.7157392Z Entering 'third_party/eigen' 2024-11-01T16:35:05.7197703Z Entering 'third_party/fbgemm' 2024-11-01T16:35:05.7236180Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:35:05.7277529Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:35:05.7315590Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:35:05.7360345Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:35:05.7398919Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:35:05.7438179Z Entering 'third_party/flatbuffers' 2024-11-01T16:35:05.7481114Z Entering 'third_party/fmt' 2024-11-01T16:35:05.7520019Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:35:05.7559145Z Entering 'third_party/gloo' 2024-11-01T16:35:05.7598184Z Entering 'third_party/googletest' 2024-11-01T16:35:05.7636654Z Entering 'third_party/ideep' 2024-11-01T16:35:05.7674475Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T16:35:05.7720544Z Entering 'third_party/ittapi' 2024-11-01T16:35:05.7759674Z Entering 'third_party/kineto' 2024-11-01T16:35:05.7799143Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:35:05.7837610Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:35:05.7878108Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:35:05.7916771Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:35:05.7955417Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:35:05.7994058Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:35:05.8034587Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:35:05.8073699Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:35:05.8112709Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:35:05.8152121Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:35:05.8193009Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:35:05.8231338Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:35:05.8270608Z Entering 'third_party/mimalloc' 2024-11-01T16:35:05.8310713Z Entering 'third_party/nccl/nccl' 2024-11-01T16:35:05.8349514Z Entering 'third_party/nlohmann' 2024-11-01T16:35:05.8390441Z Entering 'third_party/onnx' 2024-11-01T16:35:05.8446149Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T16:35:05.8489180Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T16:35:05.8530174Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:35:05.8569292Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:35:05.8606789Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:35:05.8644840Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:35:05.8684479Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:35:05.8721925Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:35:05.8759546Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:35:05.8798096Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:35:05.8839034Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:35:05.8879185Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:35:05.8937244Z Entering 'third_party/pocketfft' 2024-11-01T16:35:05.8978106Z Entering 'third_party/protobuf' 2024-11-01T16:35:05.9020129Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:35:05.9059534Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T16:35:05.9099916Z Entering 'third_party/psimd' 2024-11-01T16:35:05.9138618Z Entering 'third_party/pthreadpool' 2024-11-01T16:35:05.9177208Z Entering 'third_party/pybind11' 2024-11-01T16:35:05.9215781Z Entering 'third_party/python-peachpy' 2024-11-01T16:35:05.9254264Z Entering 'third_party/sleef' 2024-11-01T16:35:05.9292543Z Entering 'third_party/tensorpipe' 2024-11-01T16:35:05.9330643Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:05.9369690Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:05.9408138Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:05.9447027Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:05.9486059Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:05.9542510Z ##[endgroup] 2024-11-01T16:35:05.9544561Z ##[group]Persisting credentials for submodules 2024-11-01T16:35:05.9547589Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-11-01T16:35:05.9840450Z Entering 'android/libs/fbjni' 2024-11-01T16:35:05.9894184Z Entering 'third_party/FP16' 2024-11-01T16:35:05.9944821Z Entering 'third_party/FXdiv' 2024-11-01T16:35:05.9997811Z Entering 'third_party/NNPACK' 2024-11-01T16:35:06.0049508Z Entering 'third_party/NVTX' 2024-11-01T16:35:06.0101951Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T16:35:06.0153943Z Entering 'third_party/XNNPACK' 2024-11-01T16:35:06.0223429Z Entering 'third_party/benchmark' 2024-11-01T16:35:06.0275394Z Entering 'third_party/composable_kernel' 2024-11-01T16:35:06.0332282Z Entering 'third_party/cpp-httplib' 2024-11-01T16:35:06.0385187Z Entering 'third_party/cpuinfo' 2024-11-01T16:35:06.0437009Z Entering 'third_party/cudnn_frontend' 2024-11-01T16:35:06.0488299Z Entering 'third_party/cutlass' 2024-11-01T16:35:06.0546705Z Entering 'third_party/eigen' 2024-11-01T16:35:06.0601135Z Entering 'third_party/fbgemm' 2024-11-01T16:35:06.0651726Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:35:06.0703064Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:35:06.0753307Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:35:06.0811110Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:35:06.0861363Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:35:06.0912467Z Entering 'third_party/flatbuffers' 2024-11-01T16:35:06.0966230Z Entering 'third_party/fmt' 2024-11-01T16:35:06.1017244Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:35:06.1067678Z Entering 'third_party/gloo' 2024-11-01T16:35:06.1117302Z Entering 'third_party/googletest' 2024-11-01T16:35:06.1167230Z Entering 'third_party/ideep' 2024-11-01T16:35:06.1216087Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T16:35:06.1273649Z Entering 'third_party/ittapi' 2024-11-01T16:35:06.1326671Z Entering 'third_party/kineto' 2024-11-01T16:35:06.1376807Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:35:06.1427401Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:35:06.1480038Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:35:06.1530129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:35:06.1580329Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:35:06.1628623Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:35:06.1683765Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:35:06.1734808Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:35:06.1784696Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:35:06.1837023Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:35:06.1888439Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:35:06.1938418Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:35:06.1991371Z Entering 'third_party/mimalloc' 2024-11-01T16:35:06.2043305Z Entering 'third_party/nccl/nccl' 2024-11-01T16:35:06.2095145Z Entering 'third_party/nlohmann' 2024-11-01T16:35:06.2146795Z Entering 'third_party/onnx' 2024-11-01T16:35:06.2213026Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T16:35:06.2267418Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T16:35:06.2319521Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:35:06.2368553Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:35:06.2418281Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:35:06.2471227Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:35:06.2523685Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:35:06.2573351Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:35:06.2622313Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:35:06.2671408Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:35:06.2724209Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:35:06.2775663Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:35:06.2845607Z Entering 'third_party/pocketfft' 2024-11-01T16:35:06.2897215Z Entering 'third_party/protobuf' 2024-11-01T16:35:06.2950861Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:35:06.3002396Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T16:35:06.3053442Z Entering 'third_party/psimd' 2024-11-01T16:35:06.3105834Z Entering 'third_party/pthreadpool' 2024-11-01T16:35:06.3155865Z Entering 'third_party/pybind11' 2024-11-01T16:35:06.3206297Z Entering 'third_party/python-peachpy' 2024-11-01T16:35:06.3255710Z Entering 'third_party/sleef' 2024-11-01T16:35:06.3306946Z Entering 'third_party/tensorpipe' 2024-11-01T16:35:06.3355902Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:06.3407094Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:06.3456967Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:06.3507811Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:06.3557003Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:06.3625228Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-11-01T16:35:06.3909298Z Entering 'android/libs/fbjni' 2024-11-01T16:35:06.3955647Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-11-01T16:35:06.3970121Z Entering 'third_party/FP16' 2024-11-01T16:35:06.4017843Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-11-01T16:35:06.4032910Z Entering 'third_party/FXdiv' 2024-11-01T16:35:06.4080706Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-11-01T16:35:06.4095528Z Entering 'third_party/NNPACK' 2024-11-01T16:35:06.4142679Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-11-01T16:35:06.4157694Z Entering 'third_party/NVTX' 2024-11-01T16:35:06.4206256Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2024-11-01T16:35:06.4223280Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T16:35:06.4270235Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-11-01T16:35:06.4285002Z Entering 'third_party/XNNPACK' 2024-11-01T16:35:06.4332251Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-11-01T16:35:06.4364085Z Entering 'third_party/benchmark' 2024-11-01T16:35:06.4411144Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-11-01T16:35:06.4425727Z Entering 'third_party/composable_kernel' 2024-11-01T16:35:06.4474047Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2024-11-01T16:35:06.4494316Z Entering 'third_party/cpp-httplib' 2024-11-01T16:35:06.4540672Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-11-01T16:35:06.4555312Z Entering 'third_party/cpuinfo' 2024-11-01T16:35:06.4602301Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-11-01T16:35:06.4617476Z Entering 'third_party/cudnn_frontend' 2024-11-01T16:35:06.4665800Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-11-01T16:35:06.4680928Z Entering 'third_party/cutlass' 2024-11-01T16:35:06.4727488Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-11-01T16:35:06.4749803Z Entering 'third_party/eigen' 2024-11-01T16:35:06.4797341Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-11-01T16:35:06.4814775Z Entering 'third_party/fbgemm' 2024-11-01T16:35:06.4862417Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-11-01T16:35:06.4877306Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:35:06.4924157Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-11-01T16:35:06.4938310Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:35:06.4985380Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-11-01T16:35:06.5000715Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:35:06.5047527Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-11-01T16:35:06.5069171Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:35:06.5115627Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.5129792Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:35:06.5176388Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-11-01T16:35:06.5192152Z Entering 'third_party/flatbuffers' 2024-11-01T16:35:06.5242508Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-11-01T16:35:06.5261286Z Entering 'third_party/fmt' 2024-11-01T16:35:06.5310222Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-11-01T16:35:06.5325810Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:35:06.5372808Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-11-01T16:35:06.5387580Z Entering 'third_party/gloo' 2024-11-01T16:35:06.5433785Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-11-01T16:35:06.5448919Z Entering 'third_party/googletest' 2024-11-01T16:35:06.5495719Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.5510915Z Entering 'third_party/ideep' 2024-11-01T16:35:06.5557916Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-11-01T16:35:06.5572627Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T16:35:06.5620525Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-11-01T16:35:06.5643712Z Entering 'third_party/ittapi' 2024-11-01T16:35:06.5693574Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-11-01T16:35:06.5708680Z Entering 'third_party/kineto' 2024-11-01T16:35:06.5757782Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-11-01T16:35:06.5773478Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:35:06.5824244Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-11-01T16:35:06.5838870Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:35:06.5888145Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-11-01T16:35:06.5904296Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:35:06.5950521Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-11-01T16:35:06.5965520Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:35:06.6012377Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-11-01T16:35:06.6026807Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:35:06.6074169Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-11-01T16:35:06.6087812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:35:06.6136114Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-11-01T16:35:06.6152763Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:35:06.6200055Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-11-01T16:35:06.6214745Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:35:06.6261847Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.6276115Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:35:06.6322767Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-11-01T16:35:06.6338158Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:35:06.6385910Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-11-01T16:35:06.6402454Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:35:06.6450477Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-11-01T16:35:06.6464564Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:35:06.6511912Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.6527886Z Entering 'third_party/mimalloc' 2024-11-01T16:35:06.6577000Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-11-01T16:35:06.6591980Z Entering 'third_party/nccl/nccl' 2024-11-01T16:35:06.6640596Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-11-01T16:35:06.6655848Z Entering 'third_party/nlohmann' 2024-11-01T16:35:06.6703757Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-11-01T16:35:06.6719904Z Entering 'third_party/onnx' 2024-11-01T16:35:06.6772319Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-11-01T16:35:06.6803151Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T16:35:06.6849904Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-11-01T16:35:06.6867053Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T16:35:06.6915882Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-11-01T16:35:06.6932036Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:35:06.6978776Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-11-01T16:35:06.6993138Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:35:06.7038973Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.7052739Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:35:06.7098470Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-11-01T16:35:06.7112505Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:35:06.7158423Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-11-01T16:35:06.7174081Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:35:06.7219457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-11-01T16:35:06.7233490Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:35:06.7279352Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-11-01T16:35:06.7293238Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:35:06.7339531Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-11-01T16:35:06.7352924Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:35:06.7400054Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-11-01T16:35:06.7416155Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:35:06.7464599Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-11-01T16:35:06.7480539Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:35:06.7529478Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-11-01T16:35:06.7565973Z Entering 'third_party/pocketfft' 2024-11-01T16:35:06.7615666Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-11-01T16:35:06.7631028Z Entering 'third_party/protobuf' 2024-11-01T16:35:06.7679936Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-11-01T16:35:06.7698357Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:35:06.7745874Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-11-01T16:35:06.7760783Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T16:35:06.7807516Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.7823680Z Entering 'third_party/psimd' 2024-11-01T16:35:06.7874795Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-11-01T16:35:06.7889725Z Entering 'third_party/pthreadpool' 2024-11-01T16:35:06.7937990Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-11-01T16:35:06.7953455Z Entering 'third_party/pybind11' 2024-11-01T16:35:06.8001912Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-11-01T16:35:06.8016617Z Entering 'third_party/python-peachpy' 2024-11-01T16:35:06.8063871Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-11-01T16:35:06.8079642Z Entering 'third_party/sleef' 2024-11-01T16:35:06.8126023Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-11-01T16:35:06.8141457Z Entering 'third_party/tensorpipe' 2024-11-01T16:35:06.8190250Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-11-01T16:35:06.8204322Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:06.8252608Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-11-01T16:35:06.8268379Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:06.8316693Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-11-01T16:35:06.8331483Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:06.8378769Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-11-01T16:35:06.8393700Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:06.8441197Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-11-01T16:35:06.8453934Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:06.8502274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-11-01T16:35:06.9207845Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-11-01T16:35:06.9497159Z Entering 'android/libs/fbjni' 2024-11-01T16:35:06.9537241Z Entering 'third_party/FP16' 2024-11-01T16:35:06.9576445Z Entering 'third_party/FXdiv' 2024-11-01T16:35:06.9615351Z Entering 'third_party/NNPACK' 2024-11-01T16:35:06.9654038Z Entering 'third_party/NVTX' 2024-11-01T16:35:06.9693278Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T16:35:06.9731821Z Entering 'third_party/XNNPACK' 2024-11-01T16:35:06.9786850Z Entering 'third_party/benchmark' 2024-11-01T16:35:06.9824885Z Entering 'third_party/composable_kernel' 2024-11-01T16:35:06.9868940Z Entering 'third_party/cpp-httplib' 2024-11-01T16:35:06.9907309Z Entering 'third_party/cpuinfo' 2024-11-01T16:35:06.9945940Z Entering 'third_party/cudnn_frontend' 2024-11-01T16:35:06.9984792Z Entering 'third_party/cutlass' 2024-11-01T16:35:07.0031616Z Entering 'third_party/eigen' 2024-11-01T16:35:07.0072868Z Entering 'third_party/fbgemm' 2024-11-01T16:35:07.0112001Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:35:07.0150842Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:35:07.0191246Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:35:07.0235468Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:35:07.0274071Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:35:07.0313603Z Entering 'third_party/flatbuffers' 2024-11-01T16:35:07.0356129Z Entering 'third_party/fmt' 2024-11-01T16:35:07.0395268Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:35:07.0434374Z Entering 'third_party/gloo' 2024-11-01T16:35:07.0472723Z Entering 'third_party/googletest' 2024-11-01T16:35:07.0510870Z Entering 'third_party/ideep' 2024-11-01T16:35:07.0548353Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T16:35:07.0593969Z Entering 'third_party/ittapi' 2024-11-01T16:35:07.0633315Z Entering 'third_party/kineto' 2024-11-01T16:35:07.0673403Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:35:07.0712122Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:35:07.0752216Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:35:07.0792130Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:35:07.0831466Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:35:07.0870512Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:35:07.0910812Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:35:07.0947970Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:35:07.0985685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:35:07.1024563Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:35:07.1065108Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:35:07.1102788Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:35:07.1142259Z Entering 'third_party/mimalloc' 2024-11-01T16:35:07.1182941Z Entering 'third_party/nccl/nccl' 2024-11-01T16:35:07.1221242Z Entering 'third_party/nlohmann' 2024-11-01T16:35:07.1262021Z Entering 'third_party/onnx' 2024-11-01T16:35:07.1316348Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T16:35:07.1357637Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T16:35:07.1399821Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:35:07.1437937Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:35:07.1475604Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:35:07.1512625Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:35:07.1551333Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:35:07.1588385Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:35:07.1625632Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:35:07.1664050Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:35:07.1704499Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:35:07.1743863Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:35:07.1802498Z Entering 'third_party/pocketfft' 2024-11-01T16:35:07.1841873Z Entering 'third_party/protobuf' 2024-11-01T16:35:07.1883809Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:35:07.1921741Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T16:35:07.1961317Z Entering 'third_party/psimd' 2024-11-01T16:35:07.2000506Z Entering 'third_party/pthreadpool' 2024-11-01T16:35:07.2038720Z Entering 'third_party/pybind11' 2024-11-01T16:35:07.2077452Z Entering 'third_party/python-peachpy' 2024-11-01T16:35:07.2115213Z Entering 'third_party/sleef' 2024-11-01T16:35:07.2153192Z Entering 'third_party/tensorpipe' 2024-11-01T16:35:07.2193076Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:07.2230781Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:07.2267728Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:07.2305259Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:07.2341843Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:07.2401786Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-11-01T16:35:07.2686478Z Entering 'android/libs/fbjni' 2024-11-01T16:35:07.2726880Z Entering 'third_party/FP16' 2024-11-01T16:35:07.2765117Z Entering 'third_party/FXdiv' 2024-11-01T16:35:07.2802691Z Entering 'third_party/NNPACK' 2024-11-01T16:35:07.2840638Z Entering 'third_party/NVTX' 2024-11-01T16:35:07.2879316Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T16:35:07.2917231Z Entering 'third_party/XNNPACK' 2024-11-01T16:35:07.2972009Z Entering 'third_party/benchmark' 2024-11-01T16:35:07.3010681Z Entering 'third_party/composable_kernel' 2024-11-01T16:35:07.3054358Z Entering 'third_party/cpp-httplib' 2024-11-01T16:35:07.3093457Z Entering 'third_party/cpuinfo' 2024-11-01T16:35:07.3132518Z Entering 'third_party/cudnn_frontend' 2024-11-01T16:35:07.3170845Z Entering 'third_party/cutlass' 2024-11-01T16:35:07.3216710Z Entering 'third_party/eigen' 2024-11-01T16:35:07.3257030Z Entering 'third_party/fbgemm' 2024-11-01T16:35:07.3296007Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T16:35:07.3333744Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T16:35:07.3371693Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T16:35:07.3415390Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T16:35:07.3452792Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T16:35:07.3491873Z Entering 'third_party/flatbuffers' 2024-11-01T16:35:07.3533162Z Entering 'third_party/fmt' 2024-11-01T16:35:07.3572236Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T16:35:07.3611135Z Entering 'third_party/gloo' 2024-11-01T16:35:07.3649204Z Entering 'third_party/googletest' 2024-11-01T16:35:07.3690829Z Entering 'third_party/ideep' 2024-11-01T16:35:07.3728078Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T16:35:07.3773831Z Entering 'third_party/ittapi' 2024-11-01T16:35:07.3812508Z Entering 'third_party/kineto' 2024-11-01T16:35:07.3851860Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T16:35:07.3891834Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T16:35:07.3931168Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T16:35:07.3969774Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T16:35:07.4008188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T16:35:07.4045346Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T16:35:07.4085760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T16:35:07.4124956Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T16:35:07.4163446Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T16:35:07.4202292Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T16:35:07.4241431Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T16:35:07.4278631Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T16:35:07.4318034Z Entering 'third_party/mimalloc' 2024-11-01T16:35:07.4358756Z Entering 'third_party/nccl/nccl' 2024-11-01T16:35:07.4397353Z Entering 'third_party/nlohmann' 2024-11-01T16:35:07.4438660Z Entering 'third_party/onnx' 2024-11-01T16:35:07.4494037Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T16:35:07.4534633Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T16:35:07.4574745Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T16:35:07.4612113Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T16:35:07.4649034Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T16:35:07.4688064Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T16:35:07.4726262Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T16:35:07.4762716Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T16:35:07.4798825Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T16:35:07.4835210Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T16:35:07.4875563Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T16:35:07.4915158Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T16:35:07.4974311Z Entering 'third_party/pocketfft' 2024-11-01T16:35:07.5013252Z Entering 'third_party/protobuf' 2024-11-01T16:35:07.5055324Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T16:35:07.5093908Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T16:35:07.5133896Z Entering 'third_party/psimd' 2024-11-01T16:35:07.5172682Z Entering 'third_party/pthreadpool' 2024-11-01T16:35:07.5210852Z Entering 'third_party/pybind11' 2024-11-01T16:35:07.5249095Z Entering 'third_party/python-peachpy' 2024-11-01T16:35:07.5287375Z Entering 'third_party/sleef' 2024-11-01T16:35:07.5326023Z Entering 'third_party/tensorpipe' 2024-11-01T16:35:07.5365770Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T16:35:07.5403663Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T16:35:07.5440468Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T16:35:07.5478123Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T16:35:07.5515281Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T16:35:07.5567378Z ##[endgroup] 2024-11-01T16:35:07.5606186Z [command]/usr/bin/git log -1 --format='%H' 2024-11-01T16:35:07.5640946Z 'd1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea' 2024-11-01T16:35:07.5834857Z Prepare all required actions 2024-11-01T16:35:07.5835363Z Getting action download info 2024-11-01T16:35:07.7233070Z ##[group]Run ./.github/actions/setup-linux 2024-11-01T16:35:07.7233508Z env: 2024-11-01T16:35:07.7233793Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:07.7234132Z ##[endgroup] 2024-11-01T16:35:07.7314879Z ##[group]Run set -euo pipefail 2024-11-01T16:35:07.7315307Z set -euo pipefail 2024-11-01T16:35:07.7315693Z function get_ec2_metadata() { 2024-11-01T16:35:07.7316235Z  # Pulled from instance metadata endpoint for EC2 2024-11-01T16:35:07.7317173Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-11-01T16:35:07.7317970Z  category=$1 2024-11-01T16:35:07.7318503Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-11-01T16:35:07.7319131Z  runner_name_str=i-02f620357bfb2a39d 2024-11-01T16:35:07.7319650Z  if [[ -f /.inarc ]]; then 2024-11-01T16:35:07.7320128Z  echo "ARC Runner, no info on ec2 metadata" 2024-11-01T16:35:07.7320698Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-11-01T16:35:07.7321394Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-11-01T16:35:07.7322021Z  else 2024-11-01T16:35:07.7323290Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-11-01T16:35:07.7324637Z  fi 2024-11-01T16:35:07.7324912Z } 2024-11-01T16:35:07.7325254Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-11-01T16:35:07.7325845Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-11-01T16:35:07.7326507Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-11-01T16:35:07.7327080Z echo "system info $(uname -a)" 2024-11-01T16:35:07.7336311Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:07.7336817Z env: 2024-11-01T16:35:07.7337069Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:07.7337463Z ##[endgroup] 2024-11-01T16:35:07.7499992Z ami-id: ami-0fff1b9a61dec8a5f 2024-11-01T16:35:07.7602892Z instance-id: i-02f620357bfb2a39d 2024-11-01T16:35:07.7700576Z instance-type: c5.2xlarge 2024-11-01T16:35:07.7710250Z system info Linux ip-10-0-46-81.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-11-01T16:35:07.7735349Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:35:07.7736698Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:35:07.7743607Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:07.7744128Z env: 2024-11-01T16:35:07.7744397Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:07.7744737Z ##[endgroup] 2024-11-01T16:35:07.7799671Z ##[group]Run if systemctl is-active --quiet docker; then 2024-11-01T16:35:07.7800282Z if systemctl is-active --quiet docker; then 2024-11-01T16:35:07.7800959Z  echo "Docker daemon is running..."; 2024-11-01T16:35:07.7801407Z else 2024-11-01T16:35:07.7801949Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-11-01T16:35:07.7802534Z fi 2024-11-01T16:35:07.7808290Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:07.7808774Z env: 2024-11-01T16:35:07.7809042Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:07.7809394Z ##[endgroup] 2024-11-01T16:35:07.7888097Z Docker daemon is running... 2024-11-01T16:35:07.7946683Z ##[group]Run nick-fields/retry@v3.0.0 2024-11-01T16:35:07.7947065Z with: 2024-11-01T16:35:07.7947327Z shell: bash 2024-11-01T16:35:07.7947816Z timeout_minutes: 5 2024-11-01T16:35:07.7948137Z max_attempts: 3 2024-11-01T16:35:07.7948538Z retry_wait_seconds: 30 2024-11-01T16:35:07.7951697Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-11-01T16:35:07.7954928Z polling_interval_seconds: 1 2024-11-01T16:35:07.7955298Z warning_on_retry: true 2024-11-01T16:35:07.7955624Z continue_on_error: false 2024-11-01T16:35:07.7955953Z env: 2024-11-01T16:35:07.7956217Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:07.7956621Z AWS_RETRY_MODE: standard 2024-11-01T16:35:07.7956963Z AWS_MAX_ATTEMPTS: 5 2024-11-01T16:35:07.7957284Z AWS_DEFAULT_REGION: us-east-1 2024-11-01T16:35:07.7957655Z ##[endgroup] 2024-11-01T16:35:09.0936983Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-11-01T16:35:09.0938088Z Configure a credential helper to remove this warning. See 2024-11-01T16:35:09.0939463Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-11-01T16:35:09.0940180Z 2024-11-01T16:35:09.0940307Z Login Succeeded 2024-11-01T16:35:09.8812373Z Command completed after 1 attempt(s). 2024-11-01T16:35:09.8878591Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-11-01T16:35:09.8879333Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-11-01T16:35:09.8879998Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-11-01T16:35:09.8886554Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:09.8887061Z env: 2024-11-01T16:35:09.8887329Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:09.8887664Z ##[endgroup] 2024-11-01T16:35:09.8993335Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-11-01T16:35:09.8994189Z # ignore expansion of "docker ps -q" since it could be empty 2024-11-01T16:35:09.8994930Z # shellcheck disable=SC2046 2024-11-01T16:35:09.8995396Z docker stop $(docker ps -q) || true 2024-11-01T16:35:09.8996027Z # Prune all of the docker images 2024-11-01T16:35:09.8996480Z docker system prune -af 2024-11-01T16:35:09.9003228Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:09.9003718Z env: 2024-11-01T16:35:09.9003989Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:09.9004327Z ##[endgroup] 2024-11-01T16:35:09.9285867Z "docker stop" requires at least 1 argument. 2024-11-01T16:35:09.9286618Z See 'docker stop --help'. 2024-11-01T16:35:09.9286853Z 2024-11-01T16:35:09.9287247Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-11-01T16:35:09.9287711Z 2024-11-01T16:35:09.9288627Z Stop one or more running containers 2024-11-01T16:35:09.9631040Z Total reclaimed space: 0B 2024-11-01T16:35:09.9723747Z ##[group]Run set +e 2024-11-01T16:35:09.9724063Z set +e 2024-11-01T16:35:09.9724327Z set -x 2024-11-01T16:35:09.9724580Z  2024-11-01T16:35:09.9724864Z PT_DOMAIN=download.pytorch.org 2024-11-01T16:35:09.9725668Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-11-01T16:35:09.9726775Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-11-01T16:35:09.9727524Z # one is returned at random 2024-11-01T16:35:09.9728041Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-11-01T16:35:09.9728526Z  2024-11-01T16:35:09.9728954Z if [ -z "${RESOLVED_IP}" ]; then 2024-11-01T16:35:09.9729575Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-11-01T16:35:09.9730330Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-11-01T16:35:09.9730879Z  2024-11-01T16:35:09.9731169Z  if [ -z "${RESOLVED_IP}" ]; then 2024-11-01T16:35:09.9731693Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-11-01T16:35:09.9732170Z  exit 1 2024-11-01T16:35:09.9732450Z  fi 2024-11-01T16:35:09.9732700Z fi 2024-11-01T16:35:09.9732944Z  2024-11-01T16:35:09.9733386Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-11-01T16:35:09.9733901Z  # Clean up any old records first 2024-11-01T16:35:09.9734386Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-11-01T16:35:09.9734816Z fi 2024-11-01T16:35:09.9735057Z  2024-11-01T16:35:09.9735460Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-11-01T16:35:09.9735996Z cat /etc/hosts 2024-11-01T16:35:09.9742143Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:09.9742625Z env: 2024-11-01T16:35:09.9742886Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:09.9743231Z ##[endgroup] 2024-11-01T16:35:09.9768265Z + PT_DOMAIN=download.pytorch.org 2024-11-01T16:35:09.9774547Z ++ dig -4 +short download.pytorch.org 2024-11-01T16:35:09.9775031Z ++ tail -n1 2024-11-01T16:35:10.0206152Z + RESOLVED_IP=18.160.10.36 2024-11-01T16:35:10.0206977Z + '[' -z 18.160.10.36 ']' 2024-11-01T16:35:10.0207712Z + grep -r download.pytorch.org /etc/hosts 2024-11-01T16:35:10.0221706Z + echo '18.160.10.36 download.pytorch.org' 2024-11-01T16:35:10.0222737Z + sudo tee -a /etc/hosts 2024-11-01T16:35:10.2758920Z 18.160.10.36 download.pytorch.org 2024-11-01T16:35:10.2776756Z + cat /etc/hosts 2024-11-01T16:35:10.2784908Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-11-01T16:35:10.2800813Z ::1 localhost6 localhost6.localdomain6 2024-11-01T16:35:10.2801487Z 18.160.10.36 download.pytorch.org 2024-11-01T16:35:10.3029254Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-11-01T16:35:10.3029883Z with: 2024-11-01T16:35:10.3030805Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3031849Z docker-build-dir: .ci/docker 2024-11-01T16:35:10.3032219Z working-directory: . 2024-11-01T16:35:10.3032674Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.3033202Z force-push: false 2024-11-01T16:35:10.3033491Z env: 2024-11-01T16:35:10.3033774Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:10.3034107Z ##[endgroup] 2024-11-01T16:35:10.3061603Z ##[group]Run set -ex 2024-11-01T16:35:10.3061974Z set -ex 2024-11-01T16:35:10.3062259Z  2024-11-01T16:35:10.3062818Z # If the docker build directory or the build script doesn't exist, the action will 2024-11-01T16:35:10.3063879Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-11-01T16:35:10.3064698Z # job could then download the pre-built image as usual 2024-11-01T16:35:10.3065588Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-11-01T16:35:10.3066274Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3066915Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3067536Z  2024-11-01T16:35:10.3068047Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-11-01T16:35:10.3068751Z  exit 0 2024-11-01T16:35:10.3069031Z else 2024-11-01T16:35:10.3069387Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3069836Z fi 2024-11-01T16:35:10.3070098Z  2024-11-01T16:35:10.3070555Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-11-01T16:35:10.3071436Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-11-01T16:35:10.3072210Z  # use it as it is, but first let's extract the tag 2024-11-01T16:35:10.3072923Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-11-01T16:35:10.3073659Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3074367Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3074930Z else 2024-11-01T16:35:10.3075360Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-11-01T16:35:10.3076032Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3076937Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3077703Z fi 2024-11-01T16:35:10.3086174Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:10.3086662Z env: 2024-11-01T16:35:10.3086938Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:10.3087320Z REPO_NAME: pytorch 2024-11-01T16:35:10.3088344Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3089374Z DOCKER_BUILD_DIR: .ci/docker 2024-11-01T16:35:10.3089872Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.3090379Z ##[endgroup] 2024-11-01T16:35:10.3119486Z + [[ ! -d .ci/docker ]] 2024-11-01T16:35:10.3120435Z + [[ ! -f .ci/docker/build.sh ]] 2024-11-01T16:35:10.3121242Z + echo skip=false 2024-11-01T16:35:10.3122962Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-11-01T16:35:10.3128034Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3129461Z ++ awk -F '[:,]' '{print $2}' 2024-11-01T16:35:10.3148009Z + DOCKER_TAG=bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3149118Z + echo docker-tag=bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3150633Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3186125Z ##[group]Run set +e 2024-11-01T16:35:10.3186543Z set +e 2024-11-01T16:35:10.3186833Z set -x 2024-11-01T16:35:10.3187110Z  2024-11-01T16:35:10.3187436Z login() { 2024-11-01T16:35:10.3188095Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-11-01T16:35:10.3188931Z } 2024-11-01T16:35:10.3189193Z  2024-11-01T16:35:10.3189454Z retry () { 2024-11-01T16:35:10.3189841Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-11-01T16:35:10.3190285Z } 2024-11-01T16:35:10.3190533Z  2024-11-01T16:35:10.3190979Z retry login "${DOCKER_REGISTRY}" 2024-11-01T16:35:10.3191390Z  2024-11-01T16:35:10.3191864Z # Check if image already exists, if it does then skip building it 2024-11-01T16:35:10.3192585Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-11-01T16:35:10.3193209Z  exit 0 2024-11-01T16:35:10.3193680Z fi 2024-11-01T16:35:10.3194010Z  2024-11-01T16:35:10.3194509Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-11-01T16:35:10.3195459Z # be empty. The default action would be to continue rebuild the image 2024-11-01T16:35:10.3196211Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-11-01T16:35:10.3196880Z  # if we're on the base branch then use the parent commit 2024-11-01T16:35:10.3197616Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-11-01T16:35:10.3198225Z else 2024-11-01T16:35:10.3198784Z  # otherwise we're on a PR, so use the most recent base commit 2024-11-01T16:35:10.3199496Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-11-01T16:35:10.3200080Z fi 2024-11-01T16:35:10.3200488Z  2024-11-01T16:35:10.3200794Z if [[ -z "${MERGE_BASE}" ]]; then 2024-11-01T16:35:10.3201672Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3202269Z  2024-11-01T16:35:10.3203151Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-11-01T16:35:10.3203942Z  exit 0 2024-11-01T16:35:10.3204217Z fi 2024-11-01T16:35:10.3204480Z  2024-11-01T16:35:10.3204910Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-11-01T16:35:10.3205921Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-11-01T16:35:10.3207221Z  exit 1 2024-11-01T16:35:10.3207520Z fi 2024-11-01T16:35:10.3207983Z  2024-11-01T16:35:10.3208475Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-11-01T16:35:10.3210409Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-11-01T16:35:10.3211307Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-11-01T16:35:10.3212305Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-11-01T16:35:10.3214154Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-11-01T16:35:10.3214816Z fi 2024-11-01T16:35:10.3215084Z  2024-11-01T16:35:10.3215439Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-11-01T16:35:10.3222219Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:10.3222730Z env: 2024-11-01T16:35:10.3222997Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:10.3223351Z DOCKER_BUILD_DIR: .ci/docker 2024-11-01T16:35:10.3223818Z BASE_REVISION: 2055d3c8dc8b93c52eda6b9c07d716448d9e28c9 2024-11-01T16:35:10.3224911Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3225983Z DOCKER_TAG: bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:10.3226592Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.3227115Z ##[endgroup] 2024-11-01T16:35:10.3254658Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.3255322Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.3257839Z + aws ecr get-login-password --region us-east-1 2024-11-01T16:35:10.3259551Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:10.9189869Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-11-01T16:35:10.9191259Z Configure a credential helper to remove this warning. See 2024-11-01T16:35:10.9192146Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-11-01T16:35:10.9192692Z 2024-11-01T16:35:10.9192810Z Login Succeeded 2024-11-01T16:35:10.9202339Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.1356987Z { 2024-11-01T16:35:11.1357494Z "schemaVersion": 2, 2024-11-01T16:35:11.1358289Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-11-01T16:35:11.1359323Z "config": { 2024-11-01T16:35:11.1360017Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-11-01T16:35:11.1360881Z "size": 45977, 2024-11-01T16:35:11.1361811Z "digest": "sha256:acd5ab414b6754b1ba1fbfceff9d37aa2af65d736e970c726d477963e8596d49" 2024-11-01T16:35:11.1362803Z }, 2024-11-01T16:35:11.1363172Z "layers": [ 2024-11-01T16:35:11.1363617Z { 2024-11-01T16:35:11.1364352Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1365259Z "size": 30439933, 2024-11-01T16:35:11.1366191Z "digest": "sha256:7478e0ac0f23f94b2f27848fbcdf804a670fbf8d4bab26df842d40a10cd33059" 2024-11-01T16:35:11.1367526Z }, 2024-11-01T16:35:11.1367938Z { 2024-11-01T16:35:11.1368695Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1369682Z "size": 1822, 2024-11-01T16:35:11.1370556Z "digest": "sha256:ad0341f900ba4169726d094fc9b175b444e43083e7a41767b567d258755520df" 2024-11-01T16:35:11.1371633Z }, 2024-11-01T16:35:11.1372013Z { 2024-11-01T16:35:11.1372735Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1373731Z "size": 313176109, 2024-11-01T16:35:11.1374736Z "digest": "sha256:be63e049eed381057c26b89dbe1a5af32980caf444535353763f260883778b0f" 2024-11-01T16:35:11.1375806Z }, 2024-11-01T16:35:11.1376210Z { 2024-11-01T16:35:11.1376937Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1377953Z "size": 863, 2024-11-01T16:35:11.1378970Z "digest": "sha256:7b58778274e4907eb77a53e6b0cf6463f3c8bfc16fdf98d82689b6b6587d4eb2" 2024-11-01T16:35:11.1380155Z }, 2024-11-01T16:35:11.1380590Z { 2024-11-01T16:35:11.1381384Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1382393Z "size": 106, 2024-11-01T16:35:11.1383390Z "digest": "sha256:5252fbf945ae2f66a546f585125adcdd4d649a9d52affc5aa0c3dbc8562383d4" 2024-11-01T16:35:11.1384596Z }, 2024-11-01T16:35:11.1385025Z { 2024-11-01T16:35:11.1385800Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1386864Z "size": 703, 2024-11-01T16:35:11.1388247Z "digest": "sha256:f88e6e245d17df41885b0e0b50d0bbf5fcf08cb77bbe5f9abdfe4160a41c941f" 2024-11-01T16:35:11.1389627Z }, 2024-11-01T16:35:11.1390062Z { 2024-11-01T16:35:11.1390856Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1391922Z "size": 1218, 2024-11-01T16:35:11.1392942Z "digest": "sha256:d2fc2f6d6c5f1f51f1f9f6dbf384df57f88442d4aa80b19db8df5c57f6816eb0" 2024-11-01T16:35:11.1394113Z }, 2024-11-01T16:35:11.1394554Z { 2024-11-01T16:35:11.1395317Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1395960Z "size": 484, 2024-11-01T16:35:11.1396522Z "digest": "sha256:8db79f4cc8cc3ddbbcfbe4298ca789f53943cbe08b801b0ead12437dfa1578bc" 2024-11-01T16:35:11.1397173Z }, 2024-11-01T16:35:11.1397405Z { 2024-11-01T16:35:11.1397837Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1398400Z "size": 110322453, 2024-11-01T16:35:11.1398944Z "digest": "sha256:8f875d71a923483cee22a59531af7746a05a5761d41cabea5514660597dc9099" 2024-11-01T16:35:11.1399576Z }, 2024-11-01T16:35:11.1399808Z { 2024-11-01T16:35:11.1400237Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1401019Z "size": 4119, 2024-11-01T16:35:11.1401559Z "digest": "sha256:d4816a7d80f80b60067bbbfb0445c6df4e0a2f6e69bb501787127ccc2d0a4e03" 2024-11-01T16:35:11.1402211Z }, 2024-11-01T16:35:11.1402450Z { 2024-11-01T16:35:11.1402883Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1403449Z "size": 1801, 2024-11-01T16:35:11.1403986Z "digest": "sha256:2d6bd9e42551a4a156f25c19a7fe61e68252cc88d3f6452e3cb28bebf1357b03" 2024-11-01T16:35:11.1404613Z }, 2024-11-01T16:35:11.1404844Z { 2024-11-01T16:35:11.1405276Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1405840Z "size": 701, 2024-11-01T16:35:11.1406381Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1406985Z }, 2024-11-01T16:35:11.1407219Z { 2024-11-01T16:35:11.1407648Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1408210Z "size": 2803789884, 2024-11-01T16:35:11.1408778Z "digest": "sha256:96047d905613a9bad3fff00cab771685ec4ed5d6811502b45be68418b37368a4" 2024-11-01T16:35:11.1409387Z }, 2024-11-01T16:35:11.1409619Z { 2024-11-01T16:35:11.1410046Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1410603Z "size": 32, 2024-11-01T16:35:11.1411155Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1411780Z }, 2024-11-01T16:35:11.1412012Z { 2024-11-01T16:35:11.1412440Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1413000Z "size": 379, 2024-11-01T16:35:11.1413547Z "digest": "sha256:b79cecd6800959fe47b950e969ab4799d268cd7b822143bd7e4c2ffdf173d14f" 2024-11-01T16:35:11.1414383Z + exit 0 2024-11-01T16:35:11.1414614Z }, 2024-11-01T16:35:11.1414849Z { 2024-11-01T16:35:11.1415275Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1415835Z "size": 232174, 2024-11-01T16:35:11.1416407Z "digest": "sha256:efe1e385dc9e6129ba1ce09f274a24e288c5fcb30f5a9ad0cac51d4f9674b2ec" 2024-11-01T16:35:11.1417030Z }, 2024-11-01T16:35:11.1417261Z { 2024-11-01T16:35:11.1417691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1418249Z "size": 230, 2024-11-01T16:35:11.1418791Z "digest": "sha256:adeab13bac13b551938d4b48819331e51815c24629fe276f34937c1570a904ed" 2024-11-01T16:35:11.1419398Z }, 2024-11-01T16:35:11.1419629Z { 2024-11-01T16:35:11.1420057Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1420618Z "size": 3235670, 2024-11-01T16:35:11.1421177Z "digest": "sha256:24b41e0168fafa36f581e5fa51df4d5c48fb686867ae1f184860c8eee7537483" 2024-11-01T16:35:11.1421799Z }, 2024-11-01T16:35:11.1422033Z { 2024-11-01T16:35:11.1422563Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1423165Z "size": 1954, 2024-11-01T16:35:11.1423699Z "digest": "sha256:707cc0109119630d83e1c884c0250a24d99900309456ae11e6e8b3755af86b2a" 2024-11-01T16:35:11.1424318Z }, 2024-11-01T16:35:11.1424537Z { 2024-11-01T16:35:11.1424971Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1425538Z "size": 105, 2024-11-01T16:35:11.1426089Z "digest": "sha256:c5fa30c2a598a04cd4c417b6187230e12ddbe39c9dc38338e425414c5c148d4a" 2024-11-01T16:35:11.1426717Z }, 2024-11-01T16:35:11.1426934Z { 2024-11-01T16:35:11.1427363Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1427921Z "size": 565, 2024-11-01T16:35:11.1428598Z "digest": "sha256:7c311ff0f8ed17f85cce86bf63f9e9587521fa8ac6c5f21d6face105b4e7703c" 2024-11-01T16:35:11.1429251Z }, 2024-11-01T16:35:11.1429473Z { 2024-11-01T16:35:11.1429914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1430476Z "size": 32, 2024-11-01T16:35:11.1431030Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1431748Z }, 2024-11-01T16:35:11.1431968Z { 2024-11-01T16:35:11.1432405Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1432973Z "size": 104, 2024-11-01T16:35:11.1433514Z "digest": "sha256:6d067a971ea00018d0503daa88fb7473d272e19b039874532b929452d24df868" 2024-11-01T16:35:11.1434131Z }, 2024-11-01T16:35:11.1434366Z { 2024-11-01T16:35:11.1434784Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1435346Z "size": 504, 2024-11-01T16:35:11.1435891Z "digest": "sha256:32a0e0f8d213a1427ff7110069e3d4d3b90cb24b57ede9a30e7b573d649de137" 2024-11-01T16:35:11.1436519Z }, 2024-11-01T16:35:11.1436752Z { 2024-11-01T16:35:11.1437169Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1437741Z "size": 101109882, 2024-11-01T16:35:11.1438299Z "digest": "sha256:6759707dde2383b2b9b6e94894c3acf5619203cc57661e577906f3529c552a57" 2024-11-01T16:35:11.1438918Z }, 2024-11-01T16:35:11.1439148Z { 2024-11-01T16:35:11.1439561Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1440120Z "size": 109, 2024-11-01T16:35:11.1440657Z "digest": "sha256:42a959f7585ea3d548af853d04f831753759ae7793e5066ca18b973ce2402ebe" 2024-11-01T16:35:11.1441266Z }, 2024-11-01T16:35:11.1441498Z { 2024-11-01T16:35:11.1441914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1442471Z "size": 488, 2024-11-01T16:35:11.1443000Z "digest": "sha256:103e959619f3a92484107a7b88198fff73e2a6c72daa7eec906208b38f69fafe" 2024-11-01T16:35:11.1443616Z }, 2024-11-01T16:35:11.1443847Z { 2024-11-01T16:35:11.1444261Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1444822Z "size": 338, 2024-11-01T16:35:11.1445366Z "digest": "sha256:0d21b1ebe1a48164142d075480095b1e36f294ea8a7f4f147a11bc4576222137" 2024-11-01T16:35:11.1445983Z }, 2024-11-01T16:35:11.1446223Z { 2024-11-01T16:35:11.1446650Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1447195Z "size": 103, 2024-11-01T16:35:11.1447745Z "digest": "sha256:c2036a0c8e1113e3c017bbe6cf0a2b646618ee33c6ffb7ce135d6a2e4a13ab01" 2024-11-01T16:35:11.1448379Z }, 2024-11-01T16:35:11.1448611Z { 2024-11-01T16:35:11.1449035Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1449579Z "size": 1472, 2024-11-01T16:35:11.1450147Z "digest": "sha256:f566c3af6db7fc704e0bbdde98ba341c239a7e11d721b83acb0ce6ab45621b5e" 2024-11-01T16:35:11.1450787Z }, 2024-11-01T16:35:11.1451017Z { 2024-11-01T16:35:11.1451444Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1452030Z "size": 445359487, 2024-11-01T16:35:11.1452677Z "digest": "sha256:177321563b8eb0ca51527060730909bd6da52c0c28ac039ed370521202e36506" 2024-11-01T16:35:11.1453302Z }, 2024-11-01T16:35:11.1453539Z { 2024-11-01T16:35:11.1453984Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1454549Z "size": 164, 2024-11-01T16:35:11.1455071Z "digest": "sha256:088d9767f2d82f854b9b1fc4bda8783868820638188776fb797d65f81e7be245" 2024-11-01T16:35:11.1455687Z }, 2024-11-01T16:35:11.1455918Z { 2024-11-01T16:35:11.1456346Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1456905Z "size": 2211, 2024-11-01T16:35:11.1457450Z "digest": "sha256:180d2736fbf96c3dcbbffce71922e73d97bf2eb7745a6d97cd055ffc2e629329" 2024-11-01T16:35:11.1458092Z }, 2024-11-01T16:35:11.1458327Z { 2024-11-01T16:35:11.1458755Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1459562Z "size": 152, 2024-11-01T16:35:11.1460108Z "digest": "sha256:730a2f77686b27c61998a36afbfa83302fc71af61aeed8721ab2898fde71325f" 2024-11-01T16:35:11.1460741Z }, 2024-11-01T16:35:11.1460972Z { 2024-11-01T16:35:11.1461401Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1462139Z "size": 647, 2024-11-01T16:35:11.1462679Z "digest": "sha256:1af136be95e0e0ea34471cf3d78cd9a3244ff6111018a3f88318558cac12e637" 2024-11-01T16:35:11.1463312Z }, 2024-11-01T16:35:11.1463544Z { 2024-11-01T16:35:11.1463969Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1464530Z "size": 32, 2024-11-01T16:35:11.1465068Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1465701Z }, 2024-11-01T16:35:11.1465944Z { 2024-11-01T16:35:11.1466374Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1466936Z "size": 168, 2024-11-01T16:35:11.1467467Z "digest": "sha256:3eb706825457be768f552ea178ead7c52884c4237894b6bb70a23f1787e21b03" 2024-11-01T16:35:11.1468074Z }, 2024-11-01T16:35:11.1468304Z { 2024-11-01T16:35:11.1468819Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1469391Z "size": 109, 2024-11-01T16:35:11.1469946Z "digest": "sha256:67d83ed868e60c0f3717e8bcb8b07ccb0eac05f472908d47be1b7e03c22c5b12" 2024-11-01T16:35:11.1470574Z }, 2024-11-01T16:35:11.1470820Z { 2024-11-01T16:35:11.1471252Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1471812Z "size": 102, 2024-11-01T16:35:11.1472359Z "digest": "sha256:30d4de16074139d72c51e19aa214aec3cc4c988772facbc49e0aea501d886b82" 2024-11-01T16:35:11.1472977Z }, 2024-11-01T16:35:11.1473215Z { 2024-11-01T16:35:11.1473643Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1474216Z "size": 422, 2024-11-01T16:35:11.1474780Z "digest": "sha256:d0d44efe8bc344eb11d0e857603abfbcbb7955f97a120a095f91fecf2c6d89ad" 2024-11-01T16:35:11.1475424Z }, 2024-11-01T16:35:11.1475643Z { 2024-11-01T16:35:11.1476081Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1476642Z "size": 32, 2024-11-01T16:35:11.1477194Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1477826Z }, 2024-11-01T16:35:11.1478056Z { 2024-11-01T16:35:11.1478485Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1479041Z "size": 111, 2024-11-01T16:35:11.1479595Z "digest": "sha256:be6faa013cc8e66cb07fff68f375022557fb83272e5840b89b57397b34c59ddd" 2024-11-01T16:35:11.1480225Z }, 2024-11-01T16:35:11.1480448Z { 2024-11-01T16:35:11.1480882Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1481488Z "size": 473, 2024-11-01T16:35:11.1482035Z "digest": "sha256:72dc36b20429f9963dfd9bed81119228749e60f2df3c23aed442f6f53de061d9" 2024-11-01T16:35:11.1482657Z }, 2024-11-01T16:35:11.1482878Z { 2024-11-01T16:35:11.1483449Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1484019Z "size": 32, 2024-11-01T16:35:11.1484572Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1485214Z }, 2024-11-01T16:35:11.1485436Z { 2024-11-01T16:35:11.1485865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1486421Z "size": 112, 2024-11-01T16:35:11.1486960Z "digest": "sha256:058580a8278bc76e35b78df1e3648c77e807dc63bdd3dc90045c4cd9987fd5b9" 2024-11-01T16:35:11.1487578Z }, 2024-11-01T16:35:11.1487808Z { 2024-11-01T16:35:11.1488223Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1488783Z "size": 565, 2024-11-01T16:35:11.1489313Z "digest": "sha256:aae1352538670573fcb31c13d39345fd08ab18f33a30401080b0e409a62c5091" 2024-11-01T16:35:11.1489933Z }, 2024-11-01T16:35:11.1490180Z { 2024-11-01T16:35:11.1490593Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1491158Z "size": 43163839, 2024-11-01T16:35:11.1491725Z "digest": "sha256:3b05bde4486416e4a13919dbf361ae09a65caca35cce09c4b59d3deeb11d547b" 2024-11-01T16:35:11.1492470Z }, 2024-11-01T16:35:11.1492704Z { 2024-11-01T16:35:11.1493123Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1493690Z "size": 106, 2024-11-01T16:35:11.1494223Z "digest": "sha256:292e740c61872884758b278457310312e91b4c53c83f72add38b6b01592e2f74" 2024-11-01T16:35:11.1494838Z }, 2024-11-01T16:35:11.1495069Z { 2024-11-01T16:35:11.1495489Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1496053Z "size": 294, 2024-11-01T16:35:11.1496600Z "digest": "sha256:d715265d8db72d2d32d52bd703d48a4e1108f4d0e13d316639d21b174e541a9a" 2024-11-01T16:35:11.1497228Z }, 2024-11-01T16:35:11.1497462Z { 2024-11-01T16:35:11.1497878Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1498487Z "size": 32, 2024-11-01T16:35:11.1499044Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1499675Z }, 2024-11-01T16:35:11.1520326Z { 2024-11-01T16:35:11.1520853Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1521437Z "size": 106, 2024-11-01T16:35:11.1521987Z "digest": "sha256:3634fe4cf0c4e625f72a5c2443656cd99d3a8faa8f547092a68e4efeb76761f8" 2024-11-01T16:35:11.1522611Z }, 2024-11-01T16:35:11.1522847Z { 2024-11-01T16:35:11.1523273Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1523833Z "size": 425, 2024-11-01T16:35:11.1524391Z "digest": "sha256:da04921cbec53df59b0cd9df3ff3c8747096a5f7f4b8fe9d0bbb87613ab4ca00" 2024-11-01T16:35:11.1525016Z }, 2024-11-01T16:35:11.1525248Z { 2024-11-01T16:35:11.1525673Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1526231Z "size": 19308710, 2024-11-01T16:35:11.1526813Z "digest": "sha256:55b1e8dc281d64beab6693bf2031e444dc01e92b93c1d7b5ceecd7318b0c880a" 2024-11-01T16:35:11.1527436Z }, 2024-11-01T16:35:11.1527713Z { 2024-11-01T16:35:11.1528146Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1528701Z "size": 108, 2024-11-01T16:35:11.1529245Z "digest": "sha256:595dea37c8f8e777f19f790f768d0b68787b02d34eee74c8fc16d783c63ecd38" 2024-11-01T16:35:11.1529868Z }, 2024-11-01T16:35:11.1530085Z { 2024-11-01T16:35:11.1530514Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1531072Z "size": 437, 2024-11-01T16:35:11.1531627Z "digest": "sha256:1edfdc5afa7b44c396a07cb196a816e1c1660b731e6346b0cba3ed62d672b4d7" 2024-11-01T16:35:11.1532256Z }, 2024-11-01T16:35:11.1532473Z { 2024-11-01T16:35:11.1532900Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1533456Z "size": 701, 2024-11-01T16:35:11.1534171Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1534796Z }, 2024-11-01T16:35:11.1535014Z { 2024-11-01T16:35:11.1535445Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1536014Z "size": 141, 2024-11-01T16:35:11.1536567Z "digest": "sha256:f64e657da3cf04d6bc43e8de98abe0d33741737767ed0bc295e37b1dc9751ce3" 2024-11-01T16:35:11.1537207Z }, 2024-11-01T16:35:11.1537420Z { 2024-11-01T16:35:11.1537845Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1538411Z "size": 135, 2024-11-01T16:35:11.1538958Z "digest": "sha256:de853ca4b926f76e26c46b6be0e816947e2e0ed767ea71164bf5795dd68610e4" 2024-11-01T16:35:11.1539586Z }, 2024-11-01T16:35:11.1539808Z { 2024-11-01T16:35:11.1540234Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1540793Z "size": 32, 2024-11-01T16:35:11.1541342Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1541980Z }, 2024-11-01T16:35:11.1542207Z { 2024-11-01T16:35:11.1542623Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1543266Z "size": 195, 2024-11-01T16:35:11.1543813Z "digest": "sha256:71d440813d6d606e2d2fee5dfad585658b402b3fbe579c98fb79dccc9dd27a0c" 2024-11-01T16:35:11.1544446Z }, 2024-11-01T16:35:11.1544678Z { 2024-11-01T16:35:11.1545095Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1545649Z "size": 1402, 2024-11-01T16:35:11.1546198Z "digest": "sha256:cee9a121085f4b19d27c1952ee154e16ce0a0eb6d47848030a92de7b6c668118" 2024-11-01T16:35:11.1546821Z }, 2024-11-01T16:35:11.1547075Z { 2024-11-01T16:35:11.1547488Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1548040Z "size": 701, 2024-11-01T16:35:11.1548676Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1549301Z }, 2024-11-01T16:35:11.1549541Z { 2024-11-01T16:35:11.1549959Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1550532Z "size": 136, 2024-11-01T16:35:11.1551077Z "digest": "sha256:f749ccdf4d4636ca276233c3403c73c5c3f9059f77de1f220af09ae0d402f1db" 2024-11-01T16:35:11.1551731Z }, 2024-11-01T16:35:11.1551959Z { 2024-11-01T16:35:11.1552382Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1552929Z "size": 3691884935, 2024-11-01T16:35:11.1553500Z "digest": "sha256:1ffba2c07a780d4ab29bb558e28915358b9661875d01c7a570f6c4eda134c457" 2024-11-01T16:35:11.1554124Z }, 2024-11-01T16:35:11.1554350Z { 2024-11-01T16:35:11.1554779Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1555324Z "size": 156, 2024-11-01T16:35:11.1555869Z "digest": "sha256:d474c4eb5d81b5758eda41d6981795dbc39db496d327b1cba41762898c5f9112" 2024-11-01T16:35:11.1556495Z }, 2024-11-01T16:35:11.1556723Z { 2024-11-01T16:35:11.1557154Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1557700Z "size": 1402, 2024-11-01T16:35:11.1558247Z "digest": "sha256:cee9a121085f4b19d27c1952ee154e16ce0a0eb6d47848030a92de7b6c668118" 2024-11-01T16:35:11.1558878Z }, 2024-11-01T16:35:11.1559301Z { 2024-11-01T16:35:11.1559741Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1560288Z "size": 701, 2024-11-01T16:35:11.1560822Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1561442Z }, 2024-11-01T16:35:11.1561675Z { 2024-11-01T16:35:11.1562104Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1562666Z "size": 140, 2024-11-01T16:35:11.1563167Z "digest": "sha256:b30192601766675f418ce429c021330541e583716511b8c110a80f8b4512d1a3" 2024-11-01T16:35:11.1563764Z }, 2024-11-01T16:35:11.1563995Z { 2024-11-01T16:35:11.1564609Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1565172Z "size": 32, 2024-11-01T16:35:11.1565709Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1566346Z }, 2024-11-01T16:35:11.1566580Z { 2024-11-01T16:35:11.1567010Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1567569Z "size": 161, 2024-11-01T16:35:11.1568101Z "digest": "sha256:e927cdba5b8a8610a7c6a0219be646c3177e4e6638587da97c2d8ad0e49e6be1" 2024-11-01T16:35:11.1568725Z }, 2024-11-01T16:35:11.1568954Z { 2024-11-01T16:35:11.1569376Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1569934Z "size": 849, 2024-11-01T16:35:11.1570463Z "digest": "sha256:859f5d9a55a371b64c430b8ccbe2a96ae24550f9fbba87228c14452276b1b1f8" 2024-11-01T16:35:11.1571083Z }, 2024-11-01T16:35:11.1571309Z { 2024-11-01T16:35:11.1571733Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1572291Z "size": 701, 2024-11-01T16:35:11.1572815Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1573515Z }, 2024-11-01T16:35:11.1573750Z { 2024-11-01T16:35:11.1574177Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1574733Z "size": 141, 2024-11-01T16:35:11.1575279Z "digest": "sha256:e992e1c9030386aaccc6a4f0f3b1e81b9aee1474f51b629b585b5994eecbc829" 2024-11-01T16:35:11.1575895Z }, 2024-11-01T16:35:11.1576127Z { 2024-11-01T16:35:11.1576555Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1577109Z "size": 32, 2024-11-01T16:35:11.1577655Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1578271Z }, 2024-11-01T16:35:11.1578503Z { 2024-11-01T16:35:11.1578931Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1579519Z "size": 160, 2024-11-01T16:35:11.1580072Z "digest": "sha256:ded8f639d8e87a4510e9b4105897df92d8dd54138801ba7eb1fcdbf84b8d2abf" 2024-11-01T16:35:11.1580690Z }, 2024-11-01T16:35:11.1580920Z { 2024-11-01T16:35:11.1581353Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1581909Z "size": 908, 2024-11-01T16:35:11.1582452Z "digest": "sha256:6dc1988800dbe97274eba8f1acb6c4ab80a79e00c8cf3b30f06d8d8420ee559a" 2024-11-01T16:35:11.1583081Z }, 2024-11-01T16:35:11.1583295Z { 2024-11-01T16:35:11.1583724Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1584277Z "size": 701, 2024-11-01T16:35:11.1584810Z "digest": "sha256:3750343ed4e2963edebf1c1501754874e2e25387d2c1f0bc536995ea7a714449" 2024-11-01T16:35:11.1585418Z }, 2024-11-01T16:35:11.1585634Z { 2024-11-01T16:35:11.1586066Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1586621Z "size": 135, 2024-11-01T16:35:11.1587164Z "digest": "sha256:6b07caec55f88a858b123d2e3915be8715e74f071293bcf582062fd5e03a822b" 2024-11-01T16:35:11.1587783Z }, 2024-11-01T16:35:11.1587999Z { 2024-11-01T16:35:11.1588498Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1589070Z "size": 32, 2024-11-01T16:35:11.1589614Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1590243Z }, 2024-11-01T16:35:11.1590460Z { 2024-11-01T16:35:11.1590886Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1591441Z "size": 159, 2024-11-01T16:35:11.1591984Z "digest": "sha256:fe72746ef78d12232e6562062d423a61aad2fb25ef96a9c056ba01be982b4cc6" 2024-11-01T16:35:11.1592607Z }, 2024-11-01T16:35:11.1592825Z { 2024-11-01T16:35:11.1593254Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1593815Z "size": 1520, 2024-11-01T16:35:11.1594341Z "digest": "sha256:41244b047648e4071fe28c5fc86d3499897770370d8c822224af271c51dd3e40" 2024-11-01T16:35:11.1595031Z }, 2024-11-01T16:35:11.1595265Z { 2024-11-01T16:35:11.1595682Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1596249Z "size": 32, 2024-11-01T16:35:11.1596797Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1597430Z }, 2024-11-01T16:35:11.1597664Z { 2024-11-01T16:35:11.1598079Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1598638Z "size": 137, 2024-11-01T16:35:11.1599196Z "digest": "sha256:c5ca3a0d4a1103ec8bbdca66eb94f1b68bf19868aafeb16435a54b347a668dbd" 2024-11-01T16:35:11.1599861Z }, 2024-11-01T16:35:11.1600096Z { 2024-11-01T16:35:11.1600509Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1601070Z "size": 379, 2024-11-01T16:35:11.1601632Z "digest": "sha256:1f3eab9dfbb47a90acc80106d65b4e2be05b1c63fe0b4e66216e0fc00db041df" 2024-11-01T16:35:11.1602271Z }, 2024-11-01T16:35:11.1602518Z { 2024-11-01T16:35:11.1602932Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1603487Z "size": 32, 2024-11-01T16:35:11.1604102Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1604730Z }, 2024-11-01T16:35:11.1604963Z { 2024-11-01T16:35:11.1605389Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1605932Z "size": 104, 2024-11-01T16:35:11.1606491Z "digest": "sha256:805d5faba3b6ebd33be5a3de08e0cfbfba236d4b103d466b47269c4841849812" 2024-11-01T16:35:11.1607134Z }, 2024-11-01T16:35:11.1607366Z { 2024-11-01T16:35:11.1607794Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1608340Z "size": 2048, 2024-11-01T16:35:11.1608905Z "digest": "sha256:b37c2b2cc48af121a14c5d384cd7ead2eec0bf8e82def2c7823cfc0e71e48e21" 2024-11-01T16:35:11.1609547Z }, 2024-11-01T16:35:11.1609776Z { 2024-11-01T16:35:11.1610207Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1610753Z "size": 197353626, 2024-11-01T16:35:11.1611336Z "digest": "sha256:a58aebee5440abfdb53c19e05ff4daf75f3d8b3cef88cc3007a3103d37997582" 2024-11-01T16:35:11.1611983Z }, 2024-11-01T16:35:11.1612210Z { 2024-11-01T16:35:11.1612635Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1613179Z "size": 106, 2024-11-01T16:35:11.1613722Z "digest": "sha256:aa5c2183b5a66c0efc47604dfa96218eb476bdddf5403a33534c7160147a916c" 2024-11-01T16:35:11.1614355Z }, 2024-11-01T16:35:11.1614582Z { 2024-11-01T16:35:11.1615005Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1615561Z "size": 164, 2024-11-01T16:35:11.1616088Z "digest": "sha256:0c906cd3d76d4a13859d1d59c1a43b875b1c4a16e8b80bb47844de697e5d00cd" 2024-11-01T16:35:11.1616731Z }, 2024-11-01T16:35:11.1616958Z { 2024-11-01T16:35:11.1617385Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1617943Z "size": 7943, 2024-11-01T16:35:11.1618497Z "digest": "sha256:4fad3dce2eb75ae56cd22ed1352a6b8dc7a618a652098ead52eec7769a56be1d" 2024-11-01T16:35:11.1619144Z }, 2024-11-01T16:35:11.1619370Z { 2024-11-01T16:35:11.1619792Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1620347Z "size": 8069, 2024-11-01T16:35:11.1620868Z "digest": "sha256:3ee82f0066227fb3291568703c059c81d519b068cb58c4d39dff639c46865bce" 2024-11-01T16:35:11.1621478Z }, 2024-11-01T16:35:11.1621706Z { 2024-11-01T16:35:11.1622132Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1622689Z "size": 303, 2024-11-01T16:35:11.1623226Z "digest": "sha256:dbf98406efc0952d4ca62e3e458eb17ad02e4590f683b5ad5906b4dd7f2f0836" 2024-11-01T16:35:11.1623858Z }, 2024-11-01T16:35:11.1624087Z { 2024-11-01T16:35:11.1624513Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1625979Z "size": 32, 2024-11-01T16:35:11.1626536Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1627166Z }, 2024-11-01T16:35:11.1627397Z { 2024-11-01T16:35:11.1627828Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1628390Z "size": 108, 2024-11-01T16:35:11.1629038Z "digest": "sha256:9cb7ede94ead5eb859cb6a83ce084d0675ada6c535cfa7c0ac18e1aca2034256" 2024-11-01T16:35:11.1629670Z }, 2024-11-01T16:35:11.1629904Z { 2024-11-01T16:35:11.1630330Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1630892Z "size": 54145661, 2024-11-01T16:35:11.1631460Z "digest": "sha256:81ba6fd7879d26a34e11f209f0ac8bacb2edb20bd8c295699b1d71f701e857ce" 2024-11-01T16:35:11.1632080Z }, 2024-11-01T16:35:11.1632314Z { 2024-11-01T16:35:11.1632741Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-11-01T16:35:11.1633300Z "size": 32, 2024-11-01T16:35:11.1633854Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-11-01T16:35:11.1634475Z } 2024-11-01T16:35:11.1634814Z ] 2024-11-01T16:35:11.1635044Z } 2024-11-01T16:35:11.1760849Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-11-01T16:35:11.1761330Z tag=${ECR_DOCKER_IMAGE##*/} 2024-11-01T16:35:11.1761873Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-11-01T16:35:11.1768218Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:11.1768704Z env: 2024-11-01T16:35:11.1768968Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:11.1769927Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.1770920Z ##[endgroup] 2024-11-01T16:35:11.1796742Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.9-gcc11-bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.1850910Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-11-01T16:35:11.1851472Z with: 2024-11-01T16:35:11.1852354Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.1853508Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:11.1854025Z env: 2024-11-01T16:35:11.1854288Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:11.1854610Z ##[endgroup] 2024-11-01T16:35:11.1873803Z ##[group]Run set -x 2024-11-01T16:35:11.1874143Z set -x 2024-11-01T16:35:11.1874438Z set +e 2024-11-01T16:35:11.1874722Z  2024-11-01T16:35:11.1874985Z login() { 2024-11-01T16:35:11.1875647Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-11-01T16:35:11.1876383Z } 2024-11-01T16:35:11.1876631Z  2024-11-01T16:35:11.1876943Z retry () { 2024-11-01T16:35:11.1877325Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-11-01T16:35:11.1877756Z } 2024-11-01T16:35:11.1878015Z  2024-11-01T16:35:11.1878315Z retry login "${DOCKER_REGISTRY}" 2024-11-01T16:35:11.1878736Z  2024-11-01T16:35:11.1878992Z set -e 2024-11-01T16:35:11.1879444Z # ignore output since only exit code is used for conditional 2024-11-01T16:35:11.1880154Z # only pull docker image if it's not available locally 2024-11-01T16:35:11.1880938Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-11-01T16:35:11.1881638Z  retry docker pull "${DOCKER_IMAGE}" 2024-11-01T16:35:11.1882074Z fi 2024-11-01T16:35:11.1887828Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:35:11.1888334Z env: 2024-11-01T16:35:11.1888584Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:35:11.1889538Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.1890670Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:11.1891203Z ##[endgroup] 2024-11-01T16:35:11.1914855Z + set +e 2024-11-01T16:35:11.1915500Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:11.1916164Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:11.1918743Z + aws ecr get-login-password --region us-east-1 2024-11-01T16:35:11.1920258Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-11-01T16:35:11.7784961Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-11-01T16:35:11.7786003Z Configure a credential helper to remove this warning. See 2024-11-01T16:35:11.7786886Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-11-01T16:35:11.7787428Z 2024-11-01T16:35:11.7787552Z Login Succeeded 2024-11-01T16:35:11.7799994Z + set -e 2024-11-01T16:35:11.7801410Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.7931375Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:11.7933173Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:35:12.0232923Z bdd298b12da59246147f016e0693ffd722419941: Pulling from pytorch/pytorch-linux-jammy-py3.9-gcc11 2024-11-01T16:35:12.0238140Z 7478e0ac0f23: Pulling fs layer 2024-11-01T16:35:12.0239115Z ad0341f900ba: Pulling fs layer 2024-11-01T16:35:12.0239830Z be63e049eed3: Pulling fs layer 2024-11-01T16:35:12.0240516Z 7b58778274e4: Pulling fs layer 2024-11-01T16:35:12.0241250Z 5252fbf945ae: Pulling fs layer 2024-11-01T16:35:12.0242336Z f88e6e245d17: Pulling fs layer 2024-11-01T16:35:12.0243049Z d2fc2f6d6c5f: Pulling fs layer 2024-11-01T16:35:12.0243778Z 8db79f4cc8cc: Pulling fs layer 2024-11-01T16:35:12.0244161Z 8f875d71a923: Pulling fs layer 2024-11-01T16:35:12.0244607Z d4816a7d80f8: Pulling fs layer 2024-11-01T16:35:12.0245265Z 2d6bd9e42551: Pulling fs layer 2024-11-01T16:35:12.0245978Z 3750343ed4e2: Pulling fs layer 2024-11-01T16:35:12.0246654Z 96047d905613: Pulling fs layer 2024-11-01T16:35:12.0247334Z 4f4fb700ef54: Pulling fs layer 2024-11-01T16:35:12.0248110Z b79cecd68009: Pulling fs layer 2024-11-01T16:35:12.0248719Z f88e6e245d17: Waiting 2024-11-01T16:35:12.0249322Z 5252fbf945ae: Waiting 2024-11-01T16:35:12.0249947Z efe1e385dc9e: Pulling fs layer 2024-11-01T16:35:12.0250653Z d2fc2f6d6c5f: Waiting 2024-11-01T16:35:12.0251176Z adeab13bac13: Pulling fs layer 2024-11-01T16:35:12.0251780Z 24b41e0168fa: Pulling fs layer 2024-11-01T16:35:12.0252340Z 8f875d71a923: Waiting 2024-11-01T16:35:12.0252832Z 8db79f4cc8cc: Waiting 2024-11-01T16:35:12.0253340Z 2d6bd9e42551: Waiting 2024-11-01T16:35:12.0253852Z 707cc0109119: Pulling fs layer 2024-11-01T16:35:12.0254473Z c5fa30c2a598: Pulling fs layer 2024-11-01T16:35:12.0255085Z 7c311ff0f8ed: Pulling fs layer 2024-11-01T16:35:12.0255652Z 7b58778274e4: Waiting 2024-11-01T16:35:12.0256272Z 6d067a971ea0: Pulling fs layer 2024-11-01T16:35:12.0256725Z 32a0e0f8d213: Pulling fs layer 2024-11-01T16:35:12.0257426Z 3750343ed4e2: Waiting 2024-11-01T16:35:12.0258037Z 6759707dde23: Pulling fs layer 2024-11-01T16:35:12.0258413Z 42a959f7585e: Pulling fs layer 2024-11-01T16:35:12.0258770Z 96047d905613: Waiting 2024-11-01T16:35:12.0259345Z 103e959619f3: Pulling fs layer 2024-11-01T16:35:12.0259786Z 4f4fb700ef54: Waiting 2024-11-01T16:35:12.0260183Z 0d21b1ebe1a4: Pulling fs layer 2024-11-01T16:35:12.0260833Z b79cecd68009: Waiting 2024-11-01T16:35:12.0261477Z c2036a0c8e11: Pulling fs layer 2024-11-01T16:35:12.0262194Z f566c3af6db7: Pulling fs layer 2024-11-01T16:35:12.0262731Z efe1e385dc9e: Waiting 2024-11-01T16:35:12.0263246Z 177321563b8e: Pulling fs layer 2024-11-01T16:35:12.0263858Z 088d9767f2d8: Pulling fs layer 2024-11-01T16:35:12.0264411Z adeab13bac13: Waiting 2024-11-01T16:35:12.0264962Z 180d2736fbf9: Pulling fs layer 2024-11-01T16:35:12.0265546Z 730a2f77686b: Pulling fs layer 2024-11-01T16:35:12.0266145Z 24b41e0168fa: Waiting 2024-11-01T16:35:12.0266702Z 1af136be95e0: Pulling fs layer 2024-11-01T16:35:12.0267201Z 707cc0109119: Waiting 2024-11-01T16:35:12.0267503Z 6759707dde23: Waiting 2024-11-01T16:35:12.0267821Z 3eb706825457: Pulling fs layer 2024-11-01T16:35:12.0268159Z c5fa30c2a598: Waiting 2024-11-01T16:35:12.0268544Z 67d83ed868e6: Pulling fs layer 2024-11-01T16:35:12.0268907Z 42a959f7585e: Waiting 2024-11-01T16:35:12.0269229Z 30d4de160741: Pulling fs layer 2024-11-01T16:35:12.0269586Z 7c311ff0f8ed: Waiting 2024-11-01T16:35:12.0269898Z d0d44efe8bc3: Pulling fs layer 2024-11-01T16:35:12.0270324Z 103e959619f3: Waiting 2024-11-01T16:35:12.0270629Z 0d21b1ebe1a4: Waiting 2024-11-01T16:35:12.0271024Z be6faa013cc8: Pulling fs layer 2024-11-01T16:35:12.0271402Z 72dc36b20429: Pulling fs layer 2024-11-01T16:35:12.0271814Z 6d067a971ea0: Waiting 2024-11-01T16:35:12.0272117Z c2036a0c8e11: Waiting 2024-11-01T16:35:12.0272447Z 32a0e0f8d213: Waiting 2024-11-01T16:35:12.0272999Z 058580a8278b: Pulling fs layer 2024-11-01T16:35:12.0273408Z 088d9767f2d8: Waiting 2024-11-01T16:35:12.0273698Z f566c3af6db7: Waiting 2024-11-01T16:35:12.0274074Z aae135253867: Pulling fs layer 2024-11-01T16:35:12.0274516Z 180d2736fbf9: Waiting 2024-11-01T16:35:12.0274893Z 730a2f77686b: Waiting 2024-11-01T16:35:12.0275192Z 177321563b8e: Waiting 2024-11-01T16:35:12.0275623Z 3b05bde44864: Pulling fs layer 2024-11-01T16:35:12.0276132Z 292e740c6187: Pulling fs layer 2024-11-01T16:35:12.0276558Z be6faa013cc8: Waiting 2024-11-01T16:35:12.0276919Z d715265d8db7: Pulling fs layer 2024-11-01T16:35:12.0277271Z 67d83ed868e6: Waiting 2024-11-01T16:35:12.0277559Z 72dc36b20429: Waiting 2024-11-01T16:35:12.0277858Z d0d44efe8bc3: Waiting 2024-11-01T16:35:12.0278159Z 30d4de160741: Waiting 2024-11-01T16:35:12.0278623Z 3eb706825457: Waiting 2024-11-01T16:35:12.0278934Z 058580a8278b: Waiting 2024-11-01T16:35:12.0279221Z 3b05bde44864: Waiting 2024-11-01T16:35:12.0279541Z 3634fe4cf0c4: Pulling fs layer 2024-11-01T16:35:12.0279926Z da04921cbec5: Pulling fs layer 2024-11-01T16:35:12.0280292Z 55b1e8dc281d: Pulling fs layer 2024-11-01T16:35:12.0280657Z 595dea37c8f8: Pulling fs layer 2024-11-01T16:35:12.0281013Z 1edfdc5afa7b: Pulling fs layer 2024-11-01T16:35:12.0281369Z da04921cbec5: Waiting 2024-11-01T16:35:12.0281689Z f64e657da3cf: Pulling fs layer 2024-11-01T16:35:12.0282033Z 292e740c6187: Waiting 2024-11-01T16:35:12.0282353Z de853ca4b926: Pulling fs layer 2024-11-01T16:35:12.0282692Z d715265d8db7: Waiting 2024-11-01T16:35:12.0283007Z 3634fe4cf0c4: Waiting 2024-11-01T16:35:12.0283313Z 595dea37c8f8: Waiting 2024-11-01T16:35:12.0283674Z 71d440813d6d: Pulling fs layer 2024-11-01T16:35:12.0284033Z 55b1e8dc281d: Waiting 2024-11-01T16:35:12.0284359Z cee9a121085f: Pulling fs layer 2024-11-01T16:35:12.0284721Z 1edfdc5afa7b: Waiting 2024-11-01T16:35:12.0285051Z f749ccdf4d46: Pulling fs layer 2024-11-01T16:35:12.0285410Z f64e657da3cf: Waiting 2024-11-01T16:35:12.0285721Z 71d440813d6d: Waiting 2024-11-01T16:35:12.0286052Z 1ffba2c07a78: Pulling fs layer 2024-11-01T16:35:12.0286395Z de853ca4b926: Waiting 2024-11-01T16:35:12.0286705Z f749ccdf4d46: Waiting 2024-11-01T16:35:12.0287014Z cee9a121085f: Waiting 2024-11-01T16:35:12.0287338Z d474c4eb5d81: Pulling fs layer 2024-11-01T16:35:12.0287725Z b30192601766: Pulling fs layer 2024-11-01T16:35:12.0288065Z d474c4eb5d81: Waiting 2024-11-01T16:35:12.0288386Z e927cdba5b8a: Pulling fs layer 2024-11-01T16:35:12.0288766Z 859f5d9a55a3: Pulling fs layer 2024-11-01T16:35:12.0289111Z b30192601766: Waiting 2024-11-01T16:35:12.0289425Z e992e1c90303: Pulling fs layer 2024-11-01T16:35:12.0289763Z 859f5d9a55a3: Waiting 2024-11-01T16:35:12.0290064Z e992e1c90303: Waiting 2024-11-01T16:35:12.0290384Z ded8f639d8e8: Pulling fs layer 2024-11-01T16:35:12.0290751Z 6dc1988800db: Pulling fs layer 2024-11-01T16:35:12.0291126Z 6b07caec55f8: Pulling fs layer 2024-11-01T16:35:12.0291466Z ded8f639d8e8: Waiting 2024-11-01T16:35:12.0291772Z 6dc1988800db: Waiting 2024-11-01T16:35:12.0292091Z fe72746ef78d: Pulling fs layer 2024-11-01T16:35:12.0292509Z 41244b047648: Pulling fs layer 2024-11-01T16:35:12.0292861Z 6b07caec55f8: Waiting 2024-11-01T16:35:12.0293171Z c5ca3a0d4a11: Pulling fs layer 2024-11-01T16:35:12.0293539Z 1f3eab9dfbb4: Pulling fs layer 2024-11-01T16:35:12.0293887Z 41244b047648: Waiting 2024-11-01T16:35:12.0294202Z 805d5faba3b6: Pulling fs layer 2024-11-01T16:35:12.0294564Z b37c2b2cc48a: Pulling fs layer 2024-11-01T16:35:12.0294905Z 1f3eab9dfbb4: Waiting 2024-11-01T16:35:12.0295227Z a58aebee5440: Pulling fs layer 2024-11-01T16:35:12.0295576Z b37c2b2cc48a: Waiting 2024-11-01T16:35:12.0295883Z 805d5faba3b6: Waiting 2024-11-01T16:35:12.0296201Z aa5c2183b5a6: Pulling fs layer 2024-11-01T16:35:12.0296552Z 0c906cd3d76d: Pulling fs layer 2024-11-01T16:35:12.0296902Z a58aebee5440: Waiting 2024-11-01T16:35:12.0297230Z 4fad3dce2eb7: Pulling fs layer 2024-11-01T16:35:12.0297578Z aa5c2183b5a6: Waiting 2024-11-01T16:35:12.0297897Z 3ee82f006622: Pulling fs layer 2024-11-01T16:35:12.0298246Z 0c906cd3d76d: Waiting 2024-11-01T16:35:12.0298651Z dbf98406efc0: Pulling fs layer 2024-11-01T16:35:12.0299025Z 9cb7ede94ead: Pulling fs layer 2024-11-01T16:35:12.0299380Z 3ee82f006622: Waiting 2024-11-01T16:35:12.0299703Z 81ba6fd7879d: Pulling fs layer 2024-11-01T16:35:12.0300060Z 9cb7ede94ead: Waiting 2024-11-01T16:35:12.0300379Z 81ba6fd7879d: Waiting 2024-11-01T16:35:12.0917662Z ad0341f900ba: Verifying Checksum 2024-11-01T16:35:12.0918200Z ad0341f900ba: Download complete 2024-11-01T16:35:12.1536082Z 7b58778274e4: Download complete 2024-11-01T16:35:12.2111059Z 5252fbf945ae: Verifying Checksum 2024-11-01T16:35:12.2111629Z 5252fbf945ae: Download complete 2024-11-01T16:35:12.2910253Z f88e6e245d17: Download complete 2024-11-01T16:35:12.3697562Z d2fc2f6d6c5f: Verifying Checksum 2024-11-01T16:35:12.3698413Z d2fc2f6d6c5f: Download complete 2024-11-01T16:35:12.3770649Z 7478e0ac0f23: Download complete 2024-11-01T16:35:12.5195423Z 8db79f4cc8cc: Download complete 2024-11-01T16:35:12.5912652Z d4816a7d80f8: Download complete 2024-11-01T16:35:12.6475654Z 2d6bd9e42551: Download complete 2024-11-01T16:35:12.7221383Z 3750343ed4e2: Download complete 2024-11-01T16:35:13.3540938Z 7478e0ac0f23: Pull complete 2024-11-01T16:35:13.3678936Z ad0341f900ba: Pull complete 2024-11-01T16:35:13.5254998Z 8f875d71a923: Verifying Checksum 2024-11-01T16:35:13.5255501Z 8f875d71a923: Download complete 2024-11-01T16:35:13.5322026Z 4f4fb700ef54: Download complete 2024-11-01T16:35:13.6042191Z b79cecd68009: Verifying Checksum 2024-11-01T16:35:13.6042654Z b79cecd68009: Download complete 2024-11-01T16:35:13.7004800Z efe1e385dc9e: Verifying Checksum 2024-11-01T16:35:13.7005534Z efe1e385dc9e: Download complete 2024-11-01T16:35:13.7914348Z adeab13bac13: Verifying Checksum 2024-11-01T16:35:13.7915041Z adeab13bac13: Download complete 2024-11-01T16:35:13.9491725Z 24b41e0168fa: Download complete 2024-11-01T16:35:14.0310004Z 707cc0109119: Download complete 2024-11-01T16:35:14.1408002Z c5fa30c2a598: Download complete 2024-11-01T16:35:14.2087931Z 7c311ff0f8ed: Download complete 2024-11-01T16:35:14.2868839Z 6d067a971ea0: Download complete 2024-11-01T16:35:14.3525836Z 32a0e0f8d213: Verifying Checksum 2024-11-01T16:35:14.3526519Z 32a0e0f8d213: Download complete 2024-11-01T16:35:15.1974245Z be63e049eed3: Verifying Checksum 2024-11-01T16:35:15.1974771Z be63e049eed3: Download complete 2024-11-01T16:35:15.2722903Z 42a959f7585e: Verifying Checksum 2024-11-01T16:35:15.2723746Z 42a959f7585e: Download complete 2024-11-01T16:35:15.3436598Z 103e959619f3: Download complete 2024-11-01T16:35:15.4041412Z 0d21b1ebe1a4: Verifying Checksum 2024-11-01T16:35:15.4042234Z 0d21b1ebe1a4: Download complete 2024-11-01T16:35:15.4067758Z 6759707dde23: Verifying Checksum 2024-11-01T16:35:15.4068571Z 6759707dde23: Download complete 2024-11-01T16:35:15.4764135Z c2036a0c8e11: Verifying Checksum 2024-11-01T16:35:15.4764827Z c2036a0c8e11: Download complete 2024-11-01T16:35:15.4820856Z f566c3af6db7: Verifying Checksum 2024-11-01T16:35:15.4821490Z f566c3af6db7: Download complete 2024-11-01T16:35:15.5423784Z 088d9767f2d8: Download complete 2024-11-01T16:35:15.6790547Z 730a2f77686b: Verifying Checksum 2024-11-01T16:35:15.6791266Z 730a2f77686b: Download complete 2024-11-01T16:35:15.7452401Z 1af136be95e0: Verifying Checksum 2024-11-01T16:35:15.7453579Z 1af136be95e0: Download complete 2024-11-01T16:35:15.8089280Z 3eb706825457: Verifying Checksum 2024-11-01T16:35:15.8089925Z 3eb706825457: Download complete 2024-11-01T16:35:15.8700918Z 67d83ed868e6: Verifying Checksum 2024-11-01T16:35:15.8701708Z 67d83ed868e6: Download complete 2024-11-01T16:35:15.9423413Z 30d4de160741: Verifying Checksum 2024-11-01T16:35:15.9423884Z 30d4de160741: Download complete 2024-11-01T16:35:16.0120290Z d0d44efe8bc3: Download complete 2024-11-01T16:35:16.0756099Z be6faa013cc8: Download complete 2024-11-01T16:35:16.1511459Z 72dc36b20429: Verifying Checksum 2024-11-01T16:35:16.2199114Z 72dc36b20429: Download complete 2024-11-01T16:35:16.2199901Z 058580a8278b: Verifying Checksum 2024-11-01T16:35:16.2200565Z 058580a8278b: Download complete 2024-11-01T16:35:16.2868960Z aae135253867: Download complete 2024-11-01T16:35:16.7814920Z 3b05bde44864: Verifying Checksum 2024-11-01T16:35:16.7815516Z 3b05bde44864: Download complete 2024-11-01T16:35:16.8414150Z 292e740c6187: Verifying Checksum 2024-11-01T16:35:16.8414862Z 292e740c6187: Download complete 2024-11-01T16:35:16.9184000Z d715265d8db7: Verifying Checksum 2024-11-01T16:35:16.9184691Z d715265d8db7: Download complete 2024-11-01T16:35:16.9999226Z 3634fe4cf0c4: Verifying Checksum 2024-11-01T16:35:16.9999961Z 3634fe4cf0c4: Download complete 2024-11-01T16:35:17.0674135Z da04921cbec5: Verifying Checksum 2024-11-01T16:35:17.0674692Z da04921cbec5: Download complete 2024-11-01T16:35:17.3026344Z 55b1e8dc281d: Verifying Checksum 2024-11-01T16:35:17.3027130Z 55b1e8dc281d: Download complete 2024-11-01T16:35:17.3768118Z 595dea37c8f8: Download complete 2024-11-01T16:35:17.4483180Z 1edfdc5afa7b: Download complete 2024-11-01T16:35:17.5244773Z f64e657da3cf: Download complete 2024-11-01T16:35:17.5911399Z de853ca4b926: Verifying Checksum 2024-11-01T16:35:17.5912164Z de853ca4b926: Download complete 2024-11-01T16:35:17.6788084Z 71d440813d6d: Verifying Checksum 2024-11-01T16:35:17.6788806Z 71d440813d6d: Download complete 2024-11-01T16:35:17.7480626Z cee9a121085f: Download complete 2024-11-01T16:35:17.8214535Z f749ccdf4d46: Verifying Checksum 2024-11-01T16:35:17.8215307Z f749ccdf4d46: Download complete 2024-11-01T16:35:19.9742633Z 177321563b8e: Verifying Checksum 2024-11-01T16:35:19.9743332Z 177321563b8e: Download complete 2024-11-01T16:35:20.0570651Z d474c4eb5d81: Verifying Checksum 2024-11-01T16:35:20.0571442Z d474c4eb5d81: Download complete 2024-11-01T16:35:20.1185860Z b30192601766: Verifying Checksum 2024-11-01T16:35:20.1186552Z b30192601766: Download complete 2024-11-01T16:35:20.1925406Z e927cdba5b8a: Verifying Checksum 2024-11-01T16:35:20.1926220Z e927cdba5b8a: Download complete 2024-11-01T16:35:20.2664432Z 859f5d9a55a3: Download complete 2024-11-01T16:35:20.3316528Z e992e1c90303: Download complete 2024-11-01T16:35:20.4018783Z ded8f639d8e8: Verifying Checksum 2024-11-01T16:35:20.4019622Z ded8f639d8e8: Download complete 2024-11-01T16:35:20.4701492Z 6dc1988800db: Verifying Checksum 2024-11-01T16:35:20.4702114Z 6dc1988800db: Download complete 2024-11-01T16:35:20.5549181Z 6b07caec55f8: Verifying Checksum 2024-11-01T16:35:20.5549715Z 6b07caec55f8: Download complete 2024-11-01T16:35:20.6303866Z fe72746ef78d: Verifying Checksum 2024-11-01T16:35:20.6304489Z fe72746ef78d: Download complete 2024-11-01T16:35:20.7051457Z 41244b047648: Verifying Checksum 2024-11-01T16:35:20.7052127Z 41244b047648: Download complete 2024-11-01T16:35:20.7762871Z c5ca3a0d4a11: Download complete 2024-11-01T16:35:20.8345399Z 1f3eab9dfbb4: Download complete 2024-11-01T16:35:20.8955655Z 805d5faba3b6: Download complete 2024-11-01T16:35:20.9594231Z b37c2b2cc48a: Download complete 2024-11-01T16:35:23.2456778Z a58aebee5440: Verifying Checksum 2024-11-01T16:35:23.2457474Z a58aebee5440: Download complete 2024-11-01T16:35:23.3094418Z aa5c2183b5a6: Verifying Checksum 2024-11-01T16:35:23.3095001Z aa5c2183b5a6: Download complete 2024-11-01T16:35:23.3833659Z 0c906cd3d76d: Verifying Checksum 2024-11-01T16:35:23.3834350Z 0c906cd3d76d: Download complete 2024-11-01T16:35:23.4529192Z 4fad3dce2eb7: Verifying Checksum 2024-11-01T16:35:23.4529946Z 4fad3dce2eb7: Download complete 2024-11-01T16:35:23.5218149Z 3ee82f006622: Download complete 2024-11-01T16:35:23.5873283Z dbf98406efc0: Verifying Checksum 2024-11-01T16:35:23.5874003Z dbf98406efc0: Download complete 2024-11-01T16:35:23.6711464Z 9cb7ede94ead: Verifying Checksum 2024-11-01T16:35:23.6712181Z 9cb7ede94ead: Download complete 2024-11-01T16:35:24.0899587Z be63e049eed3: Pull complete 2024-11-01T16:35:24.1265400Z 7b58778274e4: Pull complete 2024-11-01T16:35:24.1737581Z 5252fbf945ae: Pull complete 2024-11-01T16:35:24.2828580Z f88e6e245d17: Pull complete 2024-11-01T16:35:24.3262250Z 81ba6fd7879d: Verifying Checksum 2024-11-01T16:35:24.3262928Z 81ba6fd7879d: Download complete 2024-11-01T16:35:24.4280550Z d2fc2f6d6c5f: Pull complete 2024-11-01T16:35:24.5702191Z 8db79f4cc8cc: Pull complete 2024-11-01T16:35:46.7512607Z 8f875d71a923: Pull complete 2024-11-01T16:35:46.9068369Z d4816a7d80f8: Pull complete 2024-11-01T16:35:47.1372111Z 2d6bd9e42551: Pull complete 2024-11-01T16:35:47.3662943Z 3750343ed4e2: Pull complete 2024-11-01T16:35:54.8758660Z 96047d905613: Verifying Checksum 2024-11-01T16:35:54.8759276Z 96047d905613: Download complete 2024-11-01T16:36:09.3272046Z 1ffba2c07a78: Verifying Checksum 2024-11-01T16:36:09.3272557Z 1ffba2c07a78: Download complete 2024-11-01T16:37:28.8705123Z 96047d905613: Pull complete 2024-11-01T16:37:28.8918465Z 4f4fb700ef54: Pull complete 2024-11-01T16:37:28.9069845Z b79cecd68009: Pull complete 2024-11-01T16:37:28.9446447Z efe1e385dc9e: Pull complete 2024-11-01T16:37:28.9594991Z adeab13bac13: Pull complete 2024-11-01T16:37:29.0250775Z 24b41e0168fa: Pull complete 2024-11-01T16:37:29.0423919Z 707cc0109119: Pull complete 2024-11-01T16:37:29.0593704Z c5fa30c2a598: Pull complete 2024-11-01T16:37:29.0765718Z 7c311ff0f8ed: Pull complete 2024-11-01T16:37:29.1152048Z 6d067a971ea0: Pull complete 2024-11-01T16:37:29.1322881Z 32a0e0f8d213: Pull complete 2024-11-01T16:37:31.9639319Z 6759707dde23: Pull complete 2024-11-01T16:37:32.1357786Z 42a959f7585e: Pull complete 2024-11-01T16:37:32.2170655Z 103e959619f3: Pull complete 2024-11-01T16:37:32.2593163Z 0d21b1ebe1a4: Pull complete 2024-11-01T16:37:32.2930948Z c2036a0c8e11: Pull complete 2024-11-01T16:37:32.3869310Z f566c3af6db7: Pull complete 2024-11-01T16:37:44.3434394Z 177321563b8e: Pull complete 2024-11-01T16:37:44.3597615Z 088d9767f2d8: Pull complete 2024-11-01T16:37:44.3807325Z 180d2736fbf9: Pull complete 2024-11-01T16:37:44.4056726Z 730a2f77686b: Pull complete 2024-11-01T16:37:44.4247764Z 1af136be95e0: Pull complete 2024-11-01T16:37:44.4701063Z 3eb706825457: Pull complete 2024-11-01T16:37:44.4888705Z 67d83ed868e6: Pull complete 2024-11-01T16:37:44.5055152Z 30d4de160741: Pull complete 2024-11-01T16:37:44.5285076Z d0d44efe8bc3: Pull complete 2024-11-01T16:37:44.5630290Z be6faa013cc8: Pull complete 2024-11-01T16:37:44.5816904Z 72dc36b20429: Pull complete 2024-11-01T16:37:44.6168897Z 058580a8278b: Pull complete 2024-11-01T16:37:44.6403006Z aae135253867: Pull complete 2024-11-01T16:37:46.2840251Z 3b05bde44864: Pull complete 2024-11-01T16:37:46.3004757Z 292e740c6187: Pull complete 2024-11-01T16:37:46.3192300Z d715265d8db7: Pull complete 2024-11-01T16:37:46.3546665Z 3634fe4cf0c4: Pull complete 2024-11-01T16:37:46.3753425Z da04921cbec5: Pull complete 2024-11-01T16:37:46.6122471Z 55b1e8dc281d: Pull complete 2024-11-01T16:37:46.6280387Z 595dea37c8f8: Pull complete 2024-11-01T16:37:46.6452644Z 1edfdc5afa7b: Pull complete 2024-11-01T16:37:46.6846009Z f64e657da3cf: Pull complete 2024-11-01T16:37:46.7035348Z de853ca4b926: Pull complete 2024-11-01T16:37:46.7367102Z 71d440813d6d: Pull complete 2024-11-01T16:37:46.7523208Z cee9a121085f: Pull complete 2024-11-01T16:37:46.7921351Z f749ccdf4d46: Pull complete 2024-11-01T16:39:41.6314545Z 1ffba2c07a78: Pull complete 2024-11-01T16:39:41.8442648Z d474c4eb5d81: Pull complete 2024-11-01T16:39:42.3191757Z b30192601766: Pull complete 2024-11-01T16:39:42.5399126Z e927cdba5b8a: Pull complete 2024-11-01T16:39:42.6063856Z 859f5d9a55a3: Pull complete 2024-11-01T16:39:42.8412246Z e992e1c90303: Pull complete 2024-11-01T16:39:43.2697620Z ded8f639d8e8: Pull complete 2024-11-01T16:39:43.4594885Z 6dc1988800db: Pull complete 2024-11-01T16:39:43.8716063Z 6b07caec55f8: Pull complete 2024-11-01T16:39:44.2372318Z fe72746ef78d: Pull complete 2024-11-01T16:39:44.4185087Z 41244b047648: Pull complete 2024-11-01T16:39:44.7824614Z c5ca3a0d4a11: Pull complete 2024-11-01T16:39:44.9775898Z 1f3eab9dfbb4: Pull complete 2024-11-01T16:39:45.3516495Z 805d5faba3b6: Pull complete 2024-11-01T16:39:45.4463760Z b37c2b2cc48a: Pull complete 2024-11-01T16:39:53.0118048Z a58aebee5440: Pull complete 2024-11-01T16:39:53.0322652Z aa5c2183b5a6: Pull complete 2024-11-01T16:39:53.0571069Z 0c906cd3d76d: Pull complete 2024-11-01T16:39:53.0756929Z 4fad3dce2eb7: Pull complete 2024-11-01T16:39:53.0967827Z 3ee82f006622: Pull complete 2024-11-01T16:39:53.1162766Z dbf98406efc0: Pull complete 2024-11-01T16:39:53.1615697Z 9cb7ede94ead: Pull complete 2024-11-01T16:39:54.6913915Z 81ba6fd7879d: Pull complete 2024-11-01T16:39:54.7463379Z Digest: sha256:68d308b5ab9729d840ef6882af267b00db6e15ae40d6c8de9da61fef478f8a18 2024-11-01T16:39:54.7669277Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:39:54.7671120Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:39:54.7709571Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:39:54.7710928Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-11-01T16:39:54.7719844Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:39:54.7720365Z env: 2024-11-01T16:39:54.7720632Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:39:54.7720970Z ##[endgroup] 2024-11-01T16:39:54.7809028Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-11-01T16:39:54.7809825Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-11-01T16:39:54.7810539Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-11-01T16:39:54.7811214Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-11-01T16:39:54.7817410Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:39:54.7817921Z env: 2024-11-01T16:39:54.7818191Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:39:54.7818518Z ##[endgroup] 2024-11-01T16:39:55.3836493Z Defaulting to user installation because normal site-packages is not writeable 2024-11-01T16:39:55.8375955Z Collecting psutil==5.9.1 2024-11-01T16:39:55.8736639Z Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB) 2024-11-01T16:39:55.9271297Z Collecting nvidia-ml-py==11.525.84 2024-11-01T16:39:55.9314280Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2024-11-01T16:39:56.0319164Z Installing collected packages: psutil, nvidia-ml-py 2024-11-01T16:39:56.2021215Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1 2024-11-01T16:39:56.4295032Z Prepare all required actions 2024-11-01T16:39:56.4295905Z Getting action download info 2024-11-01T16:39:56.5687027Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-11-01T16:39:56.7303495Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-11-01T16:39:56.8691778Z ##[group]Run ./.github/actions/download-build-artifacts 2024-11-01T16:39:56.8692264Z with: 2024-11-01T16:39:56.8692565Z name: linux-jammy-py3.9-gcc11 2024-11-01T16:39:56.8692953Z s3-bucket: gha-artifacts 2024-11-01T16:39:56.8693300Z env: 2024-11-01T16:39:56.8693546Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:39:56.8693878Z ##[endgroup] 2024-11-01T16:39:56.8731007Z ##[group]Run seemethere/download-artifact-s3@v4 2024-11-01T16:39:56.8731455Z with: 2024-11-01T16:39:56.8731724Z name: linux-jammy-py3.9-gcc11 2024-11-01T16:39:56.8732110Z s3-bucket: gha-artifacts 2024-11-01T16:39:56.8732505Z region: us-east-1 2024-11-01T16:39:56.8732795Z env: 2024-11-01T16:39:56.8733049Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:39:56.8733386Z ##[endgroup] 2024-11-01T16:39:57.4148447Z (node:39869) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-11-01T16:39:57.4149256Z 2024-11-01T16:39:57.4149530Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-11-01T16:39:57.4150266Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-11-01T16:39:57.4151171Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-11-01T16:39:57.4913655Z Found 1 objects with prefix pytorch/pytorch/11632514903/linux-jammy-py3.9-gcc11/ 2024-11-01T16:39:57.4914764Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-11-01T16:40:01.3185687Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-11-01T16:40:01.3192859Z Artifact download has finished successfully 2024-11-01T16:40:01.3366700Z ##[group]Run unzip -o artifacts.zip 2024-11-01T16:40:01.3367143Z unzip -o artifacts.zip 2024-11-01T16:40:01.3373215Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:01.3373720Z env: 2024-11-01T16:40:01.3373990Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:01.3374332Z ##[endgroup] 2024-11-01T16:40:01.3463736Z Archive: artifacts.zip 2024-11-01T16:40:01.3464499Z creating: dist/ 2024-11-01T16:40:02.3145081Z inflating: dist/torch-2.6.0a0+gitd1aa4ef-cp39-cp39-linux_x86_64.whl 2024-11-01T16:40:02.3145926Z creating: build/custom_test_artifacts/ 2024-11-01T16:40:02.3146565Z creating: build/custom_test_artifacts/custom-op-build/ 2024-11-01T16:40:02.3147307Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-11-01T16:40:02.3148422Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-11-01T16:40:02.3150610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-11-01T16:40:02.3151612Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-11-01T16:40:02.3153001Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-11-01T16:40:02.3154437Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-11-01T16:40:02.3155865Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-11-01T16:40:02.3157456Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-11-01T16:40:02.3159275Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-11-01T16:40:02.3160809Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-11-01T16:40:02.3162198Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-11-01T16:40:02.3164706Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-11-01T16:40:02.3167101Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-11-01T16:40:02.3169360Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-11-01T16:40:02.3171275Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-11-01T16:40:02.3172516Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-11-01T16:40:02.3173781Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-11-01T16:40:02.3174824Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-11-01T16:40:02.3175796Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-11-01T16:40:02.3176769Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-11-01T16:40:02.3177853Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-11-01T16:40:02.3179073Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-11-01T16:40:02.3180252Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-11-01T16:40:02.3181352Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-11-01T16:40:02.3182495Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-11-01T16:40:02.3183805Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-11-01T16:40:02.3184937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-11-01T16:40:02.3186085Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-11-01T16:40:02.3187214Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-11-01T16:40:02.3189805Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-11-01T16:40:02.3321991Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-11-01T16:40:02.3324065Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-11-01T16:40:02.3326176Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-11-01T16:40:02.3328174Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-11-01T16:40:02.3329400Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-11-01T16:40:02.3330572Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-11-01T16:40:02.3331772Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-11-01T16:40:02.3332986Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-11-01T16:40:02.3334197Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-11-01T16:40:02.3335408Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-11-01T16:40:02.3336603Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-11-01T16:40:02.3346597Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-11-01T16:40:02.3423500Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-11-01T16:40:02.3425793Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-11-01T16:40:02.3427444Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-11-01T16:40:02.3429407Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-11-01T16:40:02.3430680Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-11-01T16:40:02.3431627Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-11-01T16:40:02.3432546Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-11-01T16:40:02.3433350Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-11-01T16:40:02.3434188Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-11-01T16:40:02.3545480Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-11-01T16:40:02.3605718Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-11-01T16:40:02.3606965Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-11-01T16:40:02.3607710Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-11-01T16:40:02.3608562Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-11-01T16:40:02.3610102Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-11-01T16:40:02.3611689Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-11-01T16:40:02.3612979Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-11-01T16:40:02.3614386Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-11-01T16:40:02.3616057Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-11-01T16:40:02.3617263Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-11-01T16:40:02.3618811Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-11-01T16:40:02.3620250Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-11-01T16:40:02.3622000Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-11-01T16:40:02.3623631Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-11-01T16:40:02.3625920Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-11-01T16:40:02.3628212Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-11-01T16:40:02.3630521Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-11-01T16:40:02.3632088Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-11-01T16:40:02.3633331Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-11-01T16:40:02.3634339Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-11-01T16:40:02.3635293Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-11-01T16:40:02.3636286Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-11-01T16:40:02.3637411Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-11-01T16:40:02.3638681Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-11-01T16:40:02.3639896Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-11-01T16:40:02.3641208Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-11-01T16:40:02.3642386Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-11-01T16:40:02.3643613Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-11-01T16:40:02.3644794Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-11-01T16:40:02.3645965Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-11-01T16:40:02.3647125Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-11-01T16:40:02.3650399Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-11-01T16:40:02.3710469Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-11-01T16:40:02.3711724Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-11-01T16:40:02.3712857Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-11-01T16:40:02.3713886Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-11-01T16:40:02.3714831Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-11-01T16:40:02.3715758Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-11-01T16:40:02.3716659Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-11-01T16:40:02.3717649Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-11-01T16:40:02.3718470Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-11-01T16:40:02.3765782Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-11-01T16:40:02.3766580Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-11-01T16:40:02.3767372Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-11-01T16:40:02.3768299Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-11-01T16:40:02.3770123Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-11-01T16:40:02.3771164Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-11-01T16:40:02.3772224Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-11-01T16:40:02.3773336Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-11-01T16:40:02.3774422Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-11-01T16:40:02.3775668Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-11-01T16:40:02.3776962Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-11-01T16:40:02.3778092Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-11-01T16:40:02.3779205Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-11-01T16:40:02.3780501Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-11-01T16:40:02.3781794Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-11-01T16:40:02.3783068Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-11-01T16:40:02.3784343Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-11-01T16:40:02.3785839Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-11-01T16:40:02.3787151Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-11-01T16:40:02.3788267Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-11-01T16:40:02.3789427Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-11-01T16:40:02.3790936Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-11-01T16:40:02.3792145Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-11-01T16:40:02.3793503Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-11-01T16:40:02.3794807Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-11-01T16:40:02.3796033Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-11-01T16:40:02.3797296Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-11-01T16:40:02.3798569Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-11-01T16:40:02.3799845Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-11-01T16:40:02.3801118Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-11-01T16:40:02.3802569Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-11-01T16:40:02.3803914Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-11-01T16:40:02.3911475Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-11-01T16:40:02.3912724Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-11-01T16:40:02.3913984Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-11-01T16:40:02.3915391Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-11-01T16:40:02.3916752Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-11-01T16:40:02.3918042Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-11-01T16:40:02.3919364Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-11-01T16:40:02.3920738Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-11-01T16:40:02.3922075Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-11-01T16:40:02.3923416Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-11-01T16:40:02.3924725Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-11-01T16:40:02.3936733Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-11-01T16:40:02.3988664Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-11-01T16:40:02.3990072Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-11-01T16:40:02.3991297Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-11-01T16:40:02.3992597Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-11-01T16:40:02.3993632Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-11-01T16:40:02.3994703Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-11-01T16:40:02.3995675Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-11-01T16:40:02.3996550Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-11-01T16:40:02.3997456Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-11-01T16:40:02.4094551Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-11-01T16:40:02.4135918Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-11-01T16:40:02.4136557Z creating: build/lib/ 2024-11-01T16:40:02.4137377Z inflating: build/lib/libclog.a 2024-11-01T16:40:02.4146576Z inflating: build/lib/libpthreadpool.a 2024-11-01T16:40:02.4154851Z inflating: build/lib/libcpuinfo.a 2024-11-01T16:40:02.4162784Z inflating: build/lib/libcpuinfo_internals.a 2024-11-01T16:40:02.4226853Z inflating: build/lib/libgtest.a 2024-11-01T16:40:02.4234043Z inflating: build/lib/libittnotify.a 2024-11-01T16:40:02.4314427Z inflating: build/lib/libprotobuf-lite.a 2024-11-01T16:40:02.4384823Z inflating: build/lib/libbenchmark.a 2024-11-01T16:40:02.4411839Z inflating: build/lib/libtensorpipe_uv.a 2024-11-01T16:40:02.4474465Z inflating: build/lib/libasmjit.a 2024-11-01T16:40:02.4902442Z inflating: build/lib/libprotobuf.a 2024-11-01T16:40:02.5012513Z inflating: build/lib/libgloo.a 2024-11-01T16:40:02.5032878Z inflating: build/lib/libfmt.a 2024-11-01T16:40:02.5034525Z inflating: build/lib/libtorch_global_deps.so 2024-11-01T16:40:02.5133030Z inflating: build/lib/libc10.so 2024-11-01T16:40:02.5135293Z inflating: build/lib/libnnpack_reference_layers.a 2024-11-01T16:40:02.5154151Z inflating: build/lib/libpytorch_qnnpack.a 2024-11-01T16:40:02.5171243Z inflating: build/lib/libgmock.a 2024-11-01T16:40:02.5171975Z inflating: build/lib/libgtest_main.a 2024-11-01T16:40:02.5172725Z inflating: build/lib/libbenchmark_main.a 2024-11-01T16:40:02.5653309Z inflating: build/lib/libprotoc.a 2024-11-01T16:40:02.5671149Z inflating: build/lib/libnnpack.a 2024-11-01T16:40:02.6201412Z inflating: build/lib/libtensorpipe.a 2024-11-01T16:40:02.6202018Z inflating: build/lib/libgmock_main.a 2024-11-01T16:40:02.7196567Z inflating: build/lib/libfbgemm.a 2024-11-01T16:40:03.6695176Z inflating: build/lib/libdnnl.a 2024-11-01T16:40:03.6972775Z inflating: build/lib/libkineto.a 2024-11-01T16:40:03.7011851Z inflating: build/lib/libonnx_proto.a 2024-11-01T16:40:03.7204200Z inflating: build/lib/libXNNPACK.a 2024-11-01T16:40:03.7901986Z inflating: build/lib/libonnx.a 2024-11-01T16:40:06.1082125Z inflating: build/lib/libtorch_cpu.so 2024-11-01T16:40:06.1083116Z inflating: build/lib/libtorch.so 2024-11-01T16:40:06.1087912Z inflating: build/lib/libunbox_lib.a 2024-11-01T16:40:06.1091748Z inflating: build/lib/libshm.so 2024-11-01T16:40:06.1110249Z inflating: build/lib/libjitbackend_test.so 2024-11-01T16:40:06.1177572Z inflating: build/lib/libtorchbind_test.so 2024-11-01T16:40:06.1200965Z inflating: build/lib/libaoti_custom_ops.so 2024-11-01T16:40:06.1224957Z inflating: build/lib/libbackend_with_compiler.so 2024-11-01T16:40:06.3081308Z inflating: build/lib/libtorch_python.so 2024-11-01T16:40:06.3114235Z inflating: build/lib/libnnapi_backend.so 2024-11-01T16:40:06.3114746Z creating: build/bin/ 2024-11-01T16:40:06.3115101Z creating: build/bin/CMakeFiles/ 2024-11-01T16:40:06.3116071Z inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake 2024-11-01T16:40:06.3116815Z extracting: build/bin/CMakeFiles/progress.marks 2024-11-01T16:40:06.3117698Z inflating: build/bin/Makefile 2024-11-01T16:40:06.3118221Z inflating: build/bin/cmake_install.cmake 2024-11-01T16:40:06.3118725Z inflating: build/bin/CTestTestfile.cmake 2024-11-01T16:40:06.3170529Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-11-01T16:40:06.3223142Z inflating: build/bin/c10_DeviceGuard_test 2024-11-01T16:40:06.3276921Z inflating: build/bin/c10_Device_test 2024-11-01T16:40:06.3337717Z inflating: build/bin/c10_DispatchKeySet_test 2024-11-01T16:40:06.3393266Z inflating: build/bin/c10_Scalar_test 2024-11-01T16:40:06.3443319Z inflating: build/bin/c10_StreamGuard_test 2024-11-01T16:40:06.3496260Z inflating: build/bin/c10_SymInt_test 2024-11-01T16:40:06.3551974Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-11-01T16:40:06.3609048Z inflating: build/bin/c10_InlineStreamGuard_test 2024-11-01T16:40:06.3666365Z inflating: build/bin/c10_SizesAndStrides_test 2024-11-01T16:40:06.3738310Z inflating: build/bin/c10_cow_test 2024-11-01T16:40:06.3793044Z inflating: build/bin/c10_Bitset_test 2024-11-01T16:40:06.3843431Z inflating: build/bin/c10_ConstexprCrc_test 2024-11-01T16:40:06.3894818Z inflating: build/bin/c10_DeadlockDetection_test 2024-11-01T16:40:06.3951596Z inflating: build/bin/c10_Metaprogramming_test 2024-11-01T16:40:06.4003699Z inflating: build/bin/c10_Half_test 2024-11-01T16:40:06.4060880Z inflating: build/bin/c10_LeftRight_test 2024-11-01T16:40:06.4116038Z inflating: build/bin/c10_NetworkFlow_test 2024-11-01T16:40:06.4167774Z inflating: build/bin/c10_Synchronized_test 2024-11-01T16:40:06.4224161Z inflating: build/bin/c10_ThreadLocal_test 2024-11-01T16:40:06.4277666Z inflating: build/bin/c10_TypeIndex_test 2024-11-01T16:40:06.4330230Z inflating: build/bin/c10_TypeList_test 2024-11-01T16:40:06.4380801Z inflating: build/bin/c10_TypeTraits_test 2024-11-01T16:40:06.4434039Z inflating: build/bin/c10_accumulate_test 2024-11-01T16:40:06.4490641Z inflating: build/bin/c10_bfloat16_test 2024-11-01T16:40:06.4542631Z inflating: build/bin/c10_bit_cast_test 2024-11-01T16:40:06.4600802Z inflating: build/bin/c10_complex_math_test 2024-11-01T16:40:06.4657231Z inflating: build/bin/c10_complex_test 2024-11-01T16:40:06.4711569Z inflating: build/bin/c10_exception_test 2024-11-01T16:40:06.4763608Z inflating: build/bin/c10_flags_test 2024-11-01T16:40:06.4814945Z inflating: build/bin/c10_generic_math_test 2024-11-01T16:40:06.4976983Z inflating: build/bin/c10_intrusive_ptr_test 2024-11-01T16:40:06.5029244Z inflating: build/bin/c10_irange_test 2024-11-01T16:40:06.5084366Z inflating: build/bin/c10_lazy_test 2024-11-01T16:40:06.5142956Z inflating: build/bin/c10_logging_test 2024-11-01T16:40:06.5219062Z inflating: build/bin/c10_optional_test 2024-11-01T16:40:06.5274106Z inflating: build/bin/c10_registry_test 2024-11-01T16:40:06.5337286Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-11-01T16:40:06.5487184Z inflating: build/bin/c10_small_vector_test 2024-11-01T16:40:06.5540470Z inflating: build/bin/c10_string_util_test 2024-11-01T16:40:06.5593746Z inflating: build/bin/c10_ssize_test 2024-11-01T16:40:06.5645652Z inflating: build/bin/c10_tempfile_test 2024-11-01T16:40:06.5706213Z inflating: build/bin/c10_string_view_test 2024-11-01T16:40:06.5764129Z inflating: build/bin/c10_typeid_test 2024-11-01T16:40:06.5812743Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-11-01T16:40:06.6262920Z inflating: build/bin/protoc-3.13.0.0 2024-11-01T16:40:06.6712745Z inflating: build/bin/protoc 2024-11-01T16:40:06.7085584Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-11-01T16:40:06.7472731Z inflating: build/bin/vec_test_all_types_AVX512 2024-11-01T16:40:06.7871091Z inflating: build/bin/vec_test_all_types_AVX2 2024-11-01T16:40:06.7925779Z inflating: build/bin/FileStoreTest 2024-11-01T16:40:06.7980454Z inflating: build/bin/BackoffTest 2024-11-01T16:40:06.8037925Z inflating: build/bin/TCPStoreTest 2024-11-01T16:40:06.8093192Z inflating: build/bin/HashStoreTest 2024-11-01T16:40:06.8095817Z inflating: build/bin/example_allreduce 2024-11-01T16:40:06.8163261Z inflating: build/bin/ProcessGroupGlooTest 2024-11-01T16:40:06.8219357Z inflating: build/bin/test_dist_autograd 2024-11-01T16:40:06.8290688Z inflating: build/bin/test_cpp_rpc 2024-11-01T16:40:06.8293060Z inflating: build/bin/parallel_benchmark 2024-11-01T16:40:06.8301826Z inflating: build/bin/aot_model_compiler_test 2024-11-01T16:40:06.8369429Z inflating: build/bin/test_mobile_nnc 2024-11-01T16:40:06.8705146Z inflating: build/bin/test_lazy 2024-11-01T16:40:06.8764274Z inflating: build/bin/static_runtime_bench 2024-11-01T16:40:06.8818408Z inflating: build/bin/Dimname_test 2024-11-01T16:40:06.8893628Z inflating: build/bin/Dict_test 2024-11-01T16:40:06.8960020Z inflating: build/bin/MaybeOwned_test 2024-11-01T16:40:06.9208489Z inflating: build/bin/static_runtime_test 2024-11-01T16:40:06.9267201Z inflating: build/bin/NamedTensor_test 2024-11-01T16:40:06.9327687Z inflating: build/bin/apply_utils_test 2024-11-01T16:40:06.9392762Z inflating: build/bin/basic 2024-11-01T16:40:06.9452832Z inflating: build/bin/atest 2024-11-01T16:40:06.9509763Z inflating: build/bin/broadcast_test 2024-11-01T16:40:06.9562377Z inflating: build/bin/cpu_allocator_test 2024-11-01T16:40:06.9621747Z inflating: build/bin/cpu_generator_test 2024-11-01T16:40:06.9676734Z inflating: build/bin/cpu_profiling_allocator_test 2024-11-01T16:40:06.9728001Z inflating: build/bin/dispatch_key_set_test 2024-11-01T16:40:06.9821544Z inflating: build/bin/cpu_rng_test 2024-11-01T16:40:06.9874098Z inflating: build/bin/dlconvertor_test 2024-11-01T16:40:07.0982160Z inflating: build/bin/test_api 2024-11-01T16:40:07.1041781Z inflating: build/bin/extension_backend_test 2024-11-01T16:40:07.1098803Z inflating: build/bin/half_test 2024-11-01T16:40:07.1150867Z inflating: build/bin/lazy_tensor_test 2024-11-01T16:40:07.1246914Z inflating: build/bin/ivalue_test 2024-11-01T16:40:07.1301981Z inflating: build/bin/math_kernel_test 2024-11-01T16:40:07.1356947Z inflating: build/bin/memory_format_test 2024-11-01T16:40:07.1411691Z inflating: build/bin/memory_overlapping_test 2024-11-01T16:40:07.1463979Z inflating: build/bin/operator_name_test 2024-11-01T16:40:07.1521590Z inflating: build/bin/native_test 2024-11-01T16:40:07.1576398Z inflating: build/bin/mobile_memory_cleanup 2024-11-01T16:40:07.1630046Z inflating: build/bin/packedtensoraccessor_test 2024-11-01T16:40:07.1682272Z inflating: build/bin/operators_test 2024-11-01T16:40:07.1750254Z inflating: build/bin/pow_test 2024-11-01T16:40:07.1808937Z inflating: build/bin/quantized_test 2024-11-01T16:40:07.1860160Z inflating: build/bin/reduce_ops_test 2024-11-01T16:40:07.1913002Z inflating: build/bin/reportMemoryUsage_test 2024-11-01T16:40:07.1971299Z inflating: build/bin/scalar_tensor_test 2024-11-01T16:40:07.2023988Z inflating: build/bin/StorageUtils_test 2024-11-01T16:40:07.2083946Z inflating: build/bin/scalar_test 2024-11-01T16:40:07.2137497Z inflating: build/bin/stride_properties_test 2024-11-01T16:40:07.2193918Z inflating: build/bin/type_ptr_test 2024-11-01T16:40:07.2273369Z inflating: build/bin/tensor_iterator_test 2024-11-01T16:40:07.2276037Z inflating: build/bin/thread_init_test 2024-11-01T16:40:07.2331828Z inflating: build/bin/test_parallel 2024-11-01T16:40:07.2393263Z inflating: build/bin/type_test 2024-11-01T16:40:07.2394747Z inflating: build/bin/verify_api_visibility 2024-11-01T16:40:07.2448660Z inflating: build/bin/undefined_tensor_test 2024-11-01T16:40:07.2519362Z inflating: build/bin/legacy_vmap_test 2024-11-01T16:40:07.2572627Z inflating: build/bin/weakref_test 2024-11-01T16:40:07.2625860Z inflating: build/bin/wrapdim_test 2024-11-01T16:40:07.2686915Z inflating: build/bin/IListRef_test 2024-11-01T16:40:07.2740600Z inflating: build/bin/xla_tensor_test 2024-11-01T16:40:07.2846606Z inflating: build/bin/List_test 2024-11-01T16:40:07.2968317Z inflating: build/bin/kernel_function_legacy_test 2024-11-01T16:40:07.3064691Z inflating: build/bin/kernel_function_test 2024-11-01T16:40:07.3131966Z inflating: build/bin/KernelFunction_test 2024-11-01T16:40:07.3258260Z inflating: build/bin/kernel_lambda_legacy_test 2024-11-01T16:40:07.3360216Z inflating: build/bin/kernel_lambda_test 2024-11-01T16:40:07.3421844Z inflating: build/bin/kernel_stackbased_test 2024-11-01T16:40:07.3518374Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-11-01T16:40:07.3571170Z inflating: build/bin/CppSignature_test 2024-11-01T16:40:07.3621769Z inflating: build/bin/op_allowlist_test 2024-11-01T16:40:07.3928799Z inflating: build/bin/op_registration_test 2024-11-01T16:40:07.3985234Z inflating: build/bin/backend_fallback_test 2024-11-01T16:40:07.4050607Z inflating: build/bin/inline_container_test 2024-11-01T16:40:07.4105408Z inflating: build/bin/test_edge_op_registration 2024-11-01T16:40:07.4109757Z inflating: build/bin/torch_shm_manager 2024-11-01T16:40:07.4122582Z inflating: build/bin/tutorial_tensorexpr 2024-11-01T16:40:07.4901334Z inflating: build/bin/test_tensorexpr 2024-11-01T16:40:07.5466548Z inflating: build/bin/test_jit 2024-11-01T16:40:07.5467047Z creating: .additional_ci_files/ 2024-11-01T16:40:07.5542064Z inflating: .additional_ci_files/test-times.json 2024-11-01T16:40:07.5842698Z inflating: .additional_ci_files/test-class-times.json 2024-11-01T16:40:07.5905827Z ##[group]Run rm artifacts.zip 2024-11-01T16:40:07.5906355Z rm artifacts.zip 2024-11-01T16:40:07.5912359Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:07.5912863Z env: 2024-11-01T16:40:07.5913134Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:07.5913476Z ##[endgroup] 2024-11-01T16:40:07.6224971Z ##[group]Run df -H 2024-11-01T16:40:07.6225281Z df -H 2024-11-01T16:40:07.6231262Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:07.6231763Z env: 2024-11-01T16:40:07.6232028Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:07.6232369Z ##[endgroup] 2024-11-01T16:40:07.6386282Z Filesystem Size Used Avail Use% Mounted on 2024-11-01T16:40:07.6386818Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-11-01T16:40:07.6387312Z tmpfs 8.2G 0 8.2G 0% /dev/shm 2024-11-01T16:40:07.6387783Z tmpfs 3.3G 488k 3.3G 1% /run 2024-11-01T16:40:07.6388544Z /dev/nvme0n1p1 161G 33G 129G 21% / 2024-11-01T16:40:07.6389408Z tmpfs 8.2G 4.1k 8.2G 1% /tmp 2024-11-01T16:40:07.6390008Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-11-01T16:40:07.6479854Z Prepare all required actions 2024-11-01T16:40:07.6480282Z Getting action download info 2024-11-01T16:40:07.7672735Z ##[group]Run ./.github/actions/download-td-artifacts 2024-11-01T16:40:07.7673217Z with: 2024-11-01T16:40:07.7673452Z env: 2024-11-01T16:40:07.7673719Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:07.7674058Z ##[endgroup] 2024-11-01T16:40:07.7721696Z ##[group]Run seemethere/download-artifact-s3@v4 2024-11-01T16:40:07.7722150Z with: 2024-11-01T16:40:07.7722409Z name: td_results 2024-11-01T16:40:07.7722723Z s3-bucket: gha-artifacts 2024-11-01T16:40:07.7723052Z region: us-east-1 2024-11-01T16:40:07.7723343Z env: 2024-11-01T16:40:07.7723604Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:07.7723937Z ##[endgroup] 2024-11-01T16:40:08.3069985Z (node:39889) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-11-01T16:40:08.3070759Z 2024-11-01T16:40:08.3071122Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-11-01T16:40:08.3071924Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-11-01T16:40:08.3073337Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-11-01T16:40:08.3714506Z Found 1 objects with prefix pytorch/pytorch/11632514903/td_results/ 2024-11-01T16:40:08.3715677Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-11-01T16:40:08.4288306Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-11-01T16:40:08.4294467Z Artifact download has finished successfully 2024-11-01T16:40:08.4446952Z ##[group]Run mkdir -p .additional_ci_files 2024-11-01T16:40:08.4447432Z mkdir -p .additional_ci_files 2024-11-01T16:40:08.4447995Z mv td_results.json .additional_ci_files/td_results.json 2024-11-01T16:40:08.4454079Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:08.4454604Z env: 2024-11-01T16:40:08.4454892Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:08.4455261Z ##[endgroup] 2024-11-01T16:40:08.4672254Z ##[group]Run .github/scripts/parse_ref.py 2024-11-01T16:40:08.4672745Z .github/scripts/parse_ref.py 2024-11-01T16:40:08.4678677Z shell: /usr/bin/bash -e {0} 2024-11-01T16:40:08.4679027Z env: 2024-11-01T16:40:08.4679285Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:08.4679628Z ##[endgroup] 2024-11-01T16:40:08.5008951Z Prepare all required actions 2024-11-01T16:40:08.5054558Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-11-01T16:40:08.5055026Z with: 2024-11-01T16:40:08.5055628Z github-token: *** 2024-11-01T16:40:08.5055925Z env: 2024-11-01T16:40:08.5056184Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:08.5056503Z ##[endgroup] 2024-11-01T16:40:08.5153659Z ##[group]Run set -eux 2024-11-01T16:40:08.5153996Z set -eux 2024-11-01T16:40:08.5154594Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-11-01T16:40:08.5161633Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:08.5162123Z env: 2024-11-01T16:40:08.5162391Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:08.5162940Z GITHUB_TOKEN: *** 2024-11-01T16:40:08.5163241Z ##[endgroup] 2024-11-01T16:40:08.5188139Z + python3 .github/scripts/get_workflow_job_id.py 11632514903 i-02f620357bfb2a39d 2024-11-01T16:40:10.4561789Z setting job-id=32396543967 2024-11-01T16:40:10.4562655Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:10.4870687Z Prepare all required actions 2024-11-01T16:40:10.4871259Z Getting action download info 2024-11-01T16:40:10.6230821Z ##[group]Run ./.github/actions/filter-test-configs 2024-11-01T16:40:10.6231289Z with: 2024-11-01T16:40:10.6231774Z github-token: *** 2024-11-01T16:40:10.6235336Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]} 2024-11-01T16:40:10.6239117Z job-name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:10.6239721Z env: 2024-11-01T16:40:10.6239977Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:10.6240311Z ##[endgroup] 2024-11-01T16:40:10.6290797Z ##[group]Run nick-fields/retry@v3.0.0 2024-11-01T16:40:10.6291207Z with: 2024-11-01T16:40:10.6291520Z shell: bash 2024-11-01T16:40:10.6291805Z timeout_minutes: 10 2024-11-01T16:40:10.6292114Z max_attempts: 5 2024-11-01T16:40:10.6292413Z retry_wait_seconds: 30 2024-11-01T16:40:10.6293577Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-11-01T16:40:10.6294811Z polling_interval_seconds: 1 2024-11-01T16:40:10.6295174Z warning_on_retry: true 2024-11-01T16:40:10.6295565Z continue_on_error: false 2024-11-01T16:40:10.6295890Z env: 2024-11-01T16:40:10.6296144Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:10.6296670Z GITHUB_TOKEN: *** 2024-11-01T16:40:10.6296957Z ##[endgroup] 2024-11-01T16:40:13.0709727Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-11-01T16:40:13.3415709Z Defaulting to user installation because normal site-packages is not writeable 2024-11-01T16:40:13.5306901Z Collecting requests==2.27.1 2024-11-01T16:40:13.5652127Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2024-11-01T16:40:13.8144917Z Collecting pyyaml==6.0.1 2024-11-01T16:40:13.8192655Z Downloading PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB) 2024-11-01T16:40:13.8941840Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-11-01T16:40:13.9720629Z Collecting certifi>=2017.4.17 2024-11-01T16:40:13.9766529Z Downloading certifi-2024.8.30-py3-none-any.whl (167 kB) 2024-11-01T16:40:14.0093739Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-11-01T16:40:14.3769388Z Collecting charset-normalizer~=2.0.0 2024-11-01T16:40:14.3817122Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2024-11-01T16:40:14.4984449Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml 2024-11-01T16:40:14.8217976Z Successfully installed certifi-2024.8.30 charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1 2024-11-01T16:40:14.9378431Z Command completed after 1 attempt(s). 2024-11-01T16:40:14.9591553Z ##[group]Run set -x 2024-11-01T16:40:14.9591885Z set -x 2024-11-01T16:40:14.9592176Z  2024-11-01T16:40:14.9592725Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-11-01T16:40:14.9593458Z # in runner workspace 2024-11-01T16:40:14.9593988Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-11-01T16:40:14.9600524Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:14.9601017Z env: 2024-11-01T16:40:14.9601289Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:14.9601627Z ##[endgroup] 2024-11-01T16:40:14.9628259Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-11-01T16:40:14.9953310Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-11-01T16:40:14.9953902Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-11-01T16:40:14.9954368Z echo "Job name: ${JOB_NAME}" 2024-11-01T16:40:14.9954766Z  2024-11-01T16:40:14.9955314Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-11-01T16:40:14.9956009Z # in runner workspace 2024-11-01T16:40:14.9956594Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-11-01T16:40:14.9957230Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-11-01T16:40:14.9957704Z  --job-name "${JOB_NAME}" \ 2024-11-01T16:40:14.9961769Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}" \ 2024-11-01T16:40:14.9965463Z  --selected-test-configs "" \ 2024-11-01T16:40:14.9965925Z  --pr-number "${PR_NUMBER}" \ 2024-11-01T16:40:14.9966334Z  --tag "${TAG}" \ 2024-11-01T16:40:14.9966716Z  --event-name "${EVENT_NAME}" \ 2024-11-01T16:40:14.9967167Z  --schedule "${SCHEDULE}" \ 2024-11-01T16:40:14.9967592Z  --branch "${HEAD_BRANCH}" 2024-11-01T16:40:14.9973970Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:14.9974488Z env: 2024-11-01T16:40:14.9974745Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:14.9975300Z GITHUB_TOKEN: *** 2024-11-01T16:40:14.9975836Z JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:14.9976446Z PR_NUMBER: 138766 2024-11-01T16:40:14.9976737Z TAG: 2024-11-01T16:40:14.9977007Z EVENT_NAME: pull_request 2024-11-01T16:40:14.9977332Z SCHEDULE: 2024-11-01T16:40:14.9977610Z HEAD_BRANCH: 2024-11-01T16:40:14.9977894Z ##[endgroup] 2024-11-01T16:40:15.0002299Z Workflow: pull 2024-11-01T16:40:15.0003116Z Job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:15.2447997Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-11-01T16:40:16.0267896Z ##[group]Run echo "Filtered matrix:" 2024-11-01T16:40:16.0268350Z echo "Filtered matrix:" 2024-11-01T16:40:16.0272176Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}" 2024-11-01T16:40:16.0275851Z  2024-11-01T16:40:16.0276102Z echo 2024-11-01T16:40:16.0276476Z echo "Is the current job unstable? False" 2024-11-01T16:40:16.0276933Z  2024-11-01T16:40:16.0277192Z echo 2024-11-01T16:40:16.0277543Z echo "Is keep-going label set? False" 2024-11-01T16:40:16.0277972Z  2024-11-01T16:40:16.0278225Z echo 2024-11-01T16:40:16.0278531Z echo "Renabled issues? " 2024-11-01T16:40:16.0284699Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:16.0285204Z env: 2024-11-01T16:40:16.0285471Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:16.0285906Z ##[endgroup] 2024-11-01T16:40:16.0310540Z Filtered matrix: 2024-11-01T16:40:16.0315073Z {include: [{config: default, shard: 1, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 2, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 3, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 4, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 5, num_shards: 5, runner: linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: linux.2xlarge}]} 2024-11-01T16:40:16.0318397Z 2024-11-01T16:40:16.0318546Z Is the current job unstable? False 2024-11-01T16:40:16.0318836Z 2024-11-01T16:40:16.0319268Z Is keep-going label set? False 2024-11-01T16:40:16.0319522Z 2024-11-01T16:40:16.0319646Z Renabled issues? 2024-11-01T16:40:16.0412382Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-11-01T16:40:16.0413128Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-11-01T16:40:16.0419236Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T16:40:16.0419739Z env: 2024-11-01T16:40:16.0420005Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:16.0420336Z JOB_TIMEOUT: 240 2024-11-01T16:40:16.0420630Z ##[endgroup] 2024-11-01T16:40:16.0579213Z ##[group]Run # Fetch aws credential from IMDs 2024-11-01T16:40:16.0579800Z # Fetch aws credential from IMDs 2024-11-01T16:40:16.0580415Z eval "$(python3 .github/scripts/get_aws_session_tokens.py)" 2024-11-01T16:40:16.0580968Z set -x 2024-11-01T16:40:16.0581238Z  2024-11-01T16:40:16.0581572Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-11-01T16:40:16.0582118Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-11-01T16:40:16.0582684Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-11-01T16:40:16.0583191Z  TEST_COMMAND=.ci/onnx/test.sh 2024-11-01T16:40:16.0583598Z else 2024-11-01T16:40:16.0583922Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-11-01T16:40:16.0584339Z fi 2024-11-01T16:40:16.0584606Z  2024-11-01T16:40:16.0585066Z # detached container should get cleaned up by teardown_ec2_linux 2024-11-01T16:40:16.0585893Z # TODO: Stop building test binaries as part of the build phase 2024-11-01T16:40:16.0586581Z # Used for GPU_FLAG since that doesn't play nice 2024-11-01T16:40:16.0587273Z # shellcheck disable=SC2086,SC2090 2024-11-01T16:40:16.0587718Z container_name=$(docker run \ 2024-11-01T16:40:16.0588128Z  ${GPU_FLAG:-} \ 2024-11-01T16:40:16.0588537Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2024-11-01T16:40:16.0589104Z  -e BUILD_ENVIRONMENT \ 2024-11-01T16:40:16.0589501Z  -e PR_NUMBER \ 2024-11-01T16:40:16.0589843Z  -e GITHUB_ACTIONS \ 2024-11-01T16:40:16.0590285Z  -e GITHUB_REPOSITORY \ 2024-11-01T16:40:16.0590683Z  -e GITHUB_WORKFLOW \ 2024-11-01T16:40:16.0591060Z  -e GITHUB_JOB \ 2024-11-01T16:40:16.0591413Z  -e GITHUB_RUN_ID \ 2024-11-01T16:40:16.0591787Z  -e GITHUB_RUN_NUMBER \ 2024-11-01T16:40:16.0592172Z  -e GITHUB_RUN_ATTEMPT \ 2024-11-01T16:40:16.0592568Z  -e JOB_ID \ 2024-11-01T16:40:16.0592900Z  -e JOB_NAME \ 2024-11-01T16:40:16.0593238Z  -e BASE_SHA \ 2024-11-01T16:40:16.0593572Z  -e BRANCH \ 2024-11-01T16:40:16.0593879Z  -e SHA1 \ 2024-11-01T16:40:16.0594211Z  -e AWS_DEFAULT_REGION \ 2024-11-01T16:40:16.0594613Z  -e AWS_ACCESS_KEY_ID \ 2024-11-01T16:40:16.0595013Z  -e AWS_SECRET_ACCESS_KEY \ 2024-11-01T16:40:16.0595426Z  -e AWS_SESSION_TOKEN \ 2024-11-01T16:40:16.0595800Z  -e IN_WHEEL_TEST \ 2024-11-01T16:40:16.0596171Z  -e SHARD_NUMBER \ 2024-11-01T16:40:16.0596534Z  -e TEST_CONFIG \ 2024-11-01T16:40:16.0596893Z  -e NUM_TEST_SHARDS \ 2024-11-01T16:40:16.0597278Z  -e REENABLED_ISSUES \ 2024-11-01T16:40:16.0597685Z  -e CONTINUE_THROUGH_ERROR \ 2024-11-01T16:40:16.0598090Z  -e VERBOSE_TEST_LOGS \ 2024-11-01T16:40:16.0598485Z  -e TEST_SHOWLOCALS \ 2024-11-01T16:40:16.0598873Z  -e NO_TEST_TIMEOUT \ 2024-11-01T16:40:16.0599234Z  -e NO_TD \ 2024-11-01T16:40:16.0599566Z  -e TD_DISTRIBUTED \ 2024-11-01T16:40:16.0599931Z  -e PR_LABELS \ 2024-11-01T16:40:16.0600359Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-11-01T16:40:16.0600816Z  -e SCCACHE_BUCKET \ 2024-11-01T16:40:16.0601193Z  -e SCCACHE_REGION \ 2024-11-01T16:40:16.0601577Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-11-01T16:40:16.0601985Z  -e XLA_CUDA \ 2024-11-01T16:40:16.0602361Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-11-01T16:40:16.0602891Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-11-01T16:40:16.0603414Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-11-01T16:40:16.0603930Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-11-01T16:40:16.0604397Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-11-01T16:40:16.0604847Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-11-01T16:40:16.0605485Z  -e DASHBOARD_TAG \ 2024-11-01T16:40:16.0605862Z  -e IS_A100_RUNNER \ 2024-11-01T16:40:16.0606252Z  -e ARTIFACTS_FILE_SUFFIX \ 2024-11-01T16:40:16.0606769Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-11-01T16:40:16.0607325Z  --security-opt seccomp=unconfined \ 2024-11-01T16:40:16.0607774Z  --cap-add=SYS_PTRACE \ 2024-11-01T16:40:16.0608162Z  --ipc=host \ 2024-11-01T16:40:16.0608511Z  --shm-size="${SHM_SIZE}" \ 2024-11-01T16:40:16.0608899Z  --tty \ 2024-11-01T16:40:16.0609203Z  --detach \ 2024-11-01T16:40:16.0609546Z  --name="${container_name}" \ 2024-11-01T16:40:16.0609945Z  --user jenkins \ 2024-11-01T16:40:16.0610426Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-11-01T16:40:16.0610985Z  -w /var/lib/jenkins/workspace \ 2024-11-01T16:40:16.0611417Z  "${DOCKER_IMAGE}" 2024-11-01T16:40:16.0611763Z ) 2024-11-01T16:40:16.0612151Z # Propagate download.pytorch.org IP to container 2024-11-01T16:40:16.0613097Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-11-01T16:40:16.0614164Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-11-01T16:40:16.0615107Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-11-01T16:40:16.0621744Z shell: /usr/bin/bash -e {0} 2024-11-01T16:40:16.0622090Z env: 2024-11-01T16:40:16.0622355Z GIT_DEFAULT_BRANCH: main 2024-11-01T16:40:16.0622748Z BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11 2024-11-01T16:40:16.0623194Z PR_NUMBER: 138766 2024-11-01T16:40:16.0623525Z GITHUB_REPOSITORY: pytorch/pytorch 2024-11-01T16:40:16.0623932Z GITHUB_WORKFLOW: pull 2024-11-01T16:40:16.0624256Z GITHUB_JOB: test 2024-11-01T16:40:16.0624548Z GITHUB_RUN_ID: 11632514903 2024-11-01T16:40:16.0624906Z GITHUB_RUN_NUMBER: 261361 2024-11-01T16:40:16.0625307Z GITHUB_RUN_ATTEMPT: 1 2024-11-01T16:40:16.0625628Z JOB_ID: 32396543967 2024-11-01T16:40:16.0626166Z JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:16.0626780Z BRANCH: pull/138766 2024-11-01T16:40:16.0627146Z SHA1: d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:40:16.0627677Z BASE_SHA: 2055d3c8dc8b93c52eda6b9c07d716448d9e28c9 2024-11-01T16:40:16.0628148Z TEST_CONFIG: distributed 2024-11-01T16:40:16.0628487Z SHARD_NUMBER: 2 2024-11-01T16:40:16.0628914Z NUM_TEST_SHARDS: 2 2024-11-01T16:40:16.0629221Z REENABLED_ISSUES: 2024-11-01T16:40:16.0629549Z CONTINUE_THROUGH_ERROR: False 2024-11-01T16:40:16.0629924Z VERBOSE_TEST_LOGS: False 2024-11-01T16:40:16.0630271Z TEST_SHOWLOCALS: False 2024-11-01T16:40:16.0630608Z NO_TEST_TIMEOUT: False 2024-11-01T16:40:16.0630915Z NO_TD: False 2024-11-01T16:40:16.0631203Z TD_DISTRIBUTED: False 2024-11-01T16:40:16.0631621Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-11-01T16:40:16.0632104Z SCCACHE_REGION: us-east-1 2024-11-01T16:40:16.0632476Z SCCACHE_S3_KEY_PREFIX: pull 2024-11-01T16:40:16.0632831Z SHM_SIZE: 1g 2024-11-01T16:40:16.0633703Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:40:16.0634680Z XLA_CUDA: 2024-11-01T16:40:16.0635179Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-11-01T16:40:16.0635803Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-11-01T16:40:16.0636272Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-11-01T16:40:16.0636677Z DASHBOARD_TAG: 2024-11-01T16:40:16.0637184Z HUGGING_FACE_HUB_TOKEN: *** 2024-11-01T16:40:16.0637726Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2024-11-01T16:40:16.0638108Z IS_A100_RUNNER: 0 2024-11-01T16:40:16.0638596Z ARTIFACTS_FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T16:40:16.0639167Z ##[endgroup] 2024-11-01T16:40:16.0857175Z Traceback (most recent call last): 2024-11-01T16:40:16.0858426Z File "/home/ec2-user/actions-runner/_work/pytorch/pytorch/.github/scripts/get_aws_session_tokens.py", line 2, in 2024-11-01T16:40:16.0859532Z import boto3 # type: ignore[import] 2024-11-01T16:40:16.0860068Z ModuleNotFoundError: No module named 'boto3' 2024-11-01T16:40:16.0885543Z + [[ distributed == \m\u\l\t\i\g\p\u ]] 2024-11-01T16:40:16.0886147Z + [[ linux-jammy-py3.9-gcc11 == *onnx* ]] 2024-11-01T16:40:16.0886592Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-11-01T16:40:16.0894370Z +++ nproc --ignore=2 2024-11-01T16:40:16.0929685Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e AWS_ACCESS_KEY_ID -e AWS_SECRET_ACCESS_KEY -e AWS_SESSION_TOKEN -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_11632514903 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T16:40:19.9630318Z + container_name=7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T16:40:19.9633545Z + grep download.pytorch.org /etc/hosts 2024-11-01T16:40:19.9634845Z + docker exec -i 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 sudo bash -c '/bin/cat >> /etc/hosts' 2024-11-01T16:40:20.1622031Z + echo DOCKER_CONTAINER_ID=7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T16:40:20.1625625Z ++ echo dist/torch-2.6.0a0+gitd1aa4ef-cp39-cp39-linux_x86_64.whl 2024-11-01T16:40:20.1627629Z + docker exec -t 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 sh -c 'pip install dist/torch-2.6.0a0+gitd1aa4ef-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-11-01T16:40:21.2177285Z Processing ./dist/torch-2.6.0a0+gitd1aa4ef-cp39-cp39-linux_x86_64.whl (from torch==2.6.0a0+gitd1aa4ef) 2024-11-01T16:40:21.6953281Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (3.16.1) 2024-11-01T16:40:21.6957733Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (4.12.2) 2024-11-01T16:40:21.6961082Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (2.8.8) 2024-11-01T16:40:21.6965143Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (3.1.4) 2024-11-01T16:40:21.6969146Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (2024.10.0) 2024-11-01T16:40:21.6975210Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (1.13.1) 2024-11-01T16:40:21.7009071Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy==1.13.1->torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (1.3.0) 2024-11-01T16:40:21.7024648Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (3.3.0) 2024-11-01T16:40:21.7054048Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (1.22.4) 2024-11-01T16:40:21.7564488Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.6.0a0+gitd1aa4ef->torch==2.6.0a0+gitd1aa4ef) (3.0.2) 2024-11-01T16:40:22.4900490Z Installing collected packages: torch 2024-11-01T16:40:30.9733953Z Successfully installed torch-2.6.0a0+gitd1aa4ef 2024-11-01T16:40:31.0712030Z + export TERM=vt100 2024-11-01T16:40:31.0712524Z + TERM=vt100 2024-11-01T16:40:31.0714365Z ++ dirname .ci/pytorch/test.sh 2024-11-01T16:40:31.0732859Z + source .ci/pytorch/common.sh 2024-11-01T16:40:31.0744542Z +++ dirname .ci/pytorch/common.sh 2024-11-01T16:40:31.0751567Z ++ source .ci/pytorch/common_utils.sh 2024-11-01T16:40:31.0760045Z +++ declare -f -t trap_add 2024-11-01T16:40:31.0764383Z ++ set -ex 2024-11-01T16:40:31.0764979Z ++ [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-11-01T16:40:31.0765539Z ++ BUILD_TEST_LIBTORCH=0 2024-11-01T16:40:31.0765984Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]] 2024-11-01T16:40:31.0768182Z ++ stat -c %u /var/lib/jenkins/workspace 2024-11-01T16:40:31.0804091Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-11-01T16:40:31.0804929Z + trap_add cleanup_workspace EXIT 2024-11-01T16:40:31.0805376Z + trap_add_cmd=cleanup_workspace 2024-11-01T16:40:31.0805745Z + shift 2024-11-01T16:40:31.0806018Z + for trap_add_name in "$@" 2024-11-01T16:40:31.0810747Z +++ trap -p EXIT 2024-11-01T16:40:31.0813276Z ++ eval 'extract_trap_cmd ' 2024-11-01T16:40:31.0813697Z +++ extract_trap_cmd 2024-11-01T16:40:31.0814307Z +++ printf '%s\n' '' 2024-11-01T16:40:31.0815006Z ++ printf '%s\n' cleanup_workspace 2024-11-01T16:40:31.0816469Z + trap -- ' 2024-11-01T16:40:31.0816879Z cleanup_workspace' EXIT 2024-11-01T16:40:31.0817412Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-11-01T16:40:31.5559633Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-11-01T16:40:31.5851304Z + echo 'Environment variables:' 2024-11-01T16:40:31.5851805Z Environment variables: 2024-11-01T16:40:31.5852126Z + env 2024-11-01T16:40:31.5868932Z INSTALLED_DB=yes 2024-11-01T16:40:31.5870374Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T16:40:31.5871247Z CONTINUE_THROUGH_ERROR=False 2024-11-01T16:40:31.5871809Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11 2024-11-01T16:40:31.5872409Z HOSTNAME=7afe1bd6a4a7 2024-11-01T16:40:31.5873959Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.5875464Z GITHUB_ACTION=__self 2024-11-01T16:40:31.5876064Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-11-01T16:40:31.5876753Z GITHUB_RUN_NUMBER=261361 2024-11-01T16:40:31.5877339Z TEST_CONFIG=distributed 2024-11-01T16:40:31.5877943Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-11-01T16:40:31.5878829Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-11-01T16:40:31.5879547Z IS_A100_RUNNER=0 2024-11-01T16:40:31.5880629Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-11-01T16:40:31.5881373Z GITHUB_TRIGGERING_ACTOR=c00w 2024-11-01T16:40:31.5882001Z GITHUB_REF_TYPE=branch 2024-11-01T16:40:31.5882679Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-11-01T16:40:31.5883507Z BASE_SHA=2055d3c8dc8b93c52eda6b9c07d716448d9e28c9 2024-11-01T16:40:31.5884349Z XLA_CUDA= 2024-11-01T16:40:31.5885077Z HUGGING_FACE_HUB_TOKEN=*** 2024-11-01T16:40:31.5890599Z *** 2024-11-01T16:40:31.5890926Z GITHUB_REPOSITORY_ID=65600975 2024-11-01T16:40:31.5891308Z GITHUB_ACTIONS=true 2024-11-01T16:40:31.5891685Z SHA1=d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:40:31.5892202Z GITHUB_SHA=368da7510f5d755034681777a4e5ae6d33c07b38 2024-11-01T16:40:31.5893163Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/138766/merge 2024-11-01T16:40:31.5893833Z UCC_HOME=/usr 2024-11-01T16:40:31.5894127Z VERBOSE_TEST_LOGS=False 2024-11-01T16:40:31.5894462Z GITHUB_REF=refs/pull/138766/merge 2024-11-01T16:40:31.5894837Z SHARD_NUMBER=2 2024-11-01T16:40:31.5895139Z GITHUB_REF_PROTECTED=false 2024-11-01T16:40:31.5895487Z HOME=/var/lib/jenkins 2024-11-01T16:40:31.5895845Z GITHUB_API_URL=https://api.github.com 2024-11-01T16:40:31.5896276Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-11-01T16:40:31.5896667Z UCX_COMMIT= 2024-11-01T16:40:31.5896953Z SCCACHE_S3_KEY_PREFIX=pull 2024-11-01T16:40:31.5897295Z NUM_TEST_SHARDS=2 2024-11-01T16:40:31.5897592Z UCX_HOME=/usr 2024-11-01T16:40:31.5898518Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.5899669Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:31.5900838Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.5902128Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-11-01T16:40:31.5902813Z GITHUB_EVENT_NAME=pull_request 2024-11-01T16:40:31.5903179Z DASHBOARD_TAG= 2024-11-01T16:40:31.5903463Z GITHUB_RUN_ID=11632514903 2024-11-01T16:40:31.5904448Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.5905354Z GITHUB_ACTOR=c00w 2024-11-01T16:40:31.5905657Z PR_NUMBER=138766 2024-11-01T16:40:31.5905948Z DESIRED_CUDA= 2024-11-01T16:40:31.5906219Z GITHUB_RUN_ATTEMPT=1 2024-11-01T16:40:31.5906551Z ANACONDA_PYTHON_VERSION=3.9 2024-11-01T16:40:31.5906991Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-11-01T16:40:31.5907452Z TERM=vt100 2024-11-01T16:40:31.5907721Z INSTALLED_VISION=yes 2024-11-01T16:40:31.5908022Z BRANCH=pull/138766 2024-11-01T16:40:31.5908376Z SCCACHE_REGION=us-east-1 2024-11-01T16:40:31.5908863Z OPENSSL_ROOT_DIR=/opt/openssl 2024-11-01T16:40:31.5909240Z CUDA_PATH=/usr/local/cuda 2024-11-01T16:40:31.5910025Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-11-01T16:40:31.5910806Z GITHUB_SERVER_URL=https://github.com 2024-11-01T16:40:31.5911189Z UCC_COMMIT= 2024-11-01T16:40:31.5911464Z REENABLED_ISSUES= 2024-11-01T16:40:31.5911753Z DOCS=yes 2024-11-01T16:40:31.5912015Z INSTALLED_ANDROID= 2024-11-01T16:40:31.5912304Z SHLVL=1 2024-11-01T16:40:31.5912537Z MAX_JOBS=6 2024-11-01T16:40:31.5912808Z GITHUB_ACTOR_ID=486199 2024-11-01T16:40:31.5913268Z GITHUB_WORKFLOW_SHA=368da7510f5d755034681777a4e5ae6d33c07b38 2024-11-01T16:40:31.5913779Z GITHUB_REF_NAME=138766/merge 2024-11-01T16:40:31.5914394Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-11-01T16:40:31.5914969Z GITHUB_JOB=test 2024-11-01T16:40:31.5915267Z NO_TEST_TIMEOUT=False 2024-11-01T16:40:31.5915591Z TD_DISTRIBUTED=False 2024-11-01T16:40:31.5915930Z GITHUB_REPOSITORY=pytorch/pytorch 2024-11-01T16:40:31.5916323Z GITHUB_RETENTION_DAYS=90 2024-11-01T16:40:31.5916657Z OPENSSL_DIR=/opt/openssl 2024-11-01T16:40:31.5917003Z GITHUB_ACTION_REPOSITORY= 2024-11-01T16:40:31.5918076Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-11-01T16:40:31.5919203Z GITHUB_BASE_REF=gh/c00w/2/base 2024-11-01T16:40:31.5919568Z INSTALLED_ACL= 2024-11-01T16:40:31.5920114Z ARTIFACTS_FILE_SUFFIX=test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T16:40:31.5920662Z CI=true 2024-11-01T16:40:31.5920939Z GITHUB_REPOSITORY_OWNER=pytorch 2024-11-01T16:40:31.5921307Z JOB_ID=32396543967 2024-11-01T16:40:31.5921610Z INSTALLED_PROTOBUF=yes 2024-11-01T16:40:31.5921945Z GITHUB_HEAD_REF=gh/c00w/2/head 2024-11-01T16:40:31.5922295Z GITHUB_ACTION_REF= 2024-11-01T16:40:31.5922833Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-11-01T16:40:31.5923310Z TEST_SHOWLOCALS=False 2024-11-01T16:40:31.5923635Z GITHUB_WORKFLOW=pull 2024-11-01T16:40:31.5923979Z DEBIAN_FRONTEND=noninteractive 2024-11-01T16:40:31.5924931Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.5925792Z NO_TD=False 2024-11-01T16:40:31.5926088Z SKIP_SCCACHE_INITIALIZATION=1 2024-11-01T16:40:31.5926448Z _=/usr/bin/env 2024-11-01T16:40:31.5926927Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-11-01T16:40:31.6146194Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch 2024-11-01T16:40:31.6147811Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2024-11-01T16:40:31.6148795Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib 2024-11-01T16:40:31.6149727Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test 2024-11-01T16:40:31.6150351Z + BUILD_DIR=build 2024-11-01T16:40:31.6150740Z + BUILD_RENAMED_DIR=build_renamed 2024-11-01T16:40:31.6151150Z + BUILD_BIN_DIR=build/bin 2024-11-01T16:40:31.6151740Z + SHARD_NUMBER=2 2024-11-01T16:40:31.6152032Z + NUM_TEST_SHARDS=2 2024-11-01T16:40:31.6152361Z + export VALGRIND=ON 2024-11-01T16:40:31.6152667Z + VALGRIND=ON 2024-11-01T16:40:31.6153061Z + [[ linux-jammy-py3.9-gcc11 == *clang9* ]] 2024-11-01T16:40:31.6153471Z + [[ 0 == \1 ]] 2024-11-01T16:40:31.6153754Z + [[ False == \1 ]] 2024-11-01T16:40:31.6154178Z + [[ linux-jammy-py3.9-gcc11 != *bazel* ]] 2024-11-01T16:40:31.6154636Z ++ realpath build/custom_test_artifacts 2024-11-01T16:40:31.6205982Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-11-01T16:40:31.6206761Z + [[ -n '' ]] 2024-11-01T16:40:31.6207102Z + echo 'Environment variables' 2024-11-01T16:40:31.6207493Z Environment variables 2024-11-01T16:40:31.6207799Z + env 2024-11-01T16:40:31.6213863Z INSTALLED_DB=yes 2024-11-01T16:40:31.6214822Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T16:40:31.6215763Z CONTINUE_THROUGH_ERROR=False 2024-11-01T16:40:31.6216642Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11 2024-11-01T16:40:31.6217459Z HOSTNAME=7afe1bd6a4a7 2024-11-01T16:40:31.6218808Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.6219937Z GITHUB_ACTION=__self 2024-11-01T16:40:31.6220290Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-11-01T16:40:31.6220669Z GITHUB_RUN_NUMBER=261361 2024-11-01T16:40:31.6221009Z TEST_CONFIG=distributed 2024-11-01T16:40:31.6221535Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-11-01T16:40:31.6222405Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-11-01T16:40:31.6223176Z IS_A100_RUNNER=0 2024-11-01T16:40:31.6224701Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-11-01T16:40:31.6225392Z GITHUB_TRIGGERING_ACTOR=c00w 2024-11-01T16:40:31.6225763Z GITHUB_REF_TYPE=branch 2024-11-01T16:40:31.6226098Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-11-01T16:40:31.6226529Z BASE_SHA=2055d3c8dc8b93c52eda6b9c07d716448d9e28c9 2024-11-01T16:40:31.6226975Z XLA_CUDA= 2024-11-01T16:40:31.6227446Z HUGGING_FACE_HUB_TOKEN=*** 2024-11-01T16:40:31.6227825Z *** 2024-11-01T16:40:31.6228090Z GITHUB_REPOSITORY_ID=65600975 2024-11-01T16:40:31.6228590Z GITHUB_ACTIONS=true 2024-11-01T16:40:31.6228962Z SHA1=d1aa4ef5a6c0ee2d57fb0086f5557e34537f0fea 2024-11-01T16:40:31.6229473Z GITHUB_SHA=368da7510f5d755034681777a4e5ae6d33c07b38 2024-11-01T16:40:31.6230198Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/138766/merge 2024-11-01T16:40:31.6230843Z UCC_HOME=/usr 2024-11-01T16:40:31.6231117Z VERBOSE_TEST_LOGS=False 2024-11-01T16:40:31.6231464Z GITHUB_REF=refs/pull/138766/merge 2024-11-01T16:40:31.6231835Z SHARD_NUMBER=2 2024-11-01T16:40:31.6232160Z GITHUB_REF_PROTECTED=false 2024-11-01T16:40:31.6232502Z HOME=/var/lib/jenkins 2024-11-01T16:40:31.6232843Z GITHUB_API_URL=https://api.github.com 2024-11-01T16:40:31.6233276Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-11-01T16:40:31.6233873Z UCX_COMMIT= 2024-11-01T16:40:31.6234158Z SCCACHE_S3_KEY_PREFIX=pull 2024-11-01T16:40:31.6234501Z NUM_TEST_SHARDS=2 2024-11-01T16:40:31.6234790Z UCX_HOME=/usr 2024-11-01T16:40:31.6235695Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.6236942Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-11-01T16:40:31.6238102Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.6239282Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-11-01T16:40:31.6239960Z GITHUB_EVENT_NAME=pull_request 2024-11-01T16:40:31.6240307Z DASHBOARD_TAG= 2024-11-01T16:40:31.6240596Z GITHUB_RUN_ID=11632514903 2024-11-01T16:40:31.6241583Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.6242478Z GITHUB_ACTOR=c00w 2024-11-01T16:40:31.6242774Z PR_NUMBER=138766 2024-11-01T16:40:31.6243062Z DESIRED_CUDA= 2024-11-01T16:40:31.6243451Z GITHUB_RUN_ATTEMPT=1 2024-11-01T16:40:31.6243758Z VALGRIND=ON 2024-11-01T16:40:31.6244042Z ANACONDA_PYTHON_VERSION=3.9 2024-11-01T16:40:31.6244484Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-11-01T16:40:31.6244945Z TERM=vt100 2024-11-01T16:40:31.6245200Z INSTALLED_VISION=yes 2024-11-01T16:40:31.6245514Z BRANCH=pull/138766 2024-11-01T16:40:31.6245860Z SCCACHE_REGION=us-east-1 2024-11-01T16:40:31.6246207Z OPENSSL_ROOT_DIR=/opt/openssl 2024-11-01T16:40:31.6246571Z CUDA_PATH=/usr/local/cuda 2024-11-01T16:40:31.6247343Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-11-01T16:40:31.6248123Z GITHUB_SERVER_URL=https://github.com 2024-11-01T16:40:31.6248516Z UCC_COMMIT= 2024-11-01T16:40:31.6248783Z REENABLED_ISSUES= 2024-11-01T16:40:31.6249066Z DOCS=yes 2024-11-01T16:40:31.6249319Z INSTALLED_ANDROID= 2024-11-01T16:40:31.6249604Z SHLVL=1 2024-11-01T16:40:31.6249850Z MAX_JOBS=6 2024-11-01T16:40:31.6250118Z GITHUB_ACTOR_ID=486199 2024-11-01T16:40:31.6250561Z GITHUB_WORKFLOW_SHA=368da7510f5d755034681777a4e5ae6d33c07b38 2024-11-01T16:40:31.6251059Z GITHUB_REF_NAME=138766/merge 2024-11-01T16:40:31.6251677Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-11-01T16:40:31.6252261Z GITHUB_JOB=test 2024-11-01T16:40:31.6252553Z NO_TEST_TIMEOUT=False 2024-11-01T16:40:31.6252887Z TD_DISTRIBUTED=False 2024-11-01T16:40:31.6253210Z GITHUB_REPOSITORY=pytorch/pytorch 2024-11-01T16:40:31.6253602Z GITHUB_RETENTION_DAYS=90 2024-11-01T16:40:31.6253940Z OPENSSL_DIR=/opt/openssl 2024-11-01T16:40:31.6254280Z GITHUB_ACTION_REPOSITORY= 2024-11-01T16:40:31.6255348Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-11-01T16:40:31.6256473Z GITHUB_BASE_REF=gh/c00w/2/base 2024-11-01T16:40:31.6256826Z INSTALLED_ACL= 2024-11-01T16:40:31.6257372Z ARTIFACTS_FILE_SUFFIX=test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T16:40:31.6257938Z CI=true 2024-11-01T16:40:31.6258211Z GITHUB_REPOSITORY_OWNER=pytorch 2024-11-01T16:40:31.6258578Z JOB_ID=32396543967 2024-11-01T16:40:31.6258864Z INSTALLED_PROTOBUF=yes 2024-11-01T16:40:31.6259480Z GITHUB_HEAD_REF=gh/c00w/2/head 2024-11-01T16:40:31.6259840Z GITHUB_ACTION_REF= 2024-11-01T16:40:31.6260292Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-11-01T16:40:31.6260761Z TEST_SHOWLOCALS=False 2024-11-01T16:40:31.6261066Z GITHUB_WORKFLOW=pull 2024-11-01T16:40:31.6261398Z DEBIAN_FRONTEND=noninteractive 2024-11-01T16:40:31.6262353Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_7b0abdff-4ad1-45d1-923a-c1f4848dd2a1 2024-11-01T16:40:31.6263205Z NO_TD=False 2024-11-01T16:40:31.6263499Z SKIP_SCCACHE_INITIALIZATION=1 2024-11-01T16:40:31.6263843Z _=/usr/bin/env 2024-11-01T16:40:31.6264336Z + echo 'Testing pytorch' 2024-11-01T16:40:31.6264675Z Testing pytorch 2024-11-01T16:40:31.6264989Z + export LANG=C.UTF-8 2024-11-01T16:40:31.6265327Z + LANG=C.UTF-8 2024-11-01T16:40:31.6349382Z + PR_NUMBER=138766 2024-11-01T16:40:31.6350002Z + [[ distributed == \d\e\f\a\u\l\t ]] 2024-11-01T16:40:31.6350814Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-11-01T16:40:31.6351738Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-11-01T16:40:31.6352420Z + [[ distributed == \s\l\o\w ]] 2024-11-01T16:40:31.6353279Z + [[ linux-jammy-py3.9-gcc11 == *slow-gradcheck* ]] 2024-11-01T16:40:31.6353984Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]] 2024-11-01T16:40:31.6354493Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-11-01T16:40:31.6354996Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]] 2024-11-01T16:40:31.6355430Z + [[ distributed == *crossref* ]] 2024-11-01T16:40:31.6355893Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-11-01T16:40:31.6356401Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]] 2024-11-01T16:40:31.6356912Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]] 2024-11-01T16:40:31.6357412Z + pip_install --user ninja==1.10.2 2024-11-01T16:40:31.6357953Z + pip install --progress-bar off --user ninja==1.10.2 2024-11-01T16:40:32.1800815Z Collecting ninja==1.10.2 2024-11-01T16:40:32.1916183Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-11-01T16:40:32.2155276Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-11-01T16:40:32.7456831Z Installing collected packages: ninja 2024-11-01T16:40:32.7554950Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-11-01T16:40:32.7556309Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-11-01T16:40:32.8034694Z Successfully installed ninja-1.10.2 2024-11-01T16:40:32.8921855Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-11-01T16:40:32.8924143Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-11-01T16:40:32.8925699Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]] 2024-11-01T16:40:32.8926155Z + install_tlparse 2024-11-01T16:40:32.8926522Z + pip_install --user tlparse==0.3.25 2024-11-01T16:40:32.8927087Z + pip install --progress-bar off --user tlparse==0.3.25 2024-11-01T16:40:33.3461092Z Collecting tlparse==0.3.25 2024-11-01T16:40:33.3559799Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-11-01T16:40:33.4056337Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-11-01T16:40:33.9846426Z Installing collected packages: tlparse 2024-11-01T16:40:34.0602420Z Successfully installed tlparse-0.3.25 2024-11-01T16:40:34.1393199Z ++ python -m site --user-base 2024-11-01T16:40:34.1768737Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-11-01T16:40:34.1770498Z + [[ linux-jammy-py3.9-gcc11 == *asan* ]] 2024-11-01T16:40:34.1771054Z + [[ linux-jammy-py3.9-gcc11 == *-debug* ]] 2024-11-01T16:40:34.1771796Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]] 2024-11-01T16:40:34.1772688Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass' 2024-11-01T16:40:34.1773830Z We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass 2024-11-01T16:40:34.1774502Z + cd test 2024-11-01T16:40:34.1775073Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-11-01T16:40:36.1240430Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-11-01T16:40:36.1241426Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-11-01T16:40:36.1243124Z + DYNAMO_BENCHMARK_FLAGS=() 2024-11-01T16:40:36.1243979Z + [[ distributed == *pr_time_benchmarks* ]] 2024-11-01T16:40:36.1244838Z + [[ distributed == *dynamo_eager* ]] 2024-11-01T16:40:36.1245653Z + [[ distributed == *aot_eager* ]] 2024-11-01T16:40:36.1246142Z + [[ distributed == *aot_inductor* ]] 2024-11-01T16:40:36.1246564Z + [[ distributed == *inductor* ]] 2024-11-01T16:40:36.1246964Z + [[ distributed == *dynamic* ]] 2024-11-01T16:40:36.1247339Z + [[ distributed == *cpu* ]] 2024-11-01T16:40:36.1247985Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-11-01T16:40:36.1266821Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]] 2024-11-01T16:40:36.1267438Z + [[ linux-jammy-py3.9-gcc11 == *-bazel-* ]] 2024-11-01T16:40:36.1270559Z + cd test 2024-11-01T16:40:36.1271420Z + python -c 'import torch; print(torch.__config__.show())' 2024-11-01T16:40:37.4268965Z PyTorch built with: 2024-11-01T16:40:37.4269664Z - GCC 11.4 2024-11-01T16:40:37.4270024Z - C++ Version: 201703 2024-11-01T16:40:37.4270970Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-11-01T16:40:37.4272479Z - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-11-01T16:40:37.4273174Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-11-01T16:40:37.4273700Z - LAPACK is enabled (usually provided by MKL) 2024-11-01T16:40:37.4274191Z - NNPACK is enabled 2024-11-01T16:40:37.4274576Z - CPU capability usage: AVX512 2024-11-01T16:40:37.4282136Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-11-01T16:40:37.4289023Z 2024-11-01T16:40:37.6796200Z + cd test 2024-11-01T16:40:37.6796960Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-11-01T16:40:38.9785682Z ATen/Parallel: 2024-11-01T16:40:38.9786377Z at::get_num_threads() : 4 2024-11-01T16:40:38.9786787Z at::get_num_interop_threads() : 4 2024-11-01T16:40:38.9787199Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-11-01T16:40:38.9787611Z omp_get_max_threads() : 4 2024-11-01T16:40:38.9788755Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-11-01T16:40:38.9789586Z mkl_get_max_threads() : 4 2024-11-01T16:40:38.9790226Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-11-01T16:40:38.9790872Z std::thread::hardware_concurrency() : 8 2024-11-01T16:40:38.9791297Z Environment variables: 2024-11-01T16:40:38.9791637Z OMP_NUM_THREADS : [not set] 2024-11-01T16:40:38.9792009Z MKL_NUM_THREADS : [not set] 2024-11-01T16:40:38.9792370Z ATen parallel backend: OpenMP 2024-11-01T16:40:38.9792640Z 2024-11-01T16:40:39.2344090Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]] 2024-11-01T16:40:39.2344621Z + [[ distributed == *backward* ]] 2024-11-01T16:40:39.2345050Z + [[ distributed == *xla* ]] 2024-11-01T16:40:39.2345704Z + [[ distributed == *executorch* ]] 2024-11-01T16:40:39.2346127Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]] 2024-11-01T16:40:39.2346699Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]] 2024-11-01T16:40:39.2347165Z + [[ distributed == distributed ]] 2024-11-01T16:40:39.2347557Z + test_distributed 2024-11-01T16:40:39.2347958Z + echo 'Testing distributed python tests' 2024-11-01T16:40:39.2348396Z Testing distributed python tests 2024-11-01T16:40:39.2349128Z + python test/run_test.py --distributed-tests --shard 2 2 --verbose 2024-11-01T16:40:39.3605203Z /var/lib/jenkins/workspace/test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-11-01T16:40:39.3606396Z import pkg_resources 2024-11-01T16:40:45.2071657Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-11-01T16:40:45.2490531Z Ignoring disabled issues: [''] 2024-11-01T16:40:45.2788205Z Found test times from artifacts 2024-11-01T16:40:45.3319009Z Found test times from artifacts 2024-11-01T16:40:45.3343398Z Running all tests 2024-11-01T16:40:45.3500866Z Running parallel tests on 3 processes 2024-11-01T16:40:45.3506477Z Name: tests to run (est. time: 67.81min) 2024-11-01T16:40:45.3507653Z Serial tests (78): 2024-11-01T16:40:45.3508529Z distributed/test_dynamo_distributed 1/1 2024-11-01T16:40:45.3509422Z distributed/_tools/test_mem_tracker 1/1 2024-11-01T16:40:45.3510357Z distributed/_composable/test_contract 1/1 2024-11-01T16:40:45.3511414Z distributed/fsdp/test_fsdp_fx 1/1 2024-11-01T16:40:45.3512134Z distributed/test_symmetric_memory 1/1 2024-11-01T16:40:45.3512601Z distributed/_tensor/test_dtensor 1/1 2024-11-01T16:40:45.3513070Z distributed/_tensor/test_dtensor_ops 1/1 2024-11-01T16:40:45.3513634Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 2024-11-01T16:40:45.3514216Z distributed/optim/test_named_optimizer 1/1 2024-11-01T16:40:45.3514753Z distributed/checkpoint/test_fsdp_optim_state 1/1 2024-11-01T16:40:45.3515334Z distributed/_tensor/debug/test_comm_mode_features 1/1 2024-11-01T16:40:45.3515878Z distributed/_tensor/test_random_ops 1/1 2024-11-01T16:40:45.3516419Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 2024-11-01T16:40:45.3517007Z distributed/_tensor/experimental/test_local_map 1/1 2024-11-01T16:40:45.3517588Z distributed/_tensor/experimental/test_tp_transform 1/1 2024-11-01T16:40:45.3518158Z distributed/checkpoint/e2e/test_fine_tuning 1/1 2024-11-01T16:40:45.3518685Z distributed/_tensor/test_pointwise_ops 1/1 2024-11-01T16:40:45.3519194Z distributed/checkpoint/e2e/test_pipeline 1/1 2024-11-01T16:40:45.3519748Z distributed/checkpoint/test_dtensor_checkpoint 1/1 2024-11-01T16:40:45.3520292Z distributed/checkpoint/test_compatibility 1/1 2024-11-01T16:40:45.3520842Z distributed/tensor/parallel/test_tp_examples 1/1 2024-11-01T16:40:45.3521428Z distributed/tensor/parallel/test_tp_random_state 1/1 2024-11-01T16:40:45.3521968Z distributed/_tensor/test_embedding_ops 1/1 2024-11-01T16:40:45.3522536Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 2024-11-01T16:40:45.3523124Z distributed/checkpoint/test_state_dict_utils 1/1 2024-11-01T16:40:45.3523661Z distributed/checkpoint/test_hsdp_checkpoint 1/1 2024-11-01T16:40:45.3524179Z distributed/checkpoint/test_planner 1/1 2024-11-01T16:40:45.3524721Z distributed/_composable/fsdp/test_fully_shard_init 1/1 2024-11-01T16:40:45.3525408Z distributed/_composable/test_composability/test_pp_composability 1/1 2024-11-01T16:40:45.3526131Z distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1 2024-11-01T16:40:45.3526711Z distributed/_tensor/test_op_strategy 1/1 2024-11-01T16:40:45.3527185Z distributed/test_control_collectives 1/1 2024-11-01T16:40:45.3527645Z distributed/launcher/test_run 1/1 2024-11-01T16:40:45.3528461Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 2024-11-01T16:40:45.3529072Z distributed/pipelining/test_schedule 1/1 2024-11-01T16:40:45.3529668Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 2024-11-01T16:40:45.3530241Z distributed/fsdp/test_shard_utils 1/1 2024-11-01T16:40:45.3530724Z distributed/fsdp/test_fsdp_optim_state 1/1 2024-11-01T16:40:45.3531415Z distributed/_tensor/test_utils 1/1 2024-11-01T16:40:45.3532044Z distributed/test_nccl 1/1 2024-11-01T16:40:45.3532778Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 2024-11-01T16:40:45.3533674Z distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 2024-11-01T16:40:45.3534507Z distributed/checkpoint/test_checkpoint 1/1 2024-11-01T16:40:45.3535497Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 2024-11-01T16:40:45.3536511Z distributed/_composable/test_replicate 1/1 2024-11-01T16:40:45.3537289Z distributed/test_distributed_spawn 1/1 2024-11-01T16:40:45.3538127Z distributed/fsdp/test_fsdp_tp_integration 1/1 2024-11-01T16:40:45.3539008Z distributed/_composable/test_composability/test_2d_composability 1/1 2024-11-01T16:40:45.3539639Z distributed/test_c10d_object_collectives 1/1 2024-11-01T16:40:45.3540340Z distributed/nn/jit/test_instantiator 1/1 2024-11-01T16:40:45.3540890Z distributed/_composable/fsdp/test_fully_shard_comm 1/1 2024-11-01T16:40:45.3541412Z distributed/fsdp/test_utils 1/1 2024-11-01T16:40:45.3541867Z distributed/fsdp/test_fsdp_exec_order 1/1 2024-11-01T16:40:45.3542439Z distributed/_composable/fsdp/test_fully_shard_training 1/1 2024-11-01T16:40:45.3543432Z distributed/algorithms/quantization/test_quantization 1/1 2024-11-01T16:40:45.3544339Z distributed/test_multi_threaded_pg 1/1 2024-11-01T16:40:45.3545317Z distributed/_composable/fully_shard/test_fully_shard_runtime 1/1 2024-11-01T16:40:45.3546296Z distributed/fsdp/test_fsdp_input 1/1 2024-11-01T16:40:45.3547232Z distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 2024-11-01T16:40:45.3547819Z distributed/fsdp/test_fsdp_core 1/1 2024-11-01T16:40:45.3548323Z distributed/fsdp/test_fsdp_multiple_wrapping 1/1 2024-11-01T16:40:45.3548934Z distributed/test_pg_wrapper 1/1 2024-11-01T16:40:45.3549355Z distributed/test_c10d_common 1/1 2024-11-01T16:40:45.3549811Z distributed/fsdp/test_fsdp_comm_hooks 1/1 2024-11-01T16:40:45.3550302Z distributed/fsdp/test_fsdp_fine_tune 1/1 2024-11-01T16:40:45.3550955Z distributed/test_data_parallel 1/1 2024-11-01T16:40:45.3551810Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 2024-11-01T16:40:45.3552750Z distributed/fsdp/test_fsdp_meta 1/1 2024-11-01T16:40:45.3553516Z distributed/fsdp/test_fsdp_unshard_params 1/1 2024-11-01T16:40:45.3554466Z distributed/rpc/cuda/test_tensorpipe_agent 1/1 2024-11-01T16:40:45.3555329Z distributed/rpc/test_tensorpipe_agent 2/4 2024-11-01T16:40:45.3556129Z distributed/rpc/test_tensorpipe_agent 4/4 2024-11-01T16:40:45.3556960Z distributed/fsdp/test_distributed_checkpoint 1/1 2024-11-01T16:40:45.3557819Z distributed/test_c10d_ucc 1/1 2024-11-01T16:40:45.3558620Z distributed/_shard/sharded_tensor/ops/test_embedding 1/1 2024-11-01T16:40:45.3559528Z distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 2024-11-01T16:40:45.3560213Z distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 2024-11-01T16:40:45.3560790Z distributed/test_c10d_gloo 1/1 2024-11-01T16:40:45.3561185Z Parallel tests (0): 2024-11-01T16:40:45.3561535Z Name: excluded (est. time: 0.0min) 2024-11-01T16:40:45.3561926Z Serial tests (0): 2024-11-01T16:40:45.3562228Z Parallel tests (0): 2024-11-01T16:40:45.3840059Z Running distributed/test_dynamo_distributed 1/1 ... [2024-11-01 16:40:45.383484] 2024-11-01T16:40:45.3840767Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:40:45.3850515Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_dynamo_distributed.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:40:45.384423] 2024-11-01T16:41:27.1763482Z 2024-11-01T16:41:27.1765198Z distributed/test_dynamo_distributed 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_dynamo_distributed_1.1_f4bada9ef9154ba9_.log 2024-11-01T16:41:27.1796087Z Running 56 items in this shard: test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_call_method_forward, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_issue90375, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_symbol_splitting, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_direct, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_indirect, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_no_binding, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_torture_multi, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_asymmetric_compilation, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_asymmetric_compilation_with_fx_cache, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_scalar, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_speculation_divergence, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_tensor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_dim_mismatch, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_graph_break_empty_graph_still_collective, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_missing_source, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_scalar_missing_source, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_type_mismatch, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_baseline_aot_eager_multiprocess, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_setattr, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_unspecialized_forced_getattr_inline, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_unspecialized_forced_getattr_no_inline, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_aot_autograd, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_async_subclass_no_specialize, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_compiled_flex_attention_full_model_ddp, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_compiled_flex_attention_local_ddp, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_custom_layer, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_aot_eager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_empty_graph_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_diff_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_same_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_orig_params_assert, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_guards, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_register_attr_or_module, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_staticmethod, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_ctx_manager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_inference, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_training, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_transpose, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_higher_order_op, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ignored_parameters, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_no_split 2024-11-01T16:41:27.1825118Z 2024-11-01T16:41:27.1825633Z Running distributed/_tools/test_mem_tracker 1/1 ... [2024-11-01 16:41:27.176771] 2024-11-01T16:41:27.1826287Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:41:27.1828068Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:41:27.177317] 2024-11-01T16:41:31.6581036Z 2024-11-01T16:41:31.6582884Z distributed/_tools/test_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mem_tracker_1.1_e0414b32e8a3b16e_.log 2024-11-01T16:41:31.6586046Z Running 3 items in this shard: test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_cuda_tracker_equivalence, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_attribution, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_with_activation_checkpointing 2024-11-01T16:41:31.6587786Z 2024-11-01T16:41:31.6590869Z Running distributed/_composable/test_contract 1/1 ... [2024-11-01 16:41:31.658847] 2024-11-01T16:41:31.6591544Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:41:31.6596803Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_contract.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:41:31.659384] 2024-11-01T16:41:35.9375710Z 2024-11-01T16:41:35.9378502Z distributed/_composable/test_contract 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_contract_1.1_76b5499738930dfe_.log 2024-11-01T16:41:35.9384691Z Running 5 items in this shard: test/distributed/_composable/test_contract.py::TestContract::test_add_hooks, test/distributed/_composable/test_contract.py::TestContract::test_modify_fqn, test/distributed/_composable/test_contract.py::TestContract::test_multi_module_api, test/distributed/_composable/test_contract.py::TestContract::test_registry, test/distributed/_composable/test_contract.py::TestContract::test_state 2024-11-01T16:41:35.9388937Z 2024-11-01T16:41:35.9389754Z Running distributed/fsdp/test_fsdp_fx 1/1 ... [2024-11-01 16:41:35.938344] 2024-11-01T16:41:35.9390780Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:41:35.9393897Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fx.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:41:35.938976] 2024-11-01T16:41:40.2174395Z 2024-11-01T16:41:40.2176267Z distributed/fsdp/test_fsdp_fx 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_d2b369e0690d1d0d_.log 2024-11-01T16:41:40.2178061Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_fx.py::TestSymbolicTracing::test_symbolic_tracing_outputs 2024-11-01T16:41:40.2178868Z 2024-11-01T16:41:40.2183316Z Running distributed/test_symmetric_memory 1/1 ... [2024-11-01 16:41:40.218070] 2024-11-01T16:41:40.2184023Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:41:40.2188772Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_symmetric_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:41:40.218554] 2024-11-01T16:41:44.3971538Z 2024-11-01T16:41:44.3973377Z distributed/test_symmetric_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_symmetric_memory_1.1_f67a39d05562ed1b_.log 2024-11-01T16:41:44.4051169Z Running 103 items in this shard: test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_barrier_timeout, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_cuda_nvlink_connectivity_detection, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_empty_strided_p2p, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_empty_strided_p2p_persistent, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_gather_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_gather_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_row-wise-replicated, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_row-wise-sharded, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_tensor-wise, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_row-wise-replicated, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_row-wise-sharded, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_tensor-wise, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_matmul_reduce_scatter_scatter_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_matmul_reduce_scatter_scatter_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_0_rowwise_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_0_rowwise_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_1_rowwise_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_1_rowwise_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_all_gather_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_all_gather_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_avg_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_avg_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_sum_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_sum_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_2, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_put_signal_timeout, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_stream_write_value, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_wait_signal_timeout, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::LoweringTest::test_lowering_one_shot_all_reduce 2024-11-01T16:41:44.4118670Z 2024-11-01T16:41:44.4119236Z Running distributed/_tensor/test_dtensor 1/1 ... [2024-11-01 16:41:44.397910] 2024-11-01T16:41:44.4119859Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:41:44.4121639Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:41:44.398404] 2024-11-01T16:44:33.0122887Z 2024-11-01T16:44:33.0124559Z distributed/_tensor/test_dtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_1.1_c187f4d958aaf6bc_.log 2024-11-01T16:44:33.0141787Z Running 33 items in this shard: test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_async_output, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_constructor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_new_empty_strided, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_properties, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_save_load, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_hash, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_read_only_after_set, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_stride, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_negative_dim, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_then_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding_raise_error, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_sync, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_modules_w_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_auto_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_default_value_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_device_mesh_nd, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_2d_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_api_device_mesh_context_manager, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_device_mesh_device_conversion, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_spec_local_shard_offset, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_from_local_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_implicit_replication_for_foreach_ops, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_metadata_consistency_check, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_redistribute_sub_mesh, test/distributed/_tensor/test_dtensor.py::TestDTensorPlacementTypes::test_split_tensor_1D, test/distributed/_tensor/test_dtensor.py::DTensorLogTest::test_dtensor_log 2024-11-01T16:44:33.0156962Z 2024-11-01T16:44:33.0157473Z Running distributed/_tensor/test_dtensor_ops 1/1 ... [2024-11-01 16:44:33.013000] 2024-11-01T16:44:33.0158124Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:44:33.0160176Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:44:33.013530] 2024-11-01T16:47:23.3776333Z 2024-11-01T16:47:23.3778280Z distributed/_tensor/test_dtensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_ops_1.1_f3d7f34250884438_.log 2024-11-01T16:47:23.4580523Z Running 670 items in this shard: test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_H_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_T_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___getitem___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___radd___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rdiv___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmatmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmod___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rpow___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rsub___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__batch_norm_with_update_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__chunk_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__native_batch_norm_legit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_lengths_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_offsets_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__softmax_backward_data_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_put_accumulate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__upsample_bilinear2d_aa_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_abs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcdiv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_decomposed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_alias_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_all_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_allclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_aminmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_angle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_any_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_arange_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argsort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argwhere_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_partial_views_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_baddbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bernoulli_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bfloat16_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_block_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bool_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_shapes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bucketize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_byte_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cartesian_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cauchy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdouble_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ceil_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cfloat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chalf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_char_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_inverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_max_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_min_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clone_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_column_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_combinations_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_physical_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_constant_pad_nd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_contiguous_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_copysign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_corrcoef_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_count_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cov_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumulative_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_deg2rad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_embed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagflat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diff_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_digamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_floor_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_no_rounding_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_trunc_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_double_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_einsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_permuted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_equal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expm1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eye_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flip_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fliplr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flipud_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gather_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ge_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geometric_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geqrf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gradient_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_grid_sampler_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_half_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_heaviside_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogram_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogramdd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hypot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igammac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_inner_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_int_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isfinite_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isnan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isneginf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isposinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isreal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_item_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_2inputs_2outputs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_4inputs_with_extra_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_return_by_ref_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_unary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kron_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kthvalue_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ldexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_le_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lerp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lgamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cond_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eig_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvalsh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_householder_product_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_grad_oriented_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_multi_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_subgradients_at_zero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_slogdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_triangular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svdvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorsolve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vander_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vecdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vector_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log10_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log1p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logcumsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_and_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_not_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_or_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_xor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_long_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_unpack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mH_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mT_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matrix_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_pool2d_with_indices_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_maximum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_list_of_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_variadic_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_minimum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_movedim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_msort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_multinomial_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_5_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nan_to_num_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmedian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanquantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nansum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_dropout_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ne_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nextafter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_alpha_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_with_logits_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_celu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_channel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_similarity_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_ctc_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_elu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_bag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_with_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_without_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gaussian_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_glu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_grid_sample_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_group_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardswish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardtanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hinge_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_huber_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_instance_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_area_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bicubic_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest-exact_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_trilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_kl_div_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_leaky_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_local_response_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_logsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_margin_ranking_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mse_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_head_attention_forward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_circular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_constant_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_reflect_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_negative_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pairwise_distance_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_unshuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_poisson_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_prelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu6_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rms_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rrelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_scaled_dot_product_attention_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_selu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_silu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_smooth_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softplus_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softsign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_tanhshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_threshold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_with_distance_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_static_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_fro_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_inf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_nuc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_in_place_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_number_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ormqr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_outer_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pca_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_permute_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_permute_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pinverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polar_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_4_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_positive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_quantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rad2deg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rand_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ravel_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_real_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reciprocal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_remainder_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_renorm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_interleave_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize_as__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_roll_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rot90_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_neg_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scalar_tensor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_searchsorted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sgn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_short_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_bartlett_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_blackman_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_gaussian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hann_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_kaiser_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_nuttall_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signbit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_mm_reduce_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_sampled_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_airy_ai_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_entr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_erfcx_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_h_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_he_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i0e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_laguerre_polynomial_l_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_legendre_polynomial_p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_log_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtri_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_polygamma_special_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_spherical_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_xlog1py_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_zeta_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_list_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_square_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_multiple_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_to_size_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_along_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensor_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensordot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_sparse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_topk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_torch_ops_aten__safe_softmax_default_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_transpose_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_transpose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapz_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triangular_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tril_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_true_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trunc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unbind_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unflatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_uniform_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_consecutive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_where_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_xlogy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zero__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_like_cpu_float32 2024-11-01T16:47:23.5115632Z 2024-11-01T16:47:23.5141306Z Running distributed/_composable/fsdp/test_fully_shard_logging 1/1 ... [2024-11-01 16:47:23.513721] 2024-11-01T16:47:23.5142101Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:47:23.5146147Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_logging.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:47:23.514257] 2024-11-01T16:47:27.5946455Z 2024-11-01T16:47:27.5949174Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_5a977a98e6246c04_.log 2024-11-01T16:47:27.5950649Z Running 0 items in this shard: 2024-11-01T16:47:27.5950920Z 2024-11-01T16:47:27.5955557Z Running distributed/optim/test_named_optimizer 1/1 ... [2024-11-01 16:47:27.595271] 2024-11-01T16:47:27.5956256Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:47:27.5961149Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/optim/test_named_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:47:27.595782] 2024-11-01T16:47:30.5911708Z 2024-11-01T16:47:30.5913480Z distributed/optim/test_named_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_named_optimizer_1.1_e1bb06832bf8ef40_.log 2024-11-01T16:47:30.5914638Z 2024-11-01T16:47:30.5919766Z Running distributed/checkpoint/test_fsdp_optim_state 1/1 ... [2024-11-01 16:47:30.591779] 2024-11-01T16:47:30.5920487Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:47:30.5926342Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:47:30.592327] 2024-11-01T16:47:39.4805919Z 2024-11-01T16:47:39.4808251Z distributed/checkpoint/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_ca37e489bab03362_.log 2024-11-01T16:47:39.4810397Z Running 1 items in this shard: test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict 2024-11-01T16:47:39.4811412Z 2024-11-01T16:47:39.4815036Z Running distributed/_tensor/debug/test_comm_mode_features 1/1 ... [2024-11-01 16:47:39.481211] 2024-11-01T16:47:39.4815838Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:47:39.4821189Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode_features.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:47:39.481762] 2024-11-01T16:48:00.6467645Z 2024-11-01T16:48:00.6470104Z distributed/_tensor/debug/test_comm_mode_features 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_c7643e894c061912_.log 2024-11-01T16:48:00.6474471Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLPStacked_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_module_tracing, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_transformer_module_tracing 2024-11-01T16:48:00.6477362Z 2024-11-01T16:48:00.6477875Z Running distributed/_tensor/test_random_ops 1/1 ... [2024-11-01 16:48:00.647357] 2024-11-01T16:48:00.6478895Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:48:00.6481780Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_random_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:48:00.647886] 2024-11-01T16:48:34.7397912Z 2024-11-01T16:48:34.7399757Z distributed/_tensor/test_random_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_random_ops_1.1_fef8be5448004a7f_.log 2024-11-01T16:48:34.7404812Z Running 7 items in this shard: test/distributed/_tensor/test_random_ops.py::DistTensorRandomInitTest::test_init_ops, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_dropout_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_rand_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_uniform_2d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_manual_seed, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_meta_tensor_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_rng_tracker_init 2024-11-01T16:48:34.7408964Z 2024-11-01T16:48:34.7409551Z Running distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 ... [2024-11-01 16:48:34.740408] 2024-11-01T16:48:34.7410394Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:48:34.7412771Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_e2e_save_and_load.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:48:34.740927] 2024-11-01T16:49:17.3510336Z 2024-11-01T16:49:17.3512494Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_d3c4273ea61b9697_.log 2024-11-01T16:49:17.3518805Z Running 9 items in this shard: test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_different_ordered_state_dict_keys, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_async_cached, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_no_dist, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_overwrite, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_partial_load, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_stateful_and_non_stateful_loads, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestNoCPU::test_no_cpu, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestInitStateDict::test_init_state_dict 2024-11-01T16:49:17.3524204Z 2024-11-01T16:49:17.3524818Z Running distributed/_tensor/experimental/test_local_map 1/1 ... [2024-11-01 16:49:17.351801] 2024-11-01T16:49:17.3525542Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:49:17.3545436Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_local_map.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:49:17.352283] 2024-11-01T16:49:38.0564043Z 2024-11-01T16:49:38.0566149Z distributed/_tensor/experimental/test_local_map 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_local_map_1.1_824cd285319aaa06_.log 2024-11-01T16:49:38.0570598Z Running 4 items in this shard: test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_correctness, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_in_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_out_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_redistribute 2024-11-01T16:49:38.0573460Z 2024-11-01T16:49:38.0574025Z Running distributed/_tensor/experimental/test_tp_transform 1/1 ... [2024-11-01 16:49:38.056982] 2024-11-01T16:49:38.0574755Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:49:38.0577669Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_tp_transform.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:49:38.057479] 2024-11-01T16:49:54.9622003Z 2024-11-01T16:49:54.9624865Z distributed/_tensor/experimental/test_tp_transform 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_tp_transform_1.1_b9c520459eb8bd5c_.log 2024-11-01T16:49:54.9628454Z Running 3 items in this shard: test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_e2e, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_no_bias, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_with_uncovered_op 2024-11-01T16:49:54.9631247Z 2024-11-01T16:49:54.9632871Z Running distributed/checkpoint/e2e/test_fine_tuning 1/1 ... [2024-11-01 16:49:54.963011] 2024-11-01T16:49:54.9633647Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:49:54.9639254Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fine_tuning.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:49:54.963614] 2024-11-01T16:49:59.2436385Z 2024-11-01T16:49:59.2438623Z distributed/checkpoint/e2e/test_fine_tuning 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fine_tuning_1.1_36a29344b62860d9_.log 2024-11-01T16:49:59.2440441Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fine_tuning.py::TestFineTuning::test_fine_tuning 2024-11-01T16:49:59.2441174Z 2024-11-01T16:49:59.2445421Z Running distributed/_tensor/test_pointwise_ops 1/1 ... [2024-11-01 16:49:59.244306] 2024-11-01T16:49:59.2446152Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:49:59.2450646Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_pointwise_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:49:59.244776] 2024-11-01T16:50:03.7735446Z 2024-11-01T16:50:03.7737531Z distributed/_tensor/test_pointwise_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_pointwise_ops_1.1_86f9f573d6135262_.log 2024-11-01T16:50:03.7742385Z Running 7 items in this shard: test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_activations, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_backward, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_errors, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_mul_out, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_add, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_mul 2024-11-01T16:50:03.7746311Z 2024-11-01T16:50:03.7746804Z Running distributed/checkpoint/e2e/test_pipeline 1/1 ... [2024-11-01 16:50:03.774222] 2024-11-01T16:50:03.7747492Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:03.7750443Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_pipeline.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:03.774728] 2024-11-01T16:50:08.0025330Z 2024-11-01T16:50:08.0028473Z distributed/checkpoint/e2e/test_pipeline 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_pipeline_1.1_940324b6a1e676fc_.log 2024-11-01T16:50:08.0031780Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_pipeline.py::TestPipeline::test_pipeline 2024-11-01T16:50:08.0033017Z 2024-11-01T16:50:08.0035876Z Running distributed/checkpoint/test_dtensor_checkpoint 1/1 ... [2024-11-01 16:50:08.003319] 2024-11-01T16:50:08.0037009Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:08.0043892Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:08.003948] 2024-11-01T16:50:16.6425822Z 2024-11-01T16:50:16.6427759Z distributed/checkpoint/test_dtensor_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_checkpoint_1.1_6cc6ce8a5c0480fc_.log 2024-11-01T16:50:16.6429940Z Running 1 items in this shard: test/distributed/checkpoint/test_dtensor_checkpoint.py::DTensorPlanner::test_distributed_tensor_planner 2024-11-01T16:50:16.6430852Z 2024-11-01T16:50:16.6434021Z Running distributed/checkpoint/test_compatibility 1/1 ... [2024-11-01 16:50:16.643181] 2024-11-01T16:50:16.6434780Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:16.6440256Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_compatibility.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:16.643688] 2024-11-01T16:50:21.1223024Z 2024-11-01T16:50:21.1225160Z distributed/checkpoint/test_compatibility 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_compatibility_1.1_db2114e55ea358b0_.log 2024-11-01T16:50:21.1228605Z Running 4 items in this shard: test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_metadata, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_sharded_tensor_dependency, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_storage_meta, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_with_v_2_3 2024-11-01T16:50:21.1231121Z 2024-11-01T16:50:21.1232288Z Running distributed/tensor/parallel/test_tp_examples 1/1 ... [2024-11-01 16:50:21.122972] 2024-11-01T16:50:21.1233026Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:21.1238172Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_examples.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:21.123479] 2024-11-01T16:50:50.6553628Z 2024-11-01T16:50:50.6555629Z distributed/tensor/parallel/test_tp_examples 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_8f6c7ca987ae2dc9_.log 2024-11-01T16:50:50.6561392Z Running 6 items in this shard: test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_loss_parallel, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_inference, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_weight_tying 2024-11-01T16:50:50.6565354Z 2024-11-01T16:50:50.6565906Z Running distributed/tensor/parallel/test_tp_random_state 1/1 ... [2024-11-01 16:50:50.656079] 2024-11-01T16:50:50.6566706Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:50.6569018Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_random_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:50.656617] 2024-11-01T16:50:59.1440858Z 2024-11-01T16:50:59.1442911Z distributed/tensor/parallel/test_tp_random_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_64ea4d378979f3ee_.log 2024-11-01T16:50:59.1444940Z Running 1 items in this shard: test/distributed/tensor/parallel/test_tp_random_state.py::TensorParallelRandomStateTests::test_model_init 2024-11-01T16:50:59.1446154Z 2024-11-01T16:50:59.1448799Z Running distributed/_tensor/test_embedding_ops 1/1 ... [2024-11-01 16:50:59.144667] 2024-11-01T16:50:59.1449471Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:50:59.1454568Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_embedding_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:50:59.145161] 2024-11-01T16:51:20.4152738Z 2024-11-01T16:51:20.4155482Z distributed/_tensor/test_embedding_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_embedding_ops_1.1_ab0aa5d948be47e0_.log 2024-11-01T16:51:20.4161738Z Running 4 items in this shard: test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_multiple_embeddings_rowwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise_max_norm_errors, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_rowwise 2024-11-01T16:51:20.4166000Z 2024-11-01T16:51:20.4166934Z Running distributed/_composable/fsdp/test_fully_shard_memory 1/1 ... [2024-11-01 16:51:20.416105] 2024-11-01T16:51:20.4168132Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:20.4171403Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:20.416716] 2024-11-01T16:51:24.7453073Z 2024-11-01T16:51:24.7455167Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_3db2390d83c5843a_.log 2024-11-01T16:51:24.7457222Z Running 1 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_memory.py::TestFullyShardMemory::test_fully_shard_training_memory 2024-11-01T16:51:24.7458113Z 2024-11-01T16:51:24.7461271Z Running distributed/checkpoint/test_state_dict_utils 1/1 ... [2024-11-01 16:51:24.745864] 2024-11-01T16:51:24.7461977Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:24.7467046Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_state_dict_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:24.746396] 2024-11-01T16:51:29.1751125Z 2024-11-01T16:51:29.1752867Z distributed/checkpoint/test_state_dict_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_utils_1.1_4f1c12ddc1c7a94b_.log 2024-11-01T16:51:29.1757563Z Running 6 items in this shard: test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_complicated_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_cpu_and_ranks_only, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_create_cpu_state_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_state_dict_dtensor, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_with_cpu_and_ranks_only, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_state_dict_util_distribute_tensors 2024-11-01T16:51:29.1761592Z 2024-11-01T16:51:29.1762133Z Running distributed/checkpoint/test_hsdp_checkpoint 1/1 ... [2024-11-01 16:51:29.175728] 2024-11-01T16:51:29.1762894Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:29.1765536Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_hsdp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:29.176246] 2024-11-01T16:51:42.3725792Z 2024-11-01T16:51:42.3728042Z distributed/checkpoint/test_hsdp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_hsdp_checkpoint_1.1_7cf8ec42d0070472_.log 2024-11-01T16:51:42.3730510Z Running 2 items in this shard: test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_checkpoint, test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_fsdp_checkpoint_conversion 2024-11-01T16:51:42.3732240Z 2024-11-01T16:51:42.3732811Z Running distributed/checkpoint/test_planner 1/1 ... [2024-11-01 16:51:42.373061] 2024-11-01T16:51:42.3733474Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:42.3738605Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_planner.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:42.373560] 2024-11-01T16:51:46.8016803Z 2024-11-01T16:51:46.8018847Z distributed/checkpoint/test_planner 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_planner_1.1_810c84a37f07fda3_.log 2024-11-01T16:51:46.8023271Z Running 7 items in this shard: test/distributed/checkpoint/test_planner.py::TestSavePlan::test_global_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_resharding, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_world_size_diff_by_one, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_load_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_plan, test/distributed/checkpoint/test_planner.py::TestPlannerHelpers::test_create_read_item_from_chunks, test/distributed/checkpoint/test_planner.py::TestLoadPlanner::test_strict 2024-11-01T16:51:46.8026978Z 2024-11-01T16:51:46.8027522Z Running distributed/_composable/fsdp/test_fully_shard_init 1/1 ... [2024-11-01 16:51:46.802280] 2024-11-01T16:51:46.8028245Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:46.8030961Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:46.802793] 2024-11-01T16:51:51.1309927Z 2024-11-01T16:51:51.1312286Z distributed/_composable/fsdp/test_fully_shard_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_init_1.1_ad7a5fa7c76c01df_.log 2024-11-01T16:51:51.1339457Z Running 37 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceTensor::test_move_states_to_device_tensor, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_invalid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_valid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMeshArg::test_2d_mesh_without_mesh_dim_names, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMeshArg::test_invalid_mesh_ndim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_duplicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested_fully_shard_and_replicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_single, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_nested_fully_shard, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_shared_params_and_buffers, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_duplicates, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_shared_params, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_raise_noncontiguous_parameter, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_raise_scalar_parameter, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_shard_tensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterDTensor::test_shard_dtensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_double_lazy_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_is_root, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_module_and_param_fqns, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_multi_module_root, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_reset_sharded_param_in_lazy_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_invalid_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_1d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_2d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_rank0_broadcast_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_1d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_2d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardHSDPBroadcast::test_hsdp_broadcast_across_replicas, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_transformer_shard_dim_neg1, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_transformer_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_uneven_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_2d_transformer_shard_diff_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_invalid_shard_dim 2024-11-01T16:51:51.1365305Z 2024-11-01T16:51:51.1365991Z Running distributed/_composable/test_composability/test_pp_composability 1/1 ... [2024-11-01 16:51:51.131720] 2024-11-01T16:51:51.1366803Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:51.1368762Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_composability/test_pp_composability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:51.132244] 2024-11-01T16:51:55.4604286Z 2024-11-01T16:51:55.4607327Z distributed/_composable/test_composability/test_pp_composability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_composability.test_pp_composability_1.1_f4945c7c71e491db_.log 2024-11-01T16:51:55.4629737Z Running 20 items in this shard: test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass0_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass0_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass1_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass1_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass2_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass2_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass3_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass3_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass4_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass4_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass0_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass0_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass1_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass1_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass2_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass2_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass3_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass3_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass4_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass4_use_new_runtime_True 2024-11-01T16:51:55.4648026Z 2024-11-01T16:51:55.4648765Z Running distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1 ... [2024-11-01 16:51:55.461123] 2024-11-01T16:51:55.4649526Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:51:55.4651434Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_grad_scaler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:51:55.461708] 2024-11-01T16:52:03.7459934Z 2024-11-01T16:52:03.7462092Z distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_grad_scaler_1.1_379f652b65c27e24_.log 2024-11-01T16:52:03.7464277Z Running 1 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_grad_scaler.py::TestFullyShardGradientScaler::test_gradient_scaler 2024-11-01T16:52:03.7465185Z 2024-11-01T16:52:03.7468078Z Running distributed/_tensor/test_op_strategy 1/1 ... [2024-11-01 16:52:03.746596] 2024-11-01T16:52:03.7468793Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:52:03.7474424Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_op_strategy.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:52:03.747121] 2024-11-01T16:52:08.3260703Z 2024-11-01T16:52:08.3262746Z distributed/_tensor/test_op_strategy 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_op_strategy_1.1_d86226642140fc12_.log 2024-11-01T16:52:08.3271284Z Running 15 items in this shard: test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_batch_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_bmm_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_free_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_mm_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_bmm_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_bmm_2d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_linearity_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_mm_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_mm_2d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_pointwise_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_bmm_strategies, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_mm_strategies, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_latency, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_mesh_1d, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_mesh_2d 2024-11-01T16:52:08.3279577Z 2024-11-01T16:52:08.3280077Z Running distributed/test_control_collectives 1/1 ... [2024-11-01 16:52:08.327009] 2024-11-01T16:52:08.3280722Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:52:08.3282512Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_control_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:52:08.327677] 2024-11-01T16:52:12.6568118Z 2024-11-01T16:52:12.6570761Z distributed/test_control_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_control_collectives_1.1_006c87823ab829a9_.log 2024-11-01T16:52:12.6582934Z Running 13 items in this shard: test/distributed/test_control_collectives.py::TestCollectives::test_all_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_barrier, test/distributed/test_control_collectives.py::TestCollectives::test_barrier_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_gather, test/distributed/test_control_collectives.py::TestCollectives::test_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_scatter, test/distributed/test_control_collectives.py::TestCollectives::test_scatter_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_simple_user_func, test/distributed/test_control_collectives.py::TestCollectives::test_unique 2024-11-01T16:52:12.6593385Z 2024-11-01T16:52:12.6594156Z Running distributed/launcher/test_run 1/1 ... [2024-11-01 16:52:12.657503] 2024-11-01T16:52:12.6595215Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:52:12.6597822Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/launcher/test_run.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:52:12.658118] 2024-11-01T16:52:59.2575826Z 2024-11-01T16:52:59.2577622Z distributed/launcher/test_run 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.launcher.test_run_1.1_b94e687eff4ee4d8_.log 2024-11-01T16:52:59.2593364Z Running 24 items in this shard: test/distributed/launcher/test_run.py::ElasticLaunchTest::test_capture_logs_using_default_logs_specs, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_init_method_env_with_torchelastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_init_method_tcp_with_torchelastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_not_torchelastic_launched, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_torchelastic_launched, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_torchelastic_launched_with_logs_spec_defined, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_agent_raise_exception, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_multiple_agents, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_worker_raise_exception, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_run_path, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_shutdown, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_standalone, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_bash, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_default_nproc, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_python, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_python_caffe2_bc, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_with_env_vars, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_logs_logs_spec_entrypoint_must_be_defined, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_min_max_nodes_parse, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_gpu_launch_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_auto_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_number_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_unknown_configurations 2024-11-01T16:52:59.2606078Z 2024-11-01T16:52:59.2606760Z Running distributed/_composable/fully_shard/test_fully_shard_compile 1/1 ... [2024-11-01 16:52:59.258673] 2024-11-01T16:52:59.2607723Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:52:59.2609675Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:52:59.259207] 2024-11-01T16:53:03.3871989Z 2024-11-01T16:53:03.3874755Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_3bfee3b2da9c0054_.log 2024-11-01T16:53:03.3876778Z Running 1 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_compile.py::TestCompile::test_compile 2024-11-01T16:53:03.3877552Z 2024-11-01T16:53:03.3881606Z Running distributed/pipelining/test_schedule 1/1 ... [2024-11-01 16:53:03.387849] 2024-11-01T16:53:03.3882339Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:53:03.3886814Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_schedule.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:53:03.388363] 2024-11-01T16:54:02.8481493Z 2024-11-01T16:54:02.8485537Z distributed/pipelining/test_schedule 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_schedule_1.1_22d8eab70f18a8ad_.log 2024-11-01T16:54:02.8503063Z Running 25 items in this shard: test/distributed/pipelining/test_schedule.py::ScheduleTest::test_get_schedule_class, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass0, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass1, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass2, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass3, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass4, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass1, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_flex_and_zero_bubble_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_flex_and_zero_bubble_ScheduleClass1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref2, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref3, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref4, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref5, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref6, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref7, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_csv_csv_name_zb1p_2rank_2stagep, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_grad_with_split_b_w, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_grad_with_v_schedule, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_merge_bw_test_info0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_send_recv_test_info0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_send_recv_test_info1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_unshard_reshard_test_info0 2024-11-01T16:54:02.8518795Z 2024-11-01T16:54:02.8519538Z Running distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 ... [2024-11-01 16:54:02.848853] 2024-11-01T16:54:02.8520375Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:54:02.8522374Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:54:02.849379] 2024-11-01T16:54:11.4868868Z 2024-11-01T16:54:11.4871011Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_684d199090f9fb77_.log 2024-11-01T16:54:11.4873393Z Running 1 items in this shard: test/distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py::TestFsdpTpCheckpointConversion::test_fsdp_to_tp 2024-11-01T16:54:11.4874388Z 2024-11-01T16:54:11.4878017Z Running distributed/fsdp/test_shard_utils 1/1 ... [2024-11-01 16:54:11.487584] 2024-11-01T16:54:11.4878724Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:54:11.4884647Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_shard_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:54:11.488166] 2024-11-01T16:54:23.9329388Z 2024-11-01T16:54:23.9332017Z distributed/fsdp/test_shard_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_shard_utils_1.1_ea699aa4e56c6994_.log 2024-11-01T16:54:23.9336415Z Running 2 items in this shard: test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributed::test_create_chunk_sharded_tensor, test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributedDTensor::test_create_chunk_dtensor 2024-11-01T16:54:23.9338901Z 2024-11-01T16:54:23.9339744Z Running distributed/fsdp/test_fsdp_optim_state 1/1 ... [2024-11-01 16:54:23.933696] 2024-11-01T16:54:23.9340882Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:54:23.9347464Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:54:23.934307] 2024-11-01T16:58:42.4911436Z 2024-11-01T16:58:42.4914082Z distributed/fsdp/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_ad650748823b71a2_.log 2024-11-01T16:58:42.4964041Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_compatible_with_trec, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_nested, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_keys, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_nested_invalid, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_interface_arguments, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_no_grad, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_input_warning, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_without_param_groups, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_names, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type0, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type1, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_state_dict_with_none_tensor_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_use_orig_params, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_empty_optimizer_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_no_shard 2024-11-01T16:58:42.5011518Z 2024-11-01T16:58:42.5012102Z Running distributed/_tensor/test_utils 1/1 ... [2024-11-01 16:58:42.492005] 2024-11-01T16:58:42.5012725Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:58:42.5014613Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:58:42.492554] 2024-11-01T16:59:39.6854706Z 2024-11-01T16:59:39.6857317Z distributed/_tensor/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_utils_1.1_1033248a6d1ae017_.log 2024-11-01T16:59:39.6868574Z Running 10 items in this shard: test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_1D, test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_2D, test/distributed/_tensor/test_utils.py::UtilTest::test_fsdp_tp_meta_compute, test/distributed/_tensor/test_utils.py::UtilTest::test_hsdp_tp_meta_compute, test/distributed/_tensor/test_utils.py::UtilTest::test_strided_sharding_assumption_in_meta_compute, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_1d_mesh_strided_sharding, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_2d_mesh_2d_tensor_strided_sharding, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_2d_mesh_strided_sharding, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp1_tp_2d_dtensor_local_shards_and_offsets, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp2_tp_2d_dtensor_local_shards_and_offsets 2024-11-01T16:59:39.6877178Z 2024-11-01T16:59:39.6877916Z Running distributed/test_nccl 1/1 ... [2024-11-01 16:59:39.686286] 2024-11-01T16:59:39.6878934Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:59:39.6881340Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:59:39.686914] 2024-11-01T16:59:43.9099711Z 2024-11-01T16:59:43.9102032Z distributed/test_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_nccl_1.1_9bb554eef355bf48_.log 2024-11-01T16:59:43.9104040Z Running 0 items in this shard: 2024-11-01T16:59:43.9104505Z 2024-11-01T16:59:43.9109213Z Running distributed/fsdp/test_fsdp_backward_prefetch 1/1 ... [2024-11-01 16:59:43.910650] 2024-11-01T16:59:43.9110228Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:59:43.9115025Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_backward_prefetch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:59:43.911172] 2024-11-01T16:59:52.1953713Z 2024-11-01T16:59:52.1955809Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_707d18ada0feb8d1_.log 2024-11-01T16:59:52.1957857Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_backward_prefetch.py::TestBackwardPrefetch::test_backward_prefetch 2024-11-01T16:59:52.1958730Z 2024-11-01T16:59:52.1961539Z Running distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 ... [2024-11-01 16:59:52.195923] 2024-11-01T16:59:52.1962290Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T16:59:52.1966967Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 16:59:52.196395] 2024-11-01T17:00:17.8708593Z 2024-11-01T17:00:17.8710499Z distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_dtensor_state_dict_1.1_0a56d4ce62e6de2a_.log 2024-11-01T17:00:17.8716115Z Running 5 items in this shard: test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_fsdp_init_with_device_mesh, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_raises_warning_or_errors 2024-11-01T17:00:17.8720451Z 2024-11-01T17:00:17.8721020Z Running distributed/checkpoint/test_checkpoint 1/1 ... [2024-11-01 17:00:17.871521] 2024-11-01T17:00:17.8721769Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:00:17.8723897Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:00:17.872073] 2024-11-01T17:00:30.8224626Z 2024-11-01T17:00:30.8227209Z distributed/checkpoint/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_checkpoint_1.1_7a1a467687b414e1_.log 2024-11-01T17:00:30.8234167Z Running 8 items in this shard: test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_default_metadata, test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_tensor_metadata_with_missing_rank_spec, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_reader_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_writer_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling_no_dist, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling_no_dist 2024-11-01T17:00:30.8239024Z 2024-11-01T17:00:30.8239654Z Running distributed/_composable/fsdp/test_fully_shard_autograd 1/1 ... [2024-11-01 17:00:30.823159] 2024-11-01T17:00:30.8241164Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:00:30.8243138Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:00:30.823702] 2024-11-01T17:00:35.1521747Z 2024-11-01T17:00:35.1523956Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_e1551cb3a1a2b8b5_.log 2024-11-01T17:00:35.1528927Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_nontensor_activations, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_module, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_output, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiThread::test_post_acc_grad_hook_runs, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiProcess::test_post_acc_grad_hook_optim_parity 2024-11-01T17:00:35.1532947Z 2024-11-01T17:00:35.1533499Z Running distributed/_composable/test_replicate 1/1 ... [2024-11-01 17:00:35.152778] 2024-11-01T17:00:35.1534261Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:00:35.1536135Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_replicate.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:00:35.153293] 2024-11-01T17:01:49.9062286Z 2024-11-01T17:01:49.9064010Z distributed/_composable/test_replicate 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_replicate_1.1_80a7870f45ae8f0f_.log 2024-11-01T17:01:49.9074814Z Running 17 items in this shard: test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_non_root_multiple_save_load, test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_single_module_save_load, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_device_id, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_ignore_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_move_args_kwargs_to_device, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_multi_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_single_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_with_kwargs, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_wrong_device_id_type, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_device_id, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_fully_shard_init, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_ignore_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_move_args_kwargs_to_device, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_multi_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_single_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_with_kwargs, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_wrong_device_id_type 2024-11-01T17:01:49.9084412Z 2024-11-01T17:01:49.9084863Z Running distributed/test_distributed_spawn 1/1 ... [2024-11-01 17:01:49.906853] 2024-11-01T17:01:49.9153566Z MPI not available -- MPI backend tests will be skipped 2024-11-01T17:01:49.9154576Z Running distributed tests for the test backend with env init_method 2024-11-01T17:01:49.9157736Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:01:49.9164298Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:01:49.916137] 2024-11-01T17:01:54.1760040Z 2024-11-01T17:01:54.1761685Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_e21267dcae444fe2_.log 2024-11-01T17:01:54.1762913Z Running 0 items in this shard: 2024-11-01T17:01:54.1763176Z 2024-11-01T17:01:54.1773897Z Running distributed tests for the test backend with file init_method 2024-11-01T17:01:54.1775229Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:01:54.1780826Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:01:54.177786] 2024-11-01T17:01:58.4655478Z 2024-11-01T17:01:58.4657308Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_75a5c032756d8383_.log 2024-11-01T17:01:58.4658528Z Running 0 items in this shard: 2024-11-01T17:01:58.4658832Z 2024-11-01T17:01:58.4666829Z Running distributed tests for the gloo backend with env init_method 2024-11-01T17:01:58.4668864Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:01:58.4674513Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:01:58.467135] 2024-11-01T17:23:22.5789049Z 2024-11-01T17:23:22.5791774Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_3e130e68ca397cf0_.log 2024-11-01T17:23:22.6030384Z Running 278 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-11-01T17:23:22.6186096Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager 2024-11-01T17:23:22.6187870Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager 2024-11-01T17:23:22.6189384Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class 2024-11-01T17:23:22.6190793Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel 2024-11-01T17:23:22.6192245Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU 2024-11-01T17:23:22.6193790Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view 2024-11-01T17:23:22.6195575Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm 2024-11-01T17:23:22.6197208Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input 2024-11-01T17:23:22.6198898Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last 2024-11-01T17:23:22.6200699Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value 2024-11-01T17:23:22.6202560Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient 2024-11-01T17:23:22.6204314Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine 2024-11-01T17:23:22.6206066Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process 2024-11-01T17:23:22.6207881Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half 2024-11-01T17:23:22.6209502Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream 2024-11-01T17:23:22.6211098Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad 2024-11-01T17:23:22.6212734Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view 2024-11-01T17:23:22.6214313Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding 2024-11-01T17:23:22.6215781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group 2024-11-01T17:23:22.6217244Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync 2024-11-01T17:23:22.6218783Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook 2024-11-01T17:23:22.6220435Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook 2024-11-01T17:23:22.6222081Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view 2024-11-01T17:23:22.6223505Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather 2024-11-01T17:23:22.6224882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex 2024-11-01T17:23:22.6226347Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group 2024-11-01T17:23:22.6227812Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group 2024-11-01T17:23:22.6229323Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple 2024-11-01T17:23:22.6230788Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty 2024-11-01T17:23:22.6232261Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex 2024-11-01T17:23:22.6233600Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda 2024-11-01T17:23:22.6234973Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex 2024-11-01T17:23:22.6236361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group 2024-11-01T17:23:22.6237725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group 2024-11-01T17:23:22.6239133Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda 2024-11-01T17:23:22.6240637Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda 2024-11-01T17:23:22.6242124Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg 2024-11-01T17:23:22.6243633Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup 2024-11-01T17:23:22.6245013Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda 2024-11-01T17:23:22.6246447Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max 2024-11-01T17:23:22.6247978Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min 2024-11-01T17:23:22.6249521Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product 2024-11-01T17:23:22.6251066Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum 2024-11-01T17:23:22.6252576Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max 2024-11-01T17:23:22.6254065Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min 2024-11-01T17:23:22.6255563Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product 2024-11-01T17:23:22.6257050Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum 2024-11-01T17:23:22.6258503Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max 2024-11-01T17:23:22.6260263Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported 2024-11-01T17:23:22.6261788Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min 2024-11-01T17:23:22.6263239Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product 2024-11-01T17:23:22.6264664Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum 2024-11-01T17:23:22.6266132Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops 2024-11-01T17:23:22.6267611Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max 2024-11-01T17:23:22.6269218Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min 2024-11-01T17:23:22.6270652Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product 2024-11-01T17:23:22.6272100Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum 2024-11-01T17:23:22.6273507Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max 2024-11-01T17:23:22.6274887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min 2024-11-01T17:23:22.6276294Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product 2024-11-01T17:23:22.6277692Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum 2024-11-01T17:23:22.6279037Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max 2024-11-01T17:23:22.6280428Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min 2024-11-01T17:23:22.6281744Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product 2024-11-01T17:23:22.6283076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum 2024-11-01T17:23:22.6284417Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async 2024-11-01T17:23:22.6285794Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex 2024-11-01T17:23:22.6287178Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda 2024-11-01T17:23:22.6288575Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async 2024-11-01T17:23:22.6290010Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex 2024-11-01T17:23:22.6291366Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all 2024-11-01T17:23:22.6292658Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex 2024-11-01T17:23:22.6293995Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda 2024-11-01T17:23:22.6295355Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex 2024-11-01T17:23:22.6296748Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group 2024-11-01T17:23:22.6298162Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda 2024-11-01T17:23:22.6299539Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group 2024-11-01T17:23:22.6300895Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda 2024-11-01T17:23:22.6302314Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split 2024-11-01T17:23:22.6303808Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex 2024-11-01T17:23:22.6305391Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda 2024-11-01T17:23:22.6306943Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex 2024-11-01T17:23:22.6308618Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group 2024-11-01T17:23:22.6310216Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda 2024-11-01T17:23:22.6311785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group 2024-11-01T17:23:22.6313333Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda 2024-11-01T17:23:22.6314870Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split 2024-11-01T17:23:22.6316466Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex 2024-11-01T17:23:22.6317996Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda 2024-11-01T17:23:22.6319571Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex 2024-11-01T17:23:22.6321167Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group 2024-11-01T17:23:22.6322778Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda 2024-11-01T17:23:22.6324380Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group 2024-11-01T17:23:22.6325954Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda 2024-11-01T17:23:22.6327433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters 2024-11-01T17:23:22.6328727Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier 2024-11-01T17:23:22.6329986Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda 2024-11-01T17:23:22.6331303Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group 2024-11-01T17:23:22.6332685Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda 2024-11-01T17:23:22.6334031Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group 2024-11-01T17:23:22.6335364Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda 2024-11-01T17:23:22.6336755Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group 2024-11-01T17:23:22.6338164Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global 2024-11-01T17:23:22.6339555Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group 2024-11-01T17:23:22.6340939Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo 2024-11-01T17:23:22.6342476Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags 2024-11-01T17:23:22.6343972Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err 2024-11-01T17:23:22.6345429Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl 2024-11-01T17:23:22.6346889Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl 2024-11-01T17:23:22.6348361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err 2024-11-01T17:23:22.6349882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err 2024-11-01T17:23:22.6351404Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl 2024-11-01T17:23:22.6352894Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl 2024-11-01T17:23:22.6354296Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast 2024-11-01T17:23:22.6355593Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda 2024-11-01T17:23:22.6356937Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group 2024-11-01T17:23:22.6358286Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group 2024-11-01T17:23:22.6359949Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list 2024-11-01T17:23:22.6361317Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager 2024-11-01T17:23:22.6362709Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async 2024-11-01T17:23:22.6364312Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger 2024-11-01T17:23:22.6366084Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger 2024-11-01T17:23:22.6367679Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward 2024-11-01T17:23:22.6369260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false 2024-11-01T17:23:22.6370905Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params 2024-11-01T17:23:22.6372396Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer 2024-11-01T17:23:22.6373827Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook 2024-11-01T17:23:22.6375280Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce 2024-11-01T17:23:22.6376781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future 2024-11-01T17:23:22.6378461Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping 2024-11-01T17:23:22.6380076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad 2024-11-01T17:23:22.6381607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging 2024-11-01T17:23:22.6383013Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph 2024-11-01T17:23:22.6384507Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks 2024-11-01T17:23:22.6386047Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks 2024-11-01T17:23:22.6387473Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph 2024-11-01T17:23:22.6388932Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device 2024-11-01T17:23:22.6390403Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization 2024-11-01T17:23:22.6391864Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook 2024-11-01T17:23:22.6393270Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs 2024-11-01T17:23:22.6394662Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized 2024-11-01T17:23:22.6396047Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce 2024-11-01T17:23:22.6397550Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group 2024-11-01T17:23:22.6399163Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD 2024-11-01T17:23:22.6400624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD 2024-11-01T17:23:22.6402052Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD 2024-11-01T17:23:22.6403464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg 2024-11-01T17:23:22.6404791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference 2024-11-01T17:23:22.6406216Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence 2024-11-01T17:23:22.6407653Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu 2024-11-01T17:23:22.6409033Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu 2024-11-01T17:23:22.6410516Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks 2024-11-01T17:23:22.6412058Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks 2024-11-01T17:23:22.6413703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params 2024-11-01T17:23:22.6415408Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error 2024-11-01T17:23:22.6416855Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple 2024-11-01T17:23:22.6418416Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none 2024-11-01T17:23:22.6420210Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none 2024-11-01T17:23:22.6421897Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params 2024-11-01T17:23:22.6423606Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none 2024-11-01T17:23:22.6425433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none 2024-11-01T17:23:22.6427093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd 2024-11-01T17:23:22.6428630Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph 2024-11-01T17:23:22.6430143Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler 2024-11-01T17:23:22.6431625Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace 2024-11-01T17:23:22.6433073Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler 2024-11-01T17:23:22.6434509Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged 2024-11-01T17:23:22.6435932Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks 2024-11-01T17:23:22.6437395Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad 2024-11-01T17:23:22.6438949Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params 2024-11-01T17:23:22.6440361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone 2024-11-01T17:23:22.6441772Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types 2024-11-01T17:23:22.6443236Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval 2024-11-01T17:23:22.6444660Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states 2024-11-01T17:23:22.6446064Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception 2024-11-01T17:23:22.6447520Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable 2024-11-01T17:23:22.6448925Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs 2024-11-01T17:23:22.6450386Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn 2024-11-01T17:23:22.6452052Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception 2024-11-01T17:23:22.6453566Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features 2024-11-01T17:23:22.6454957Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group 2024-11-01T17:23:22.6456284Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group 2024-11-01T17:23:22.6457663Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static 2024-11-01T17:23:22.6459315Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks 2024-11-01T17:23:22.6460771Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars 2024-11-01T17:23:22.6462115Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather 2024-11-01T17:23:22.6463387Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks 2024-11-01T17:23:22.6464811Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda 2024-11-01T17:23:22.6466124Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group 2024-11-01T17:23:22.6467443Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group 2024-11-01T17:23:22.6468797Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object 2024-11-01T17:23:22.6470148Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup 2024-11-01T17:23:22.6471489Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend 2024-11-01T17:23:22.6472847Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params 2024-11-01T17:23:22.6474192Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future 2024-11-01T17:23:22.6475447Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank 2024-11-01T17:23:22.6476782Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group 2024-11-01T17:23:22.6478167Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group 2024-11-01T17:23:22.6479611Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync 2024-11-01T17:23:22.6481064Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph 2024-11-01T17:23:22.6482365Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv 2024-11-01T17:23:22.6483576Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend 2024-11-01T17:23:22.6484893Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler 2024-11-01T17:23:22.6486292Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler 2024-11-01T17:23:22.6487729Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang 2024-11-01T17:23:22.6489390Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks 2024-11-01T17:23:22.6490942Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order 2024-11-01T17:23:22.6492386Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo 2024-11-01T17:23:22.6493867Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout 2024-11-01T17:23:22.6495389Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup 2024-11-01T17:23:22.6496888Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks 2024-11-01T17:23:22.6498371Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather 2024-11-01T17:23:22.6499810Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce 2024-11-01T17:23:22.6501304Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast 2024-11-01T17:23:22.6502734Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce 2024-11-01T17:23:22.6504151Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream 2024-11-01T17:23:22.6505566Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups 2024-11-01T17:23:22.6506948Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration 2024-11-01T17:23:22.6508633Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size 2024-11-01T17:23:22.6510356Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank 2024-11-01T17:23:22.6511990Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size 2024-11-01T17:23:22.6513554Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed 2024-11-01T17:23:22.6515164Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size 2024-11-01T17:23:22.6516768Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module 2024-11-01T17:23:22.6518268Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module 2024-11-01T17:23:22.6519733Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager 2024-11-01T17:23:22.6521202Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group 2024-11-01T17:23:22.6522714Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity 2024-11-01T17:23:22.6524256Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view 2024-11-01T17:23:22.6525978Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd 2024-11-01T17:23:22.6527752Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view 2024-11-01T17:23:22.6529436Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload 2024-11-01T17:23:22.6530894Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max 2024-11-01T17:23:22.6532264Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min 2024-11-01T17:23:22.6533670Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product 2024-11-01T17:23:22.6535082Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum 2024-11-01T17:23:22.6536448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max 2024-11-01T17:23:22.6537836Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min 2024-11-01T17:23:22.6539190Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product 2024-11-01T17:23:22.6540543Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum 2024-11-01T17:23:22.6541838Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max 2024-11-01T17:23:22.6543087Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min 2024-11-01T17:23:22.6544378Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product 2024-11-01T17:23:22.6545757Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda 2024-11-01T17:23:22.6547171Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda 2024-11-01T17:23:22.6548625Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum 2024-11-01T17:23:22.6549920Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda 2024-11-01T17:23:22.6551271Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice 2024-11-01T17:23:22.6552607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice 2024-11-01T17:23:22.6553887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter 2024-11-01T17:23:22.6555159Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks 2024-11-01T17:23:22.6556464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex 2024-11-01T17:23:22.6557764Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda 2024-11-01T17:23:22.6559281Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex 2024-11-01T17:23:22.6560645Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group 2024-11-01T17:23:22.6562087Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group 2024-11-01T17:23:22.6563418Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list 2024-11-01T17:23:22.6564738Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv 2024-11-01T17:23:22.6566056Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source 2024-11-01T17:23:22.6567520Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler 2024-11-01T17:23:22.6569064Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler 2024-11-01T17:23:22.6570546Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler 2024-11-01T17:23:22.6571925Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl 2024-11-01T17:23:22.6573333Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler 2024-11-01T17:23:22.6574899Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler 2024-11-01T17:23:22.6576323Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler 2024-11-01T17:23:22.6577706Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag 2024-11-01T17:23:22.6579153Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler 2024-11-01T17:23:22.6580688Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler 2024-11-01T17:23:22.6582131Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum 2024-11-01T17:23:22.6583560Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda 2024-11-01T17:23:22.6584968Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp 2024-11-01T17:23:22.6586349Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu 2024-11-01T17:23:22.6587742Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward 2024-11-01T17:23:22.6589173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-11-01T17:23:22.6590625Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters 2024-11-01T17:23:22.6592183Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-11-01T17:23:22.6593733Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-11-01T17:23:22.6594593Z 2024-11-01T17:23:22.6594901Z Running distributed tests for the gloo backend with file init_method 2024-11-01T17:23:22.6595489Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:23:22.6597576Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:23:22.591087] 2024-11-01T17:44:45.2420421Z 2024-11-01T17:44:45.2422028Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_6009667a1954d7cd_.log 2024-11-01T17:44:45.2623188Z Running 278 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-11-01T17:44:45.2779206Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager 2024-11-01T17:44:45.2780964Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager 2024-11-01T17:44:45.2782609Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class 2024-11-01T17:44:45.2784029Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel 2024-11-01T17:44:45.2785488Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU 2024-11-01T17:44:45.2787026Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view 2024-11-01T17:44:45.2788715Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm 2024-11-01T17:44:45.2790350Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input 2024-11-01T17:44:45.2792046Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last 2024-11-01T17:44:45.2793858Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value 2024-11-01T17:44:45.2795725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient 2024-11-01T17:44:45.2797474Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine 2024-11-01T17:44:45.2799229Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process 2024-11-01T17:44:45.2800963Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half 2024-11-01T17:44:45.2802584Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream 2024-11-01T17:44:45.2804189Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad 2024-11-01T17:44:45.2805816Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view 2024-11-01T17:44:45.2807374Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding 2024-11-01T17:44:45.2808952Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group 2024-11-01T17:44:45.2810425Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync 2024-11-01T17:44:45.2811964Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook 2024-11-01T17:44:45.2813637Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook 2024-11-01T17:44:45.2815277Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view 2024-11-01T17:44:45.2816704Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather 2024-11-01T17:44:45.2818076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex 2024-11-01T17:44:45.2819611Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group 2024-11-01T17:44:45.2821063Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group 2024-11-01T17:44:45.2822514Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple 2024-11-01T17:44:45.2823990Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty 2024-11-01T17:44:45.2825432Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex 2024-11-01T17:44:45.2826781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda 2024-11-01T17:44:45.2828160Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex 2024-11-01T17:44:45.2829629Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group 2024-11-01T17:44:45.2830992Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group 2024-11-01T17:44:45.2832510Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda 2024-11-01T17:44:45.2834012Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda 2024-11-01T17:44:45.2835498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg 2024-11-01T17:44:45.2836953Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup 2024-11-01T17:44:45.2838350Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda 2024-11-01T17:44:45.2839784Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max 2024-11-01T17:44:45.2841310Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min 2024-11-01T17:44:45.2842859Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product 2024-11-01T17:44:45.2844405Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum 2024-11-01T17:44:45.2845983Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max 2024-11-01T17:44:45.2847462Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min 2024-11-01T17:44:45.2848966Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product 2024-11-01T17:44:45.2850464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum 2024-11-01T17:44:45.2851916Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max 2024-11-01T17:44:45.2853450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported 2024-11-01T17:44:45.2854978Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min 2024-11-01T17:44:45.2856480Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product 2024-11-01T17:44:45.2857903Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum 2024-11-01T17:44:45.2859557Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops 2024-11-01T17:44:45.2861039Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max 2024-11-01T17:44:45.2862465Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min 2024-11-01T17:44:45.2863917Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product 2024-11-01T17:44:45.2865364Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum 2024-11-01T17:44:45.2866771Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max 2024-11-01T17:44:45.2868140Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min 2024-11-01T17:44:45.2869594Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product 2024-11-01T17:44:45.2870973Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum 2024-11-01T17:44:45.2872322Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max 2024-11-01T17:44:45.2873631Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min 2024-11-01T17:44:45.2874964Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product 2024-11-01T17:44:45.2876293Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum 2024-11-01T17:44:45.2877644Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async 2024-11-01T17:44:45.2879022Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex 2024-11-01T17:44:45.2880406Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda 2024-11-01T17:44:45.2881947Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async 2024-11-01T17:44:45.2883384Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex 2024-11-01T17:44:45.2884739Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all 2024-11-01T17:44:45.2886046Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex 2024-11-01T17:44:45.2887372Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda 2024-11-01T17:44:45.2888728Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex 2024-11-01T17:44:45.2890118Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group 2024-11-01T17:44:45.2891523Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda 2024-11-01T17:44:45.2892974Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group 2024-11-01T17:44:45.2894331Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda 2024-11-01T17:44:45.2895749Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split 2024-11-01T17:44:45.2897253Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex 2024-11-01T17:44:45.2898782Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda 2024-11-01T17:44:45.2900342Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex 2024-11-01T17:44:45.2901932Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group 2024-11-01T17:44:45.2903527Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda 2024-11-01T17:44:45.2905085Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group 2024-11-01T17:44:45.2906634Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda 2024-11-01T17:44:45.2908173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split 2024-11-01T17:44:45.2909762Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex 2024-11-01T17:44:45.2911309Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda 2024-11-01T17:44:45.2912873Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex 2024-11-01T17:44:45.2914468Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group 2024-11-01T17:44:45.2916081Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda 2024-11-01T17:44:45.2917673Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group 2024-11-01T17:44:45.2919303Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda 2024-11-01T17:44:45.2920767Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters 2024-11-01T17:44:45.2922066Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier 2024-11-01T17:44:45.2923330Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda 2024-11-01T17:44:45.2924651Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group 2024-11-01T17:44:45.2926026Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda 2024-11-01T17:44:45.2927386Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group 2024-11-01T17:44:45.2928714Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda 2024-11-01T17:44:45.2930258Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group 2024-11-01T17:44:45.2931662Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global 2024-11-01T17:44:45.2933048Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group 2024-11-01T17:44:45.2934432Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo 2024-11-01T17:44:45.2935841Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags 2024-11-01T17:44:45.2937333Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err 2024-11-01T17:44:45.2938802Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl 2024-11-01T17:44:45.2940260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl 2024-11-01T17:44:45.2941731Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err 2024-11-01T17:44:45.2943164Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err 2024-11-01T17:44:45.2944673Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl 2024-11-01T17:44:45.2946169Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl 2024-11-01T17:44:45.2947524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast 2024-11-01T17:44:45.2948869Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda 2024-11-01T17:44:45.2950229Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group 2024-11-01T17:44:45.2951580Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group 2024-11-01T17:44:45.2952930Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list 2024-11-01T17:44:45.2954346Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager 2024-11-01T17:44:45.2955733Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async 2024-11-01T17:44:45.2957335Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger 2024-11-01T17:44:45.2959536Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger 2024-11-01T17:44:45.2961233Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward 2024-11-01T17:44:45.2962818Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false 2024-11-01T17:44:45.2964484Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params 2024-11-01T17:44:45.2965971Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer 2024-11-01T17:44:45.2967574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook 2024-11-01T17:44:45.2969016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce 2024-11-01T17:44:45.2970525Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future 2024-11-01T17:44:45.2972100Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping 2024-11-01T17:44:45.2973730Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad 2024-11-01T17:44:45.2975267Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging 2024-11-01T17:44:45.2976676Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph 2024-11-01T17:44:45.2978165Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks 2024-11-01T17:44:45.2979715Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks 2024-11-01T17:44:45.2981144Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph 2024-11-01T17:44:45.2982426Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device 2024-11-01T17:44:45.2983808Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization 2024-11-01T17:44:45.2985282Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook 2024-11-01T17:44:45.2986720Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs 2024-11-01T17:44:45.2988111Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized 2024-11-01T17:44:45.2989584Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce 2024-11-01T17:44:45.2991079Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group 2024-11-01T17:44:45.2992693Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD 2024-11-01T17:44:45.2994139Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD 2024-11-01T17:44:45.2995577Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD 2024-11-01T17:44:45.2996991Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg 2024-11-01T17:44:45.2998345Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference 2024-11-01T17:44:45.2999714Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence 2024-11-01T17:44:45.3001126Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu 2024-11-01T17:44:45.3002499Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu 2024-11-01T17:44:45.3004037Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks 2024-11-01T17:44:45.3005555Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks 2024-11-01T17:44:45.3007149Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params 2024-11-01T17:44:45.3008785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error 2024-11-01T17:44:45.3010228Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple 2024-11-01T17:44:45.3011792Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none 2024-11-01T17:44:45.3013604Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none 2024-11-01T17:44:45.3015305Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params 2024-11-01T17:44:45.3017009Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none 2024-11-01T17:44:45.3018832Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none 2024-11-01T17:44:45.3020433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd 2024-11-01T17:44:45.3021886Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph 2024-11-01T17:44:45.3023397Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler 2024-11-01T17:44:45.3024881Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace 2024-11-01T17:44:45.3026347Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler 2024-11-01T17:44:45.3027785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged 2024-11-01T17:44:45.3029354Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks 2024-11-01T17:44:45.3030816Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad 2024-11-01T17:44:45.3032317Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params 2024-11-01T17:44:45.3033730Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone 2024-11-01T17:44:45.3035142Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types 2024-11-01T17:44:45.3036601Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval 2024-11-01T17:44:45.3038030Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states 2024-11-01T17:44:45.3039445Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception 2024-11-01T17:44:45.3040959Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable 2024-11-01T17:44:45.3042396Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs 2024-11-01T17:44:45.3043854Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn 2024-11-01T17:44:45.3045448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception 2024-11-01T17:44:45.3046950Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features 2024-11-01T17:44:45.3048401Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group 2024-11-01T17:44:45.3049742Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group 2024-11-01T17:44:45.3051134Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static 2024-11-01T17:44:45.3052603Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks 2024-11-01T17:44:45.3054059Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars 2024-11-01T17:44:45.3055391Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather 2024-11-01T17:44:45.3056667Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks 2024-11-01T17:44:45.3057948Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda 2024-11-01T17:44:45.3059463Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group 2024-11-01T17:44:45.3060785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group 2024-11-01T17:44:45.3062081Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object 2024-11-01T17:44:45.3063441Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup 2024-11-01T17:44:45.3064776Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend 2024-11-01T17:44:45.3066274Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params 2024-11-01T17:44:45.3067623Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future 2024-11-01T17:44:45.3069185Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank 2024-11-01T17:44:45.3070524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group 2024-11-01T17:44:45.3071926Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group 2024-11-01T17:44:45.3073383Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync 2024-11-01T17:44:45.3074850Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph 2024-11-01T17:44:45.3076159Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv 2024-11-01T17:44:45.3077518Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend 2024-11-01T17:44:45.3078834Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler 2024-11-01T17:44:45.3080215Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler 2024-11-01T17:44:45.3081668Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang 2024-11-01T17:44:45.3083246Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks 2024-11-01T17:44:45.3084814Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order 2024-11-01T17:44:45.3086265Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo 2024-11-01T17:44:45.3087741Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout 2024-11-01T17:44:45.3089259Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup 2024-11-01T17:44:45.3090749Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks 2024-11-01T17:44:45.3092208Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather 2024-11-01T17:44:45.3093661Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce 2024-11-01T17:44:45.3095104Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast 2024-11-01T17:44:45.3096533Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce 2024-11-01T17:44:45.3097960Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream 2024-11-01T17:44:45.3099324Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups 2024-11-01T17:44:45.3100703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration 2024-11-01T17:44:45.3102380Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size 2024-11-01T17:44:45.3104086Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank 2024-11-01T17:44:45.3105718Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size 2024-11-01T17:44:45.3107278Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed 2024-11-01T17:44:45.3108956Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size 2024-11-01T17:44:45.3110573Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module 2024-11-01T17:44:45.3112104Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module 2024-11-01T17:44:45.3113568Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager 2024-11-01T17:44:45.3115113Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group 2024-11-01T17:44:45.3116660Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity 2024-11-01T17:44:45.3118211Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view 2024-11-01T17:44:45.3119860Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd 2024-11-01T17:44:45.3121634Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view 2024-11-01T17:44:45.3123321Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload 2024-11-01T17:44:45.3124793Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max 2024-11-01T17:44:45.3126183Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min 2024-11-01T17:44:45.3127586Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product 2024-11-01T17:44:45.3128993Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum 2024-11-01T17:44:45.3130360Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max 2024-11-01T17:44:45.3131711Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min 2024-11-01T17:44:45.3133076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product 2024-11-01T17:44:45.3134429Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum 2024-11-01T17:44:45.3135725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max 2024-11-01T17:44:45.3136994Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min 2024-11-01T17:44:45.3138270Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product 2024-11-01T17:44:45.3139703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda 2024-11-01T17:44:45.3141121Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda 2024-11-01T17:44:45.3142440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum 2024-11-01T17:44:45.3143730Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda 2024-11-01T17:44:45.3145077Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice 2024-11-01T17:44:45.3146430Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice 2024-11-01T17:44:45.3147711Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter 2024-11-01T17:44:45.3149044Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks 2024-11-01T17:44:45.3150431Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex 2024-11-01T17:44:45.3151734Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda 2024-11-01T17:44:45.3153056Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex 2024-11-01T17:44:45.3154422Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group 2024-11-01T17:44:45.3155747Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group 2024-11-01T17:44:45.3157087Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list 2024-11-01T17:44:45.3158400Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv 2024-11-01T17:44:45.3159887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source 2024-11-01T17:44:45.3161358Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler 2024-11-01T17:44:45.3162905Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler 2024-11-01T17:44:45.3164379Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler 2024-11-01T17:44:45.3165753Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl 2024-11-01T17:44:45.3167167Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler 2024-11-01T17:44:45.3168653Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler 2024-11-01T17:44:45.3170135Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler 2024-11-01T17:44:45.3171520Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag 2024-11-01T17:44:45.3172970Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler 2024-11-01T17:44:45.3174490Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler 2024-11-01T17:44:45.3176065Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum 2024-11-01T17:44:45.3177470Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda 2024-11-01T17:44:45.3178960Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp 2024-11-01T17:44:45.3180353Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu 2024-11-01T17:44:45.3181768Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward 2024-11-01T17:44:45.3183134Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-11-01T17:44:45.3184613Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters 2024-11-01T17:44:45.3186167Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-11-01T17:44:45.3187791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-11-01T17:44:45.3188731Z 2024-11-01T17:44:45.3189391Z Running distributed/fsdp/test_fsdp_tp_integration 1/1 ... [2024-11-01 17:44:45.252730] 2024-11-01T17:44:45.3190077Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:44:45.3191901Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_tp_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:44:45.253193] 2024-11-01T17:45:01.6498691Z 2024-11-01T17:45:01.6500553Z distributed/fsdp/test_fsdp_tp_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_868a1d9a19c8ee79_.log 2024-11-01T17:45:01.6503540Z Running 3 items in this shard: test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_extension_grad, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_integration, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_sync_module_state 2024-11-01T17:45:01.6505594Z 2024-11-01T17:45:01.6506800Z Running distributed/_composable/test_composability/test_2d_composability 1/1 ... [2024-11-01 17:45:01.650450] 2024-11-01T17:45:01.6507599Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:45:01.6513212Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_composability/test_2d_composability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:45:01.650975] 2024-11-01T17:45:57.5890352Z 2024-11-01T17:45:57.5893743Z distributed/_composable/test_composability/test_2d_composability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_composability.test_2d_composability_1.1_fb0e6180bbf09474_.log 2024-11-01T17:45:57.5912440Z Running 17 items in this shard: test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_2d_uneven_shard_raise_error, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_tp_with_fsdp_offloading, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_mlp, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_transformer, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_transformer_checkpoint_resume, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DStateDict::test_fully_shard_tp_2d_set_full_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::Test2dFSDP1ParallelIntegration::test_2d_ddp_integration_functionality, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_default, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_not_use_orig_params, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_use_orig_params, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_fsdp_state_enable_extension, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_raise_invalid_tp_composition, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_load_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_optim_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_fsdp1_tp_2d_set_full_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_fsdp_2d_extension 2024-11-01T17:45:57.5925140Z 2024-11-01T17:45:57.5925743Z Running distributed/test_c10d_object_collectives 1/1 ... [2024-11-01 17:45:57.589856] 2024-11-01T17:45:57.5926413Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:45:57.5928230Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_object_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:45:57.590408] 2024-11-01T17:46:41.0030371Z 2024-11-01T17:46:41.0032079Z distributed/test_c10d_object_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_object_collectives_1.1_e29dc3faddaaa5c1_.log 2024-11-01T17:46:41.0038870Z Running 9 items in this shard: test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_broadcast_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_scatter_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_send_recv_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_broadcast_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_scatter_object 2024-11-01T17:46:41.0044289Z 2024-11-01T17:46:41.0044793Z Running distributed/nn/jit/test_instantiator 1/1 ... [2024-11-01 17:46:41.003635] 2024-11-01T17:46:41.0045514Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:46:41.0047500Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/nn/jit/test_instantiator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:46:41.004152] 2024-11-01T17:46:45.2823452Z 2024-11-01T17:46:45.2826091Z distributed/nn/jit/test_instantiator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.nn.jit.test_instantiator_1.1_398c5fe0ea818ff8_.log 2024-11-01T17:46:45.2829278Z Running 3 items in this shard: test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_get_arg_return_types_from_interface, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_non_scripted_remote_module_template, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_scripted_remote_module_template 2024-11-01T17:46:45.2831467Z 2024-11-01T17:46:45.2832177Z Running distributed/_composable/fsdp/test_fully_shard_comm 1/1 ... [2024-11-01 17:46:45.282976] 2024-11-01T17:46:45.2832900Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:46:45.2837847Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_comm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:46:45.283471] 2024-11-01T17:46:49.8120171Z 2024-11-01T17:46:49.8122387Z distributed/_composable/fsdp/test_fully_shard_comm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_comm_1.1_d664e3a7bf533c9f_.log 2024-11-01T17:46:49.8134948Z Running 15 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_all_gather_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp16, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_fully_shard_communication_count, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_manual_reshard_with_reshard_after_forward_false, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_set_reduce_scatter_divide_factor, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_backward_misprefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_unused_module, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_forward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiProcess::test_unshard_async, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_no_param_group, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_without_lazy_init 2024-11-01T17:46:49.8145309Z 2024-11-01T17:46:49.8145763Z Running distributed/fsdp/test_utils 1/1 ... [2024-11-01 17:46:49.812627] 2024-11-01T17:46:49.8146361Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:46:49.8148110Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:46:49.813122] 2024-11-01T17:46:54.1414643Z 2024-11-01T17:46:54.1416502Z distributed/fsdp/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_utils_1.1_66fb96588f1412c8_.log 2024-11-01T17:46:54.1420031Z Running 5 items in this shard: test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_cpu_cuda, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices0, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices1, test/distributed/fsdp/test_utils.py::TestUtils::test_packed_sequence, test/distributed/fsdp/test_utils.py::TestUtils::test_replace_by_prefix 2024-11-01T17:46:54.1422539Z 2024-11-01T17:46:54.1423097Z Running distributed/fsdp/test_fsdp_exec_order 1/1 ... [2024-11-01 17:46:54.142078] 2024-11-01T17:46:54.1423804Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:46:54.1428735Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_exec_order.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:46:54.142574] 2024-11-01T17:47:30.6196397Z 2024-11-01T17:47:30.6200918Z distributed/fsdp/test_fsdp_exec_order 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_c7e25f8d0a9b5548_.log 2024-11-01T17:47:30.6212295Z Running 8 items in this shard: test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy1 2024-11-01T17:47:30.6222229Z 2024-11-01T17:47:30.6223208Z Running distributed/_composable/fsdp/test_fully_shard_training 1/1 ... [2024-11-01 17:47:30.620433] 2024-11-01T17:47:30.6224447Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:47:30.6227260Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_training.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:47:30.621058] 2024-11-01T17:47:35.1500094Z 2024-11-01T17:47:35.1503309Z distributed/_composable/fsdp/test_fully_shard_training 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_training_1.1_029c7c874eac3320_.log 2024-11-01T17:47:35.1533067Z Running 24 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_training.py::test_compiled_fsdp, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardForwardInputs::test_root_move_forward_input_to_device, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardRegisteredParams::test_param_registration_after_backward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardRegisteredParams::test_param_registration_after_forward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardCastAfterInit::test_to_float64_after_init, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_explicit_prefetching, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_multi_forward_module, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_non_root_forward_backward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_post_optim_event, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group_cpu_offload_eager, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group_unshard_async_op, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_single_group_shard_dim0, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_single_group_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCompose::test_train_parity_with_activation_checkpointing, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardShardPlacementFnMultiProcess::test_train_parity_shard_placement_fn_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardShardPlacementFnMultiThread::test_shard_placement_fn_contiguous_params_grads, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardSharedParams::test_train_parity_with_shared_params, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardGradientAccumulation::test_1f1b_microbatching, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardGradientAccumulation::test_gradient_accumulation, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardNDTraining::test_2d_mlp_with_nd_mesh, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardHSDP3DTraining::test_3d_mlp_with_nd_mesh, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardHSDPTraining::test_train_parity_hsdp, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardCustomForwardMethod::test_register_fsdp_forward_method 2024-11-01T17:47:35.1560461Z 2024-11-01T17:47:35.1561662Z Running distributed/algorithms/quantization/test_quantization 1/1 ... [2024-11-01 17:47:35.150846] 2024-11-01T17:47:35.1607805Z MPI not available -- MPI backend tests will be skipped 2024-11-01T17:47:35.1609460Z Running distributed tests for the test backend with env init_method 2024-11-01T17:47:35.1613823Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:47:35.1621991Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:47:35.161729] 2024-11-01T17:47:39.1148668Z 2024-11-01T17:47:39.1151227Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a4c59fe9ce6d7e3b_.log 2024-11-01T17:47:39.1152724Z Running 0 items in this shard: 2024-11-01T17:47:39.1152982Z 2024-11-01T17:47:39.1159560Z Running distributed tests for the test backend with file init_method 2024-11-01T17:47:39.1161108Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:47:39.1166763Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:47:39.116334] 2024-11-01T17:47:43.1149649Z 2024-11-01T17:47:43.1151881Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a649879eebad4a56_.log 2024-11-01T17:47:43.1153371Z Running 0 items in this shard: 2024-11-01T17:47:43.1158367Z 2024-11-01T17:47:43.1159146Z Running distributed tests for the gloo backend with env init_method 2024-11-01T17:47:43.1160446Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:47:43.1166036Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:47:43.116304] 2024-11-01T17:48:11.9253365Z 2024-11-01T17:48:11.9258610Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a68084db4dba309a_.log 2024-11-01T17:48:11.9268317Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-11-01T17:48:11.9277283Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-11-01T17:48:11.9279676Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-11-01T17:48:11.9282402Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-11-01T17:48:11.9284913Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-11-01T17:48:11.9287323Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-11-01T17:48:11.9289933Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-11-01T17:48:11.9291195Z 2024-11-01T17:48:11.9291643Z Running distributed tests for the gloo backend with file init_method 2024-11-01T17:48:11.9292456Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:48:11.9295583Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:48:11.927409] 2024-11-01T17:48:40.9894906Z 2024-11-01T17:48:40.9897271Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_93f3f086de6e8331_.log 2024-11-01T17:48:40.9903145Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-11-01T17:48:40.9908504Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-11-01T17:48:40.9910109Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-11-01T17:48:40.9912271Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-11-01T17:48:40.9913910Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-11-01T17:48:40.9915622Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-11-01T17:48:40.9917304Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-11-01T17:48:40.9918192Z 2024-11-01T17:48:40.9918717Z Running distributed/test_multi_threaded_pg 1/1 ... [2024-11-01 17:48:40.991000] 2024-11-01T17:48:40.9919358Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:48:40.9921283Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_multi_threaded_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:48:40.991459] 2024-11-01T17:48:45.4702075Z 2024-11-01T17:48:45.4704001Z distributed/test_multi_threaded_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_multi_threaded_pg_1.1_9e8a02dda53b959b_.log 2024-11-01T17:48:45.4717789Z Running 22 items in this shard: test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_none, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_tensor, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_skip, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_coalesced, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_ops, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_to_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_allgather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_assert_equal_on_rank, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_bwd_sees_fwd_pg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_gather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_reduce_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_subpg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_using_pg_from_another_thread 2024-11-01T17:48:45.4729781Z 2024-11-01T17:48:45.4730699Z Running distributed/_composable/fully_shard/test_fully_shard_runtime 1/1 ... [2024-11-01 17:48:45.470826] 2024-11-01T17:48:45.4731474Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:48:45.4733401Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_runtime.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:48:45.471344] 2024-11-01T17:48:49.7495611Z 2024-11-01T17:48:49.7497838Z distributed/_composable/fully_shard/test_fully_shard_runtime 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_runtime_1.1_8810ce4495a34005_.log 2024-11-01T17:48:49.7500403Z Running 2 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_runtime.py::TestRuntime::test_training, test/distributed/_composable/fully_shard/test_fully_shard_runtime.py::TestRuntime::test_unshard_reshard_order 2024-11-01T17:48:49.7501759Z 2024-11-01T17:48:49.7503504Z Running distributed/fsdp/test_fsdp_input 1/1 ... [2024-11-01 17:48:49.750134] 2024-11-01T17:48:49.7504149Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:48:49.7509528Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_input.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:48:49.750639] 2024-11-01T17:49:02.0911986Z 2024-11-01T17:49:02.0913964Z distributed/fsdp/test_fsdp_input 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_input_1.1_217411ec2e1f0355_.log 2024-11-01T17:49:02.0915969Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_input.py::TestInput::test_input_type_dict, test/distributed/fsdp/test_fsdp_input.py::TestInput::test_input_type_list 2024-11-01T17:49:02.0917035Z 2024-11-01T17:49:02.0920373Z Running distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 ... [2024-11-01 17:49:02.091798] 2024-11-01T17:49:02.0921196Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:49:02.0926420Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_file_system_checkpoint_cpu.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:49:02.092318] 2024-11-01T17:49:48.5378550Z 2024-11-01T17:49:48.5380997Z distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_file_system_checkpoint_cpu_1.1_8371232d68f263cb_.log 2024-11-01T17:49:48.5393829Z Running 12 items in this shard: test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_save_load_bytes_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_save_load_bytes_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor_thread_count_2 2024-11-01T17:49:48.5403995Z 2024-11-01T17:49:48.5404547Z Running distributed/fsdp/test_fsdp_core 1/1 ... [2024-11-01 17:49:48.538762] 2024-11-01T17:49:48.5405186Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:49:48.5406947Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_core.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:49:48.539277] 2024-11-01T17:53:53.5999174Z 2024-11-01T17:53:53.6000910Z distributed/fsdp/test_fsdp_core 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_core_1.1_705bdd0d469e8c35_.log 2024-11-01T17:53:53.6043432Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_after_state_dict, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestAutograd::test_unshard_params_as_tensors 2024-11-01T17:53:53.6079557Z 2024-11-01T17:53:53.6080330Z Running distributed/fsdp/test_fsdp_multiple_wrapping 1/1 ... [2024-11-01 17:53:53.600471] 2024-11-01T17:53:53.6081031Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:53:53.6082878Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_multiple_wrapping.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:53:53.600963] 2024-11-01T17:54:01.9356600Z 2024-11-01T17:54:01.9358557Z distributed/fsdp/test_fsdp_multiple_wrapping 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_multiple_wrapping_1.1_dc9054d438e7e8ca_.log 2024-11-01T17:54:01.9360593Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_multiple_wrapping.py::TestMultipleWrapping::test_multiple_wrapping 2024-11-01T17:54:01.9361403Z 2024-11-01T17:54:01.9365801Z Running distributed/test_pg_wrapper 1/1 ... [2024-11-01 17:54:01.936324] 2024-11-01T17:54:01.9366421Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:54:01.9372090Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_pg_wrapper.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:54:01.936884] 2024-11-01T17:55:59.2065988Z 2024-11-01T17:55:59.2068231Z distributed/test_pg_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_pg_wrapper_1.1_56b1f10d506ca12e_.log 2024-11-01T17:55:59.2083973Z Running 17 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_coalescing_manager_debug_mode_detail, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_hang, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_detail, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_off, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_debug_level_detail_no_gloo, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_new_group_no_gloo, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_hang, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode_off, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_debug_mode 2024-11-01T17:55:59.2111836Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_coalescing_manager_debug_mode_detail 2024-11-01T17:55:59.2113263Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_hang 2024-11-01T17:55:59.2114717Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_detail 2024-11-01T17:55:59.2116645Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_off 2024-11-01T17:55:59.2118121Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch 2024-11-01T17:55:59.2119570Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch_debug_mode 2024-11-01T17:55:59.2121027Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_debug_level_detail_no_gloo 2024-11-01T17:55:59.2122396Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_new_group_no_gloo 2024-11-01T17:55:59.2123710Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_hang 2024-11-01T17:55:59.2125081Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda 2024-11-01T17:55:59.2126599Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda_debug_mode 2024-11-01T17:55:59.2128281Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode 2024-11-01T17:55:59.2129812Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode_off 2024-11-01T17:55:59.2131283Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch 2024-11-01T17:55:59.2132691Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda 2024-11-01T17:55:59.2134185Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda_debug_mode 2024-11-01T17:55:59.2135710Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_debug_mode 2024-11-01T17:55:59.2136530Z 2024-11-01T17:55:59.2137089Z Running distributed/test_c10d_common 1/1 ... [2024-11-01 17:55:59.207818] 2024-11-01T17:55:59.2137680Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:55:59.2139494Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_common.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:55:59.208341] 2024-11-01T17:59:18.5171586Z 2024-11-01T17:59:18.5173595Z distributed/test_c10d_common 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_common_1.1_6aade8f869650b2f_.log 2024-11-01T17:59:18.5189729Z Running 23 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype, test/distributed/test_c10d_common.py::CommTest::test_debug_level, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback 2024-11-01T17:59:18.5202000Z Running 1 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier 2024-11-01T17:59:18.5203312Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype 2024-11-01T17:59:18.5204850Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype 2024-11-01T17:59:18.5206246Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype 2024-11-01T17:59:18.5207646Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype 2024-11-01T17:59:18.5208861Z Running 1 items in this shard: test/distributed/test_c10d_common.py::CommTest::test_debug_level 2024-11-01T17:59:18.5210078Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr 2024-11-01T17:59:18.5211450Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config 2024-11-01T17:59:18.5212783Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives 2024-11-01T17:59:18.5214120Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name 2024-11-01T17:59:18.5215617Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends 2024-11-01T17:59:18.5217134Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available 2024-11-01T17:59:18.5218487Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv 2024-11-01T17:59:18.5220007Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends 2024-11-01T17:59:18.5221721Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend 2024-11-01T17:59:18.5223189Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop 2024-11-01T17:59:18.5224356Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable 2024-11-01T17:59:18.5225458Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal 2024-11-01T17:59:18.5226576Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle 2024-11-01T17:59:18.5227692Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank 2024-11-01T17:59:18.5229061Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback 2024-11-01T17:59:18.5230259Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv 2024-11-01T17:59:18.5231393Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback 2024-11-01T17:59:18.5232075Z 2024-11-01T17:59:18.5232686Z Running distributed/fsdp/test_fsdp_comm_hooks 1/1 ... [2024-11-01 17:59:18.518574] 2024-11-01T17:59:18.5233328Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T17:59:18.5235123Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_comm_hooks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 17:59:18.519069] 2024-11-01T18:00:27.1454208Z 2024-11-01T18:00:27.1456941Z distributed/fsdp/test_fsdp_comm_hooks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_comm_hooks_1.1_0627618c735a0c47_.log 2024-11-01T18:00:27.1491271Z Running 28 items in this shard: test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_hybrid_strategy, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy2 2024-11-01T18:00:27.1521759Z 2024-11-01T18:00:27.1522755Z Running distributed/fsdp/test_fsdp_fine_tune 1/1 ... [2024-11-01 18:00:27.146300] 2024-11-01T18:00:27.1523876Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:00:27.1526233Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fine_tune.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:00:27.146937] 2024-11-01T18:00:31.4772614Z 2024-11-01T18:00:31.4774614Z distributed/fsdp/test_fsdp_fine_tune 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_e0b23017b0f4b7d6_.log 2024-11-01T18:00:31.4777787Z Running 4 items in this shard: test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_backward_reshard_hooks, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_hooks_multi_traversal, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_ddp, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_non_frozen_fsdp 2024-11-01T18:00:31.4780195Z 2024-11-01T18:00:31.4781120Z Running distributed/test_data_parallel 1/1 ... [2024-11-01 18:00:31.477906] 2024-11-01T18:00:31.4781769Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:00:31.4786955Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_data_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:00:31.478411] 2024-11-01T18:00:35.9069301Z 2024-11-01T18:00:35.9071028Z distributed/test_data_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_data_parallel_1.1_f2fe5db7b3d55e60_.log 2024-11-01T18:00:35.9098974Z Running 46 items in this shard: test/distributed/test_data_parallel.py::TestDataParallel::test_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_buffers_requiring_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_complex, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_device_args, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_function_deletion, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_lazy_linear, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_device, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_no_refcycles, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_module_zero_inputs, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_multiple_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_output, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_no_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_rnn, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_small_back, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_sparse, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_different_len_dicts, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_passes_exception, test/distributed/test_data_parallel.py::TestDataParallel::test_parameter_list_dict_replica, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate_buffers, test/distributed/test_data_parallel.py::TestDataParallel::test_save_replica_module, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_strided_grad_layout, test/distributed/test_data_parallel.py::TestDataParallel::test_zero_grad, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float64 2024-11-01T18:00:35.9124209Z 2024-11-01T18:00:35.9124831Z Running distributed/_shard/sharding_spec/test_sharding_spec 1/1 ... [2024-11-01 18:00:35.907592] 2024-11-01T18:00:35.9125576Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:00:35.9127461Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharding_spec/test_sharding_spec.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:00:35.908088] 2024-11-01T18:00:44.8963028Z 2024-11-01T18:00:44.8965774Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_cba565fa89a291af_.log 2024-11-01T18:00:44.8981203Z Running 11 items in this shard: test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_check_overlapping, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_chunked_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_device_placement, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_enumerable_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunk_sharding_params, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunked_dim_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_split_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_infer_sharding_spec_from_shards_metadata, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_shard_tensor, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_tensor_ctor 2024-11-01T18:00:44.8994424Z 2024-11-01T18:00:44.8995331Z Running distributed/fsdp/test_fsdp_meta 1/1 ... [2024-11-01 18:00:44.896906] 2024-11-01T18:00:44.8996432Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:00:44.8999387Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_meta.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:00:44.897463] 2024-11-01T18:01:22.2331958Z 2024-11-01T18:01:22.2334049Z distributed/fsdp/test_fsdp_meta 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_meta_1.1_d5648b2ebafe1ecc_.log 2024-11-01T18:01:22.2345272Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_meta, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_torchdistx, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_meta_device_with_mixed_precision, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_reset_params, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_init_fn 2024-11-01T18:01:22.2355937Z 2024-11-01T18:01:22.2356517Z Running distributed/fsdp/test_fsdp_unshard_params 1/1 ... [2024-11-01 18:01:22.233850] 2024-11-01T18:01:22.2357256Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:01:22.2359789Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_unshard_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:01:22.234355] 2024-11-01T18:02:28.1622856Z 2024-11-01T18:02:28.1624900Z distributed/fsdp/test_fsdp_unshard_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_unshard_params_1.1_0b7626bb2e24e9b2_.log 2024-11-01T18:02:28.1635123Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_named_parameters_and_buffers, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_param_data, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_recurse, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_respects_reshard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_singleton_param_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_submodule, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_core, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_none_grads, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_param_data_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_writeback_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_offload_to_cpu_no_shard_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_rank0_only_with_writeback_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_backward_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_forward_raises 2024-11-01T18:02:28.1644748Z 2024-11-01T18:02:28.1645304Z Running distributed/rpc/cuda/test_tensorpipe_agent 1/1 ... [2024-11-01 18:02:28.162961] 2024-11-01T18:02:28.1646002Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:02:28.1647912Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/cuda/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:02:28.163465] 2024-11-01T18:18:10.6950729Z 2024-11-01T18:18:10.6952819Z distributed/rpc/cuda/test_tensorpipe_agent 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_bc54d9f2e47409b1_.log 2024-11-01T18:18:10.7043582Z Running 99 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations 2024-11-01T18:18:10.7113974Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda 2024-11-01T18:18:10.7115482Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple 2024-11-01T18:18:10.7117043Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation 2024-11-01T18:18:10.7118714Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root 2024-11-01T18:18:10.7120392Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device 2024-11-01T18:18:10.7122076Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script 2024-11-01T18:18:10.7123873Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices 2024-11-01T18:18:10.7125400Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device 2024-11-01T18:18:10.7127034Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu 2024-11-01T18:18:10.7128841Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future 2024-11-01T18:18:10.7130670Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future 2024-11-01T18:18:10.7132517Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices 2024-11-01T18:18:10.7134373Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor 2024-11-01T18:18:10.7136335Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor 2024-11-01T18:18:10.7138268Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor 2024-11-01T18:18:10.7140305Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor 2024-11-01T18:18:10.7142302Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor 2024-11-01T18:18:10.7144249Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor 2024-11-01T18:18:10.7146082Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device 2024-11-01T18:18:10.7147795Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int 2024-11-01T18:18:10.7149573Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str 2024-11-01T18:18:10.7151298Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda 2024-11-01T18:18:10.7153066Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace 2024-11-01T18:18:10.7154820Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor 2024-11-01T18:18:10.7156567Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device 2024-11-01T18:18:10.7158252Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream 2024-11-01T18:18:10.7160045Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi 2024-11-01T18:18:10.7161819Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested 2024-11-01T18:18:10.7163518Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi 2024-11-01T18:18:10.7165186Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu 2024-11-01T18:18:10.7166869Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default 2024-11-01T18:18:10.7168652Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default 2024-11-01T18:18:10.7170394Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default 2024-11-01T18:18:10.7172152Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default 2024-11-01T18:18:10.7173913Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1 2024-11-01T18:18:10.7175684Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2 2024-11-01T18:18:10.7177376Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3 2024-11-01T18:18:10.7179065Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4 2024-11-01T18:18:10.7180733Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5 2024-11-01T18:18:10.7182414Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6 2024-11-01T18:18:10.7184102Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7 2024-11-01T18:18:10.7185788Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8 2024-11-01T18:18:10.7187496Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1 2024-11-01T18:18:10.7189305Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2 2024-11-01T18:18:10.7191050Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3 2024-11-01T18:18:10.7192776Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4 2024-11-01T18:18:10.7194514Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5 2024-11-01T18:18:10.7196235Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6 2024-11-01T18:18:10.7197953Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7 2024-11-01T18:18:10.7199678Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8 2024-11-01T18:18:10.7201488Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default 2024-11-01T18:18:10.7203272Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default 2024-11-01T18:18:10.7205069Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default 2024-11-01T18:18:10.7206851Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default 2024-11-01T18:18:10.7208558Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu 2024-11-01T18:18:10.7210219Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options 2024-11-01T18:18:10.7211977Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device 2024-11-01T18:18:10.7213855Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device 2024-11-01T18:18:10.7215662Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device 2024-11-01T18:18:10.7217409Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one 2024-11-01T18:18:10.7219124Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config 2024-11-01T18:18:10.7220887Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop 2024-11-01T18:18:10.7222699Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout 2024-11-01T18:18:10.7224516Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote 2024-11-01T18:18:10.7226358Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response 2024-11-01T18:18:10.7228218Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response 2024-11-01T18:18:10.7230115Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop 2024-11-01T18:18:10.7231874Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu 2024-11-01T18:18:10.7233583Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self 2024-11-01T18:18:10.7235286Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many 2024-11-01T18:18:10.7236967Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote 2024-11-01T18:18:10.7238659Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu 2024-11-01T18:18:10.7240471Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self 2024-11-01T18:18:10.7242240Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name 2024-11-01T18:18:10.7243937Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch 2024-11-01T18:18:10.7245593Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch 2024-11-01T18:18:10.7247332Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse 2024-11-01T18:18:10.7249111Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1 2024-11-01T18:18:10.7250936Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2 2024-11-01T18:18:10.7252801Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3 2024-11-01T18:18:10.7254607Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4 2024-11-01T18:18:10.7256381Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1 2024-11-01T18:18:10.7258126Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2 2024-11-01T18:18:10.7260079Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3 2024-11-01T18:18:10.7261814Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4 2024-11-01T18:18:10.7263561Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5 2024-11-01T18:18:10.7265301Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1 2024-11-01T18:18:10.7267061Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2 2024-11-01T18:18:10.7268878Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3 2024-11-01T18:18:10.7270644Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4 2024-11-01T18:18:10.7272414Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1 2024-11-01T18:18:10.7274171Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2 2024-11-01T18:18:10.7275937Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3 2024-11-01T18:18:10.7277689Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4 2024-11-01T18:18:10.7279636Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes 2024-11-01T18:18:10.7281390Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value 2024-11-01T18:18:10.7283132Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass 2024-11-01T18:18:10.7284908Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams 2024-11-01T18:18:10.7286693Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations 2024-11-01T18:18:10.7287681Z 2024-11-01T18:18:10.7288309Z Running distributed/rpc/test_tensorpipe_agent 2/4 ... [2024-11-01 18:18:10.700252] 2024-11-01T18:18:10.7288987Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:18:10.7290972Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=2', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:18:10.700771] 2024-11-01T18:38:59.3282833Z 2024-11-01T18:38:59.3284800Z distributed/rpc/test_tensorpipe_agent 2/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_4add288ec9bb3ff3_.log 2024-11-01T18:38:59.3385143Z Running 122 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-11-01T18:38:59.3453409Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add 2024-11-01T18:38:59.3454761Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote 2024-11-01T18:38:59.3456235Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async 2024-11-01T18:38:59.3457732Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote 2024-11-01T18:38:59.3459358Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async 2024-11-01T18:38:59.3460773Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote 2024-11-01T18:38:59.3462231Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async 2024-11-01T18:38:59.3463660Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method 2024-11-01T18:38:59.3465030Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote 2024-11-01T18:38:59.3466390Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self 2024-11-01T18:38:59.3467687Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple 2024-11-01T18:38:59.3469145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options 2024-11-01T18:38:59.3470552Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used 2024-11-01T18:38:59.3471856Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name 2024-11-01T18:38:59.3473262Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src 2024-11-01T18:38:59.3474522Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done 2024-11-01T18:38:59.3475827Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception 2024-11-01T18:38:59.3477156Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos 2024-11-01T18:38:59.3478445Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc 2024-11-01T18:38:59.3479716Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names 2024-11-01T18:38:59.3480984Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown 2024-11-01T18:38:59.3482333Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret 2024-11-01T18:38:59.3483632Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc 2024-11-01T18:38:59.3485047Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress 2024-11-01T18:38:59.3486368Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward 2024-11-01T18:38:59.3487688Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init 2024-11-01T18:38:59.3488981Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future 2024-11-01T18:38:59.3490286Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace 2024-11-01T18:38:59.3491748Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled 2024-11-01T18:38:59.3493125Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory 2024-11-01T18:38:59.3494500Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes 2024-11-01T18:38:59.3496009Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded 2024-11-01T18:38:59.3497605Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded 2024-11-01T18:38:59.3499131Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf 2024-11-01T18:38:59.3500608Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded 2024-11-01T18:38:59.3502023Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in 2024-11-01T18:38:59.3503291Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method 2024-11-01T18:38:59.3504590Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception 2024-11-01T18:38:59.3505910Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle 2024-11-01T18:38:59.3507224Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result 2024-11-01T18:38:59.3508657Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func 2024-11-01T18:38:59.3510032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args 2024-11-01T18:38:59.3511351Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container 2024-11-01T18:38:59.3512744Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call 2024-11-01T18:38:59.3514044Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit 2024-11-01T18:38:59.3515261Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future 2024-11-01T18:38:59.3516554Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async 2024-11-01T18:38:59.3517908Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote 2024-11-01T18:38:59.3519232Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs 2024-11-01T18:38:59.3520597Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function 2024-11-01T18:38:59.3522166Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded 2024-11-01T18:38:59.3523576Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts 2024-11-01T18:38:59.3524908Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported 2024-11-01T18:38:59.3526279Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking 2024-11-01T18:38:59.3527669Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking 2024-11-01T18:38:59.3528994Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add 2024-11-01T18:38:59.3530222Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add 2024-11-01T18:38:59.3531569Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg 2024-11-01T18:38:59.3532933Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank 2024-11-01T18:38:59.3534277Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler 2024-11-01T18:38:59.3535730Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout 2024-11-01T18:38:59.3537082Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc 2024-11-01T18:38:59.3538369Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc 2024-11-01T18:38:59.3539682Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward 2024-11-01T18:38:59.3541040Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func 2024-11-01T18:38:59.3542390Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout 2024-11-01T18:38:59.3543724Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense 2024-11-01T18:38:59.3545089Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout 2024-11-01T18:38:59.3546613Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf 2024-11-01T18:38:59.3548187Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors 2024-11-01T18:38:59.3549755Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref 2024-11-01T18:38:59.3551185Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors 2024-11-01T18:38:59.3552601Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info 2024-11-01T18:38:59.3554012Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling 2024-11-01T18:38:59.3555491Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call 2024-11-01T18:38:59.3556994Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call 2024-11-01T18:38:59.3558607Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors 2024-11-01T18:38:59.3560291Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context 2024-11-01T18:38:59.3561831Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote 2024-11-01T18:38:59.3563409Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args 2024-11-01T18:38:59.3564934Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions 2024-11-01T18:38:59.3566399Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim 2024-11-01T18:38:59.3567867Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote 2024-11-01T18:38:59.3569314Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf 2024-11-01T18:38:59.3570746Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults 2024-11-01T18:38:59.3572316Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork 2024-11-01T18:38:59.3573870Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async 2024-11-01T18:38:59.3575301Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf 2024-11-01T18:38:59.3576670Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled 2024-11-01T18:38:59.3578052Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return 2024-11-01T18:38:59.3579391Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner 2024-11-01T18:38:59.3580766Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported 2024-11-01T18:38:59.3582159Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate 2024-11-01T18:38:59.3583628Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value 2024-11-01T18:38:59.3585045Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported 2024-11-01T18:38:59.3586509Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed 2024-11-01T18:38:59.3587905Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward 2024-11-01T18:38:59.3589440Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context 2024-11-01T18:38:59.3590883Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync 2024-11-01T18:38:59.3592272Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref 2024-11-01T18:38:59.3593789Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported 2024-11-01T18:38:59.3595693Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported 2024-11-01T18:38:59.3597454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside 2024-11-01T18:38:59.3599089Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs 2024-11-01T18:38:59.3600696Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp 2024-11-01T18:38:59.3602310Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together 2024-11-01T18:38:59.3603929Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc 2024-11-01T18:38:59.3605529Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank 2024-11-01T18:38:59.3607132Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args 2024-11-01T18:38:59.3608683Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse 2024-11-01T18:38:59.3610231Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse 2024-11-01T18:38:59.3611820Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container 2024-11-01T18:38:59.3613471Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse 2024-11-01T18:38:59.3615133Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads 2024-11-01T18:38:59.3616818Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse 2024-11-01T18:38:59.3618543Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse 2024-11-01T18:38:59.3620334Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse 2024-11-01T18:38:59.3622217Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse 2024-11-01T18:38:59.3624010Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse 2024-11-01T18:38:59.3625833Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse 2024-11-01T18:38:59.3627686Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse 2024-11-01T18:38:59.3629559Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-11-01T18:38:59.3630487Z 2024-11-01T18:38:59.3631115Z Running distributed/rpc/test_tensorpipe_agent 4/4 ... [2024-11-01 18:38:59.335760] 2024-11-01T18:38:59.3631774Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:38:59.3633662Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=4', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:38:59.336313] 2024-11-01T18:58:21.7966001Z 2024-11-01T18:58:21.7967819Z distributed/rpc/test_tensorpipe_agent 4/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_efdbe620e9343cdf_.log 2024-11-01T18:58:21.8062609Z Running 112 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse 2024-11-01T18:58:21.8126806Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather 2024-11-01T18:58:21.8128107Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout 2024-11-01T18:58:21.8129429Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method 2024-11-01T18:58:21.8130787Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote 2024-11-01T18:58:21.8132212Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote 2024-11-01T18:58:21.8133629Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested 2024-11-01T18:58:21.8135019Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote 2024-11-01T18:58:21.8136413Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise 2024-11-01T18:58:21.8137845Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote 2024-11-01T18:58:21.8139364Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote 2024-11-01T18:58:21.8140919Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks 2024-11-01T18:58:21.8142401Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy 2024-11-01T18:58:21.8143789Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num 2024-11-01T18:58:21.8145141Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type 2024-11-01T18:58:21.8146494Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee 2024-11-01T18:58:21.8147937Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload 2024-11-01T18:58:21.8149419Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions 2024-11-01T18:58:21.8150729Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice 2024-11-01T18:58:21.8152150Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner 2024-11-01T18:58:21.8153515Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice 2024-11-01T18:58:21.8154764Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc 2024-11-01T18:58:21.8156058Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref 2024-11-01T18:58:21.8157323Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors 2024-11-01T18:58:21.8158600Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality 2024-11-01T18:58:21.8160101Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs 2024-11-01T18:58:21.8161538Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded 2024-11-01T18:58:21.8163211Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin 2024-11-01T18:58:21.8164648Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc 2024-11-01T18:58:21.8166155Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded 2024-11-01T18:58:21.8167723Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str 2024-11-01T18:58:21.8169098Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined 2024-11-01T18:58:21.8170367Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw 2024-11-01T18:58:21.8171660Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception 2024-11-01T18:58:21.8172981Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all 2024-11-01T18:58:21.8174312Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded 2024-11-01T18:58:21.8175668Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset 2024-11-01T18:58:21.8176997Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info 2024-11-01T18:58:21.8178311Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak 2024-11-01T18:58:21.8179600Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self 2024-11-01T18:58:21.8180912Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse 2024-11-01T18:58:21.8182214Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor 2024-11-01T18:58:21.8183533Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self 2024-11-01T18:58:21.8184809Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str 2024-11-01T18:58:21.8186033Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout 2024-11-01T18:58:21.8187298Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking 2024-11-01T18:58:21.8188872Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg 2024-11-01T18:58:21.8190364Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg 2024-11-01T18:58:21.8191739Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors 2024-11-01T18:58:21.8193072Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc 2024-11-01T18:58:21.8194405Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler 2024-11-01T18:58:21.8195729Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown 2024-11-01T18:58:21.8197117Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python 2024-11-01T18:58:21.8198487Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call 2024-11-01T18:58:21.8199836Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id 2024-11-01T18:58:21.8201108Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle 2024-11-01T18:58:21.8202570Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server 2024-11-01T18:58:21.8204135Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd 2024-11-01T18:58:21.8205569Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi 2024-11-01T18:58:21.8206990Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple 2024-11-01T18:58:21.8208407Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self 2024-11-01T18:58:21.8209855Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc 2024-11-01T18:58:21.8211384Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors 2024-11-01T18:58:21.8212892Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value 2024-11-01T18:58:21.8214425Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself 2024-11-01T18:58:21.8215920Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward 2024-11-01T18:58:21.8217341Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded 2024-11-01T18:58:21.8218790Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads 2024-11-01T18:58:21.8220219Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote 2024-11-01T18:58:21.8221678Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order 2024-11-01T18:58:21.8223109Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw 2024-11-01T18:58:21.8224767Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported 2024-11-01T18:58:21.8226506Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script 2024-11-01T18:58:21.8228273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script 2024-11-01T18:58:21.8229849Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain 2024-11-01T18:58:21.8231254Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote 2024-11-01T18:58:21.8232769Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit 2024-11-01T18:58:21.8234299Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified 2024-11-01T18:58:21.8235831Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref 2024-11-01T18:58:21.8237403Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function 2024-11-01T18:58:21.8238895Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception 2024-11-01T18:58:21.8240340Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients 2024-11-01T18:58:21.8241762Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script 2024-11-01T18:58:21.8243200Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs 2024-11-01T18:58:21.8244774Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script 2024-11-01T18:58:21.8246331Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters 2024-11-01T18:58:21.8247914Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire 2024-11-01T18:58:21.8249546Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside 2024-11-01T18:58:21.8251110Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs 2024-11-01T18:58:21.8252681Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote 2024-11-01T18:58:21.8254266Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads 2024-11-01T18:58:21.8256030Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda 2024-11-01T18:58:21.8257937Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank 2024-11-01T18:58:21.8259865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse 2024-11-01T18:58:21.8261428Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse 2024-11-01T18:58:21.8263076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse 2024-11-01T18:58:21.8264633Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse 2024-11-01T18:58:21.8266234Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse 2024-11-01T18:58:21.8267817Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout 2024-11-01T18:58:21.8269468Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout 2024-11-01T18:58:21.8271070Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse 2024-11-01T18:58:21.8272776Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse 2024-11-01T18:58:21.8274575Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse 2024-11-01T18:58:21.8276391Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse 2024-11-01T18:58:21.8278116Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse 2024-11-01T18:58:21.8279912Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse 2024-11-01T18:58:21.8281713Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse 2024-11-01T18:58:21.8283503Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse 2024-11-01T18:58:21.8285351Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse 2024-11-01T18:58:21.8287174Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse 2024-11-01T18:58:21.8288901Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse 2024-11-01T18:58:21.8290690Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse 2024-11-01T18:58:21.8292501Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse 2024-11-01T18:58:21.8293399Z 2024-11-01T18:58:21.8294084Z Running distributed/fsdp/test_distributed_checkpoint 1/1 ... [2024-11-01 18:58:21.803213] 2024-11-01T18:58:21.8294781Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:21.8296618Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_distributed_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:21.803742] 2024-11-01T18:58:26.1822393Z 2024-11-01T18:58:26.1824550Z distributed/fsdp/test_distributed_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_distributed_checkpoint_1.1_1681ce28bfc0ff53_.log 2024-11-01T18:58:26.1827529Z Running 2 items in this shard: test/distributed/fsdp/test_distributed_checkpoint.py::TestDistributedCheckpoint::test_distributed_checkpoint_state_dict_type0, test/distributed/fsdp/test_distributed_checkpoint.py::TestDistributedCheckpoint::test_distributed_checkpoint_state_dict_type1 2024-11-01T18:58:26.1829364Z 2024-11-01T18:58:26.1830192Z Running distributed/test_c10d_ucc 1/1 ... [2024-11-01 18:58:26.182816] 2024-11-01T18:58:26.1830842Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:26.1836291Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:26.183323] 2024-11-01T18:58:27.7778010Z 2024-11-01T18:58:27.7779584Z distributed/test_c10d_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ucc_1.1_1bcb19bce3463df1_.log 2024-11-01T18:58:27.7780589Z 2024-11-01T18:58:27.7786665Z Running distributed/_shard/sharded_tensor/ops/test_embedding 1/1 ... [2024-11-01 18:58:27.778405] 2024-11-01T18:58:27.7787415Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:27.7792237Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:27.778924] 2024-11-01T18:58:31.8066408Z 2024-11-01T18:58:31.8069556Z distributed/_shard/sharded_tensor/ops/test_embedding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_1.1_f49cecb338d4d063_.log 2024-11-01T18:58:31.8074488Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_rowwise 2024-11-01T18:58:31.8077223Z 2024-11-01T18:58:31.8078196Z Running distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 ... [2024-11-01 18:58:31.807439] 2024-11-01T18:58:31.8079551Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:31.8085113Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding_bag.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:31.808067] 2024-11-01T18:58:35.8362719Z 2024-11-01T18:58:35.8364654Z distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_bag_1.1_96fd1703ffe1d127_.log 2024-11-01T18:58:35.8367463Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_rowwise 2024-11-01T18:58:35.8369479Z 2024-11-01T18:58:35.8370092Z Running distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 ... [2024-11-01 18:58:35.836740] 2024-11-01T18:58:35.8370874Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:35.8375563Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:35.837253] 2024-11-01T18:58:39.8655930Z 2024-11-01T18:58:39.8658381Z distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_reshard_1.1_43eff6ecd3cadf20_.log 2024-11-01T18:58:39.8661578Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py::TestReshard::test_sharded_tensor_reshard, test/distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py::TestReshard::test_sharded_tensor_reshard_errors 2024-11-01T18:58:39.8663300Z 2024-11-01T18:58:39.8664296Z Running distributed/test_c10d_gloo 1/1 ... [2024-11-01 18:58:39.866163] 2024-11-01T18:58:39.8664907Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-11-01T18:58:39.8670042Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-11-01 18:58:39.866664] 2024-11-01T19:15:28.9699853Z 2024-11-01T19:15:28.9701436Z distributed/test_c10d_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_gloo_1.1_a4c65ce9c02eda48_.log 2024-11-01T19:15:28.9811842Z Running 120 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init, test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket, test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-11-01T19:15:28.9932866Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init 2024-11-01T19:15:28.9935393Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo 2024-11-01T19:15:28.9938018Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics 2024-11-01T19:15:28.9940701Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda 2024-11-01T19:15:28.9943389Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks 2024-11-01T19:15:28.9946172Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async 2024-11-01T19:15:28.9949159Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks 2024-11-01T19:15:28.9952092Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced 2024-11-01T19:15:28.9955449Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input 2024-11-01T19:15:28.9958207Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress 2024-11-01T19:15:28.9960830Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda 2024-11-01T19:15:28.9963560Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics 2024-11-01T19:15:28.9966241Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda 2024-11-01T19:15:28.9969184Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks 2024-11-01T19:15:28.9972248Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async 2024-11-01T19:15:28.9975480Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics 2024-11-01T19:15:28.9978706Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks 2024-11-01T19:15:28.9981652Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda 2024-11-01T19:15:28.9984633Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress 2024-11-01T19:15:28.9987431Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress 2024-11-01T19:15:28.9990242Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda 2024-11-01T19:15:28.9992975Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait 2024-11-01T19:15:28.9995697Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics 2024-11-01T19:15:28.9998443Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda 2024-11-01T19:15:29.0001237Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks 2024-11-01T19:15:29.0003814Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress 2024-11-01T19:15:29.0006439Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda 2024-11-01T19:15:29.0009014Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors 2024-11-01T19:15:29.0012030Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics 2024-11-01T19:15:29.0014654Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda 2024-11-01T19:15:29.0017217Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks 2024-11-01T19:15:29.0019864Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input 2024-11-01T19:15:29.0022518Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress 2024-11-01T19:15:29.0025038Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda 2024-11-01T19:15:29.0027753Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor 2024-11-01T19:15:29.0030525Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics 2024-11-01T19:15:29.0033110Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda 2024-11-01T19:15:29.0035973Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks 2024-11-01T19:15:29.0038544Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor 2024-11-01T19:15:29.0041397Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced 2024-11-01T19:15:29.0044103Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress 2024-11-01T19:15:29.0046628Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda 2024-11-01T19:15:29.0049255Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics 2024-11-01T19:15:29.0051952Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda 2024-11-01T19:15:29.0054562Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks 2024-11-01T19:15:29.0057179Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress 2024-11-01T19:15:29.0059916Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda 2024-11-01T19:15:29.0062605Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all 2024-11-01T19:15:29.0065239Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout 2024-11-01T19:15:29.0068068Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics 2024-11-01T19:15:29.0071018Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda 2024-11-01T19:15:29.0073856Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks 2024-11-01T19:15:29.0076788Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched 2024-11-01T19:15:29.0079734Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output 2024-11-01T19:15:29.0082747Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param 2024-11-01T19:15:29.0085979Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module 2024-11-01T19:15:29.0089582Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing 2024-11-01T19:15:29.0093041Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False 2024-11-01T19:15:29.0096475Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True 2024-11-01T19:15:29.0100078Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False 2024-11-01T19:15:29.0103864Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True 2024-11-01T19:15:29.0107425Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False 2024-11-01T19:15:29.0111041Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True 2024-11-01T19:15:29.0114893Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing 2024-11-01T19:15:29.0118435Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False 2024-11-01T19:15:29.0122084Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True 2024-11-01T19:15:29.0126205Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False 2024-11-01T19:15:29.0129996Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True 2024-11-01T19:15:29.0133399Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu 2024-11-01T19:15:29.0136847Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo 2024-11-01T19:15:29.0140044Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once 2024-11-01T19:15:29.0143163Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients 2024-11-01T19:15:29.0146198Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init 2024-11-01T19:15:29.0149431Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type 2024-11-01T19:15:29.0152920Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty 2024-11-01T19:15:29.0156372Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad 2024-11-01T19:15:29.0159888Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view 2024-11-01T19:15:29.0163433Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph 2024-11-01T19:15:29.0167145Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list 2024-11-01T19:15:29.0170856Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list 2024-11-01T19:15:29.0174132Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module 2024-11-01T19:15:29.0177080Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module 2024-11-01T19:15:29.0180007Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module 2024-11-01T19:15:29.0183118Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view 2024-11-01T19:15:29.0186067Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output 2024-11-01T19:15:29.0189118Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters 2024-11-01T19:15:29.0192297Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor 2024-11-01T19:15:29.0195246Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state 2024-11-01T19:15:29.0198546Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint 2024-11-01T19:15:29.0201816Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients 2024-11-01T19:15:29.0205359Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view 2024-11-01T19:15:29.0209039Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input 2024-11-01T19:15:29.0212760Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input 2024-11-01T19:15:29.0216036Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward 2024-11-01T19:15:29.0217776Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer 2024-11-01T19:15:29.0219625Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters 2024-11-01T19:15:29.0221536Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket 2024-11-01T19:15:29.0223329Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket 2024-11-01T19:15:29.0225121Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket 2024-11-01T19:15:29.0226813Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors 2024-11-01T19:15:29.0228604Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu 2024-11-01T19:15:29.0230455Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda 2024-11-01T19:15:29.0232227Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership 2024-11-01T19:15:29.0233914Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group 2024-11-01T19:15:29.0235722Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default 2024-11-01T19:15:29.0237711Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup 2024-11-01T19:15:29.0239633Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo 2024-11-01T19:15:29.0241650Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group 2024-11-01T19:15:29.0243468Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex 2024-11-01T19:15:29.0245218Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch 2024-11-01T19:15:29.0247273Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single 2024-11-01T19:15:29.0249634Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced 2024-11-01T19:15:29.0252043Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced 2024-11-01T19:15:29.0254401Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives 2024-11-01T19:15:29.0257042Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends 2024-11-01T19:15:29.0260945Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend 2024-11-01T19:15:29.0263711Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier 2024-11-01T19:15:29.0265839Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync 2024-11-01T19:15:29.0267729Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg 2024-11-01T19:15:29.0269865Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-11-01T19:15:29.0270953Z 2024-11-01T19:15:29.7215742Z Running test batch 'tests to run' cost 9284.37 seconds 2024-11-01T19:15:30.4296002Z 2024-11-01T19:15:30.4296771Z real 154m51.195s 2024-11-01T19:15:30.4297150Z user 269m49.595s 2024-11-01T19:15:30.4297476Z sys 40m6.322s 2024-11-01T19:15:30.4297768Z + assert_git_not_dirty 2024-11-01T19:15:30.4298379Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]] 2024-11-01T19:15:30.4298897Z + [[ linux-jammy-py3.9-gcc11 != *xla* ]] 2024-11-01T19:15:30.4303346Z ++ git status --porcelain 2024-11-01T19:15:30.4304094Z ++ grep -v '?? third_party' 2024-11-01T19:15:54.7900537Z ++ true 2024-11-01T19:15:54.7901109Z + git_status= 2024-11-01T19:15:54.7904008Z + [[ -n '' ]] 2024-11-01T19:15:54.7904721Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]] 2024-11-01T19:15:54.7905642Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-11-01T19:15:54.7906090Z + [[ 2 == 1 ]] 2024-11-01T19:15:54.7906391Z + cleanup_workspace 2024-11-01T19:15:54.7907293Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-11-01T19:15:54.7908540Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-11-01T19:15:54.7909518Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-11-01T19:15:54.7910184Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-11-01T19:15:54.7911015Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-11-01T19:15:54.7911981Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-11-01T19:15:54.7912676Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-11-01T19:15:55.2945790Z ##[group]Run cat test/**/*_toprint.log || true 2024-11-01T19:15:55.2946311Z cat test/**/*_toprint.log || true 2024-11-01T19:15:55.2956248Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:55.2956762Z env: 2024-11-01T19:15:55.2957035Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.2957673Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.2958345Z ##[endgroup] 2024-11-01T19:15:55.3037924Z cat: 'test/**/*_toprint.log': No such file or directory 2024-11-01T19:15:55.3089288Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-11-01T19:15:55.3089774Z kill "$MONITOR_SCRIPT_PID" 2024-11-01T19:15:55.3095806Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:55.3096296Z env: 2024-11-01T19:15:55.3096566Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.3097186Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.3097870Z MONITOR_SCRIPT_PID: 39859 2024-11-01T19:15:55.3098221Z ##[endgroup] 2024-11-01T19:15:55.3307134Z Prepare all required actions 2024-11-01T19:15:55.3307613Z Getting action download info 2024-11-01T19:15:55.5868874Z Download action repository 'actions/upload-artifact@v3' (SHA:ff15f0306b3f739f7b6fd43fb5d26cd321bd4de5) 2024-11-01T19:15:55.7421633Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-11-01T19:15:55.7422111Z with: 2024-11-01T19:15:55.7422521Z file-suffix: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T19:15:55.7423057Z s3-bucket: gha-artifacts 2024-11-01T19:15:55.7423543Z env: 2024-11-01T19:15:55.7423818Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.7424451Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.7425116Z ##[endgroup] 2024-11-01T19:15:55.7456836Z ##[group]Run # Remove any previous test jsons if they exist 2024-11-01T19:15:55.7457478Z # Remove any previous test jsons if they exist 2024-11-01T19:15:55.7457989Z rm -f test-jsons-*.zip 2024-11-01T19:15:55.7483785Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2024-11-01T19:15:55.7490356Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:55.7490860Z env: 2024-11-01T19:15:55.7491116Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.7491739Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.7492543Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T19:15:55.7493069Z ##[endgroup] 2024-11-01T19:15:55.7658739Z adding: test/test-reports/td_exclusions-2bf038a7b6e7c0d32627.json (deflated 86%) 2024-11-01T19:15:55.7688862Z ##[group]Run # Remove any previous test reports if they exist 2024-11-01T19:15:55.7689528Z # Remove any previous test reports if they exist 2024-11-01T19:15:55.7690051Z rm -f test-reports-*.zip 2024-11-01T19:15:55.7690716Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2024-11-01T19:15:55.7696948Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:55.7697516Z env: 2024-11-01T19:15:55.7697792Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.7698421Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.7699228Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T19:15:55.7699753Z ##[endgroup] 2024-11-01T19:15:55.7834649Z adding: test/test-reports/python-pytest/distributed.test_dynamo_distributed/distributed.test_dynamo_distributed-def3a52d6255d09a.xml (deflated 93%) 2024-11-01T19:15:55.7836515Z adding: test/test-reports/python-pytest/distributed._tools.test_mem_tracker/distributed._tools.test_mem_tracker-3070962e36075370.xml (deflated 65%) 2024-11-01T19:15:55.7839136Z adding: test/test-reports/python-pytest/distributed._composable.test_contract/distributed._composable.test_contract-eb94c4166553a876.xml (deflated 69%) 2024-11-01T19:15:55.7840923Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fx/distributed.fsdp.test_fsdp_fx-229bda5d792633bc.xml (deflated 36%) 2024-11-01T19:15:55.7842628Z adding: test/test-reports/python-pytest/distributed.test_symmetric_memory/distributed.test_symmetric_memory-768f3fe63f3167b6.xml (deflated 97%) 2024-11-01T19:15:55.7844340Z adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor/distributed._tensor.test_dtensor-d75a49458ef29a57.xml (deflated 85%) 2024-11-01T19:15:55.7862224Z adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor_ops/distributed._tensor.test_dtensor_ops-7d4f46545146e12b.xml (deflated 97%) 2024-11-01T19:15:55.7866093Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_logging/distributed._composable.fsdp.test_fully_shard_logging-1fd7b0dca2211ba7.xml (deflated 28%) 2024-11-01T19:15:55.7870150Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_optim_state/distributed.checkpoint.test_fsdp_optim_state-86af7eaf4e37c0ad.xml (deflated 37%) 2024-11-01T19:15:55.7873726Z adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode_features/distributed._tensor.debug.test_comm_mode_features-2ae3154487c10baf.xml (deflated 63%) 2024-11-01T19:15:55.7877160Z adding: test/test-reports/python-pytest/distributed._tensor.test_random_ops/distributed._tensor.test_random_ops-9f37c84958b9299b.xml (deflated 74%) 2024-11-01T19:15:55.7879719Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_e2e_save_and_load/distributed.checkpoint.e2e.test_e2e_save_and_load-a1e7e512290820b8.xml (deflated 77%) 2024-11-01T19:15:55.7883906Z adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_local_map/distributed._tensor.experimental.test_local_map-20c1f7138e81cf0b.xml (deflated 67%) 2024-11-01T19:15:55.7887799Z adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_tp_transform/distributed._tensor.experimental.test_tp_transform-d170ae23682c2fa8.xml (deflated 62%) 2024-11-01T19:15:55.7891060Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fine_tuning/distributed.checkpoint.e2e.test_fine_tuning-dead8c98680f57cc.xml (deflated 38%) 2024-11-01T19:15:55.7894611Z adding: test/test-reports/python-pytest/distributed._tensor.test_pointwise_ops/distributed._tensor.test_pointwise_ops-aafacbac465d326c.xml (deflated 70%) 2024-11-01T19:15:55.7898197Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_pipeline/distributed.checkpoint.e2e.test_pipeline-92be35e5d8df0156.xml (deflated 38%) 2024-11-01T19:15:55.7902067Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_checkpoint/distributed.checkpoint.test_dtensor_checkpoint-f3a7cb696377fd88.xml (deflated 40%) 2024-11-01T19:15:55.7905929Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_compatibility/distributed.checkpoint.test_compatibility-bbcbcf83b2f4b6c9.xml (deflated 69%) 2024-11-01T19:15:55.7909392Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_examples/distributed.tensor.parallel.test_tp_examples-18eb8cc9aac2e8bf.xml (deflated 74%) 2024-11-01T19:15:55.7912990Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_random_state/distributed.tensor.parallel.test_tp_random_state-1e20555868a598b0.xml (deflated 37%) 2024-11-01T19:15:55.7916757Z adding: test/test-reports/python-pytest/distributed._tensor.test_embedding_ops/distributed._tensor.test_embedding_ops-22243286d7de4c2d.xml (deflated 67%) 2024-11-01T19:15:55.7920580Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_memory/distributed._composable.fsdp.test_fully_shard_memory-e220d014364768bf.xml (deflated 38%) 2024-11-01T19:15:55.7924551Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict_utils/distributed.checkpoint.test_state_dict_utils-3d3098dbc0623ac2.xml (deflated 75%) 2024-11-01T19:15:55.7928424Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_hsdp_checkpoint/distributed.checkpoint.test_hsdp_checkpoint-6d936fd5b2d7b520.xml (deflated 54%) 2024-11-01T19:15:55.7932084Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_planner/distributed.checkpoint.test_planner-c65bcf4014c5e289.xml (deflated 66%) 2024-11-01T19:15:55.7935857Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_init/distributed._composable.fsdp.test_fully_shard_init-9f29c27108104e9d.xml (deflated 92%) 2024-11-01T19:15:55.7940187Z adding: test/test-reports/python-pytest/distributed._composable.test_composability.test_pp_composability/distributed._composable.test_composability.test_pp_composability-09438687ad075506.xml (deflated 95%) 2024-11-01T19:15:55.7944690Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_grad_scaler/distributed._composable.fsdp.test_fully_shard_grad_scaler-d198e42bbfab5632.xml (deflated 47%) 2024-11-01T19:15:55.7949254Z adding: test/test-reports/python-pytest/distributed._tensor.test_op_strategy/distributed._tensor.test_op_strategy-2b5ecd700161323a.xml (deflated 83%) 2024-11-01T19:15:55.7952716Z adding: test/test-reports/python-pytest/distributed.test_control_collectives/distributed.test_control_collectives-1a9eb57fd770754c.xml (deflated 84%) 2024-11-01T19:15:55.7956009Z adding: test/test-reports/python-pytest/distributed.launcher.test_run/distributed.launcher.test_run-2573c2af2feaee0b.xml (deflated 84%) 2024-11-01T19:15:55.7960074Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_compile/distributed._composable.fully_shard.test_fully_shard_compile-abf2007d6253bcde.xml (deflated 49%) 2024-11-01T19:15:55.7964158Z adding: test/test-reports/python-pytest/distributed.pipelining.test_schedule/distributed.pipelining.test_schedule-0d3a535432fe7134.xml (deflated 90%) 2024-11-01T19:15:55.7968298Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion-b9503b7585389874.xml (deflated 39%) 2024-11-01T19:15:55.7972206Z adding: test/test-reports/python-pytest/distributed.fsdp.test_shard_utils/distributed.fsdp.test_shard_utils-b74cfadb82f08dab.xml (deflated 53%) 2024-11-01T19:15:55.7975692Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_optim_state/distributed.fsdp.test_fsdp_optim_state-fcdd59773674b183.xml (deflated 96%) 2024-11-01T19:15:55.7979061Z adding: test/test-reports/python-pytest/distributed._tensor.test_utils/distributed._tensor.test_utils-15cb707be711ad83.xml (deflated 77%) 2024-11-01T19:15:55.7982039Z adding: test/test-reports/python-pytest/distributed.test_nccl/distributed.test_nccl-3752550288289b58.xml (deflated 28%) 2024-11-01T19:15:55.7985408Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_backward_prefetch/distributed.fsdp.test_fsdp_backward_prefetch-fb26b56ca7c0ab08.xml (deflated 47%) 2024-11-01T19:15:55.7989312Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_dtensor_state_dict/distributed.fsdp.test_fsdp_dtensor_state_dict-df75bbb24f07001e.xml (deflated 71%) 2024-11-01T19:15:55.7993137Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_checkpoint/distributed.checkpoint.test_checkpoint-c3b5a71b83f4ce8d.xml (deflated 84%) 2024-11-01T19:15:55.7997198Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_autograd/distributed._composable.fsdp.test_fully_shard_autograd-5bad416cc76a3400.xml (deflated 67%) 2024-11-01T19:15:55.8001103Z adding: test/test-reports/python-pytest/distributed._composable.test_replicate/distributed._composable.test_replicate-e0f77b7ca588af4d.xml (deflated 88%) 2024-11-01T19:15:55.8004774Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_tp_integration/distributed.fsdp.test_fsdp_tp_integration-567d20980052fb5b.xml (deflated 72%) 2024-11-01T19:15:55.8009103Z adding: test/test-reports/python-pytest/distributed._composable.test_composability.test_2d_composability/distributed._composable.test_composability.test_2d_composability-7cb7198dba5cd691.xml (deflated 84%) 2024-11-01T19:15:55.8013275Z adding: test/test-reports/python-pytest/distributed.test_c10d_object_collectives/distributed.test_c10d_object_collectives-9478bbfc2f110e43.xml (deflated 80%) 2024-11-01T19:15:55.8016874Z adding: test/test-reports/python-pytest/distributed.nn.jit.test_instantiator/distributed.nn.jit.test_instantiator-1dabc93a2ef4d257.xml (deflated 61%) 2024-11-01T19:15:55.8020743Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_comm/distributed._composable.fsdp.test_fully_shard_comm-fd8b62b6be487371.xml (deflated 85%) 2024-11-01T19:15:55.8024320Z adding: test/test-reports/python-pytest/distributed.fsdp.test_utils/distributed.fsdp.test_utils-4c81022b3013850c.xml (deflated 70%) 2024-11-01T19:15:55.8027676Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_exec_order/distributed.fsdp.test_fsdp_exec_order-11fff1c3d9f60592.xml (deflated 87%) 2024-11-01T19:15:55.8031917Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_training/distributed._composable.fsdp.test_fully_shard_training-2ad256c0d3235738.xml (deflated 85%) 2024-11-01T19:15:55.8035737Z adding: test/test-reports/python-pytest/distributed.test_multi_threaded_pg/distributed.test_multi_threaded_pg-e9561423ea8f8947.xml (deflated 81%) 2024-11-01T19:15:55.8039761Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_runtime/distributed._composable.fully_shard.test_fully_shard_runtime-f2ffd54edbdd4bd2.xml (deflated 54%) 2024-11-01T19:15:55.8043741Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_input/distributed.fsdp.test_fsdp_input-9f10ead2c4358fa8.xml (deflated 64%) 2024-11-01T19:15:55.8047537Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_file_system_checkpoint_cpu/distributed.checkpoint.test_file_system_checkpoint_cpu-e098d7faa735503a.xml (deflated 78%) 2024-11-01T19:15:55.8051638Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_core/distributed.fsdp.test_fsdp_core-4e65588652ae81ee.xml (deflated 96%) 2024-11-01T19:15:55.8055174Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_multiple_wrapping/distributed.fsdp.test_fsdp_multiple_wrapping-c2da88fc4a440ab4.xml (deflated 47%) 2024-11-01T19:15:55.8058559Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-8696bb1243684daf.xml (deflated 44%) 2024-11-01T19:15:55.8061777Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-0ccdbbd48d0dbf43.xml (deflated 44%) 2024-11-01T19:15:55.8065272Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-db36eceba807b939.xml (deflated 44%) 2024-11-01T19:15:55.8068322Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-5ef7e1893f9823b5.xml (deflated 43%) 2024-11-01T19:15:55.8071424Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-e2b1fe1576c83fc1.xml (deflated 44%) 2024-11-01T19:15:55.8074479Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-e89b6b51ad30b3fc.xml (deflated 44%) 2024-11-01T19:15:55.8077522Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-2352d19966b015ea.xml (deflated 44%) 2024-11-01T19:15:55.8080536Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-c787f3f529c2657f.xml (deflated 44%) 2024-11-01T19:15:55.8083551Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-64c031ef1f4cbdd8.xml (deflated 35%) 2024-11-01T19:15:55.8086582Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-4dc955893c893e38.xml (deflated 42%) 2024-11-01T19:15:55.8089622Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-ca9156b20a565b23.xml (deflated 42%) 2024-11-01T19:15:55.8092649Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-ae1dc1660201c2ff.xml (deflated 35%) 2024-11-01T19:15:55.8095677Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-5c96076a3e2070f3.xml (deflated 35%) 2024-11-01T19:15:55.8098681Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-9e9f1bb6ba3e1749.xml (deflated 35%) 2024-11-01T19:15:55.8101719Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-c2709ec03732d43d.xml (deflated 43%) 2024-11-01T19:15:55.8104753Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-92232b3cfc9ac4b6.xml (deflated 42%) 2024-11-01T19:15:55.8108022Z adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-117982fed49a486a.xml (deflated 35%) 2024-11-01T19:15:55.8111163Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-e7e21a2983080882.xml (deflated 37%) 2024-11-01T19:15:55.8114198Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-79e1e842006afc17.xml (deflated 36%) 2024-11-01T19:15:55.8117271Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-1e27bdb9bc26c3e9.xml (deflated 35%) 2024-11-01T19:15:55.8120498Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-ea887cc9fa01b767.xml (deflated 35%) 2024-11-01T19:15:55.8123586Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-5c9d5faa9632517d.xml (deflated 37%) 2024-11-01T19:15:55.8126675Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-db12bdb358ccf73c.xml (deflated 36%) 2024-11-01T19:15:55.8129721Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-d6f851d42cf2a2de.xml (deflated 35%) 2024-11-01T19:15:55.8132833Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-361ab6fda199e0a1.xml (deflated 34%) 2024-11-01T19:15:55.8135933Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-0f9df889fd06eb4f.xml (deflated 34%) 2024-11-01T19:15:55.8138963Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-d3323a6ab9ee2fcf.xml (deflated 35%) 2024-11-01T19:15:55.8142009Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-be609e123a7d421a.xml (deflated 35%) 2024-11-01T19:15:55.8145042Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-1600c7b32b9c205b.xml (deflated 34%) 2024-11-01T19:15:55.8148097Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-6cabbbaa66e88633.xml (deflated 35%) 2024-11-01T19:15:55.8151511Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-44c15e0b1f6e3b09.xml (deflated 34%) 2024-11-01T19:15:55.8154545Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-0745ccdb7bbbaa77.xml (deflated 34%) 2024-11-01T19:15:55.8157593Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-258040a382782afd.xml (deflated 36%) 2024-11-01T19:15:55.8161559Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c79f231bc4dccde0.xml (deflated 36%) 2024-11-01T19:15:55.8164663Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-685a29ba4fa8c2c6.xml (deflated 36%) 2024-11-01T19:15:55.8167754Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-19754f57bdccf3ce.xml (deflated 37%) 2024-11-01T19:15:55.8170869Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-2f6ccb132cd6c567.xml (deflated 36%) 2024-11-01T19:15:55.8173998Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-f25389e1da9f5049.xml (deflated 35%) 2024-11-01T19:15:55.8177088Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-5f7a1115c01cb148.xml (deflated 34%) 2024-11-01T19:15:55.8180185Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-3375b6617535f4a8.xml (deflated 33%) 2024-11-01T19:15:55.8183502Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_comm_hooks/distributed.fsdp.test_fsdp_comm_hooks-05af0172ee7f5f88.xml (deflated 94%) 2024-11-01T19:15:55.8187284Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fine_tune/distributed.fsdp.test_fsdp_fine_tune-8bb7fe3811a3e230.xml (deflated 64%) 2024-11-01T19:15:55.8190718Z adding: test/test-reports/python-pytest/distributed.test_data_parallel/distributed.test_data_parallel-873be56f44db1f8c.xml (deflated 94%) 2024-11-01T19:15:55.8194424Z adding: test/test-reports/python-pytest/distributed._shard.sharding_spec.test_sharding_spec/distributed._shard.sharding_spec.test_sharding_spec-03b7cea0cbae5443.xml (deflated 83%) 2024-11-01T19:15:55.8198082Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_meta/distributed.fsdp.test_fsdp_meta-bfe31055c49168ee.xml (deflated 90%) 2024-11-01T19:15:55.8201822Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_unshard_params/distributed.fsdp.test_fsdp_unshard_params-e93507fba302b6c5.xml (deflated 90%) 2024-11-01T19:15:55.8205607Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b3204b08177ec460.xml (deflated 41%) 2024-11-01T19:15:55.8209538Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1c6f878de2f0efff.xml (deflated 41%) 2024-11-01T19:15:55.8212763Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b9841d95a1a77832.xml (deflated 41%) 2024-11-01T19:15:55.8214986Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-64b07c968b3264eb.xml (deflated 41%) 2024-11-01T19:15:55.8217190Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c10be796fa3e91b1.xml (deflated 41%) 2024-11-01T19:15:55.8219444Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-71cade66194c28c3.xml (deflated 41%) 2024-11-01T19:15:55.8221643Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7bd03e2e0386918c.xml (deflated 41%) 2024-11-01T19:15:55.8223821Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6fcea1ef49b6cc8c.xml (deflated 41%) 2024-11-01T19:15:55.8225975Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-02015c7e95be5c34.xml (deflated 43%) 2024-11-01T19:15:55.8228155Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0c7e2bda1b6f1eb1.xml (deflated 41%) 2024-11-01T19:15:55.8230438Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6f9b0bfd9dcc997f.xml (deflated 41%) 2024-11-01T19:15:55.8232667Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bd235cff0e3abf42.xml (deflated 42%) 2024-11-01T19:15:55.8234886Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9dde0a62c8f5f23c.xml (deflated 42%) 2024-11-01T19:15:55.8237063Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9f4cf44cb5683245.xml (deflated 42%) 2024-11-01T19:15:55.8239228Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d0671443b20d61ea.xml (deflated 42%) 2024-11-01T19:15:55.8241443Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f5658251091ad4ee.xml (deflated 42%) 2024-11-01T19:15:55.8243749Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b813a860aca32c1d.xml (deflated 42%) 2024-11-01T19:15:55.8245981Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-de5d2c1c502f9dba.xml (deflated 42%) 2024-11-01T19:15:55.8248240Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-af9074099d3bbf7f.xml (deflated 42%) 2024-11-01T19:15:55.8250637Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6b361ac518ed910c.xml (deflated 42%) 2024-11-01T19:15:55.8252942Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d1220be3140d586e.xml (deflated 42%) 2024-11-01T19:15:55.8255151Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d8b0f4c13cb84c97.xml (deflated 42%) 2024-11-01T19:15:55.8257353Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-644fda196dd9f14a.xml (deflated 42%) 2024-11-01T19:15:55.8259727Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-fd90c9f7c8b1f7d0.xml (deflated 42%) 2024-11-01T19:15:55.8261914Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-5551626e897aea10.xml (deflated 42%) 2024-11-01T19:15:55.8264110Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d85db075a55de01c.xml (deflated 41%) 2024-11-01T19:15:55.8266320Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-dac411d9761f0e01.xml (deflated 42%) 2024-11-01T19:15:55.8268584Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-22fd4fe9d67d8e21.xml (deflated 42%) 2024-11-01T19:15:55.8270808Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f0a4d0bd9bcd6c1e.xml (deflated 42%) 2024-11-01T19:15:55.8273055Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0e28a1ccb9fd6a5f.xml (deflated 36%) 2024-11-01T19:15:55.8275263Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6c39ec49948e191e.xml (deflated 42%) 2024-11-01T19:15:55.8277473Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-55596418876791b6.xml (deflated 42%) 2024-11-01T19:15:55.8279652Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ae0b1cf7c4025cb2.xml (deflated 42%) 2024-11-01T19:15:55.8281842Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f9c1d4c8976eeeb2.xml (deflated 42%) 2024-11-01T19:15:55.8284053Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2d0e2eaed2bc9544.xml (deflated 42%) 2024-11-01T19:15:55.8286269Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-fc1e20a7f2cd9f09.xml (deflated 42%) 2024-11-01T19:15:55.8288511Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b844d9b8dd14f535.xml (deflated 41%) 2024-11-01T19:15:55.8290732Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9cce11eb44d046f9.xml (deflated 41%) 2024-11-01T19:15:55.8293109Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-50efc9d50f8dd30e.xml (deflated 41%) 2024-11-01T19:15:55.8295340Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f91d0cfbe6de0f3c.xml (deflated 41%) 2024-11-01T19:15:55.8297534Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3f71630580254c12.xml (deflated 41%) 2024-11-01T19:15:55.8299817Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bf1d9edac2b724f3.xml (deflated 41%) 2024-11-01T19:15:55.8302035Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-5ea61bab3e4f7846.xml (deflated 42%) 2024-11-01T19:15:55.8304253Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-de3bb74df2777d86.xml (deflated 41%) 2024-11-01T19:15:55.8306445Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f6db44a11dfd5cc0.xml (deflated 41%) 2024-11-01T19:15:55.8308700Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d44ab1d4f75e7c7d.xml (deflated 41%) 2024-11-01T19:15:55.8310689Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8889b8540293c256.xml (deflated 42%) 2024-11-01T19:15:55.8312648Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9e002061295d2717.xml (deflated 42%) 2024-11-01T19:15:55.8314626Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-39df863f284e88d4.xml (deflated 41%) 2024-11-01T19:15:55.8316588Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f4b6108de5627216.xml (deflated 41%) 2024-11-01T19:15:55.8318536Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-91badc381a7cd44c.xml (deflated 41%) 2024-11-01T19:15:55.8320509Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8f6a81a5a2309537.xml (deflated 42%) 2024-11-01T19:15:55.8322476Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-975e4531ff2168ad.xml (deflated 42%) 2024-11-01T19:15:55.8324632Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a53fe42c8f993936.xml (deflated 42%) 2024-11-01T19:15:55.8326582Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b0779312893c1915.xml (deflated 42%) 2024-11-01T19:15:55.8328541Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a8133a30ff18ff89.xml (deflated 42%) 2024-11-01T19:15:55.8330492Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e949cb2eb4205869.xml (deflated 42%) 2024-11-01T19:15:55.8332454Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-df7c262320e44c79.xml (deflated 42%) 2024-11-01T19:15:55.8334408Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e7b857176df783fa.xml (deflated 42%) 2024-11-01T19:15:55.8336497Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-4e46c3ca43d2e35c.xml (deflated 42%) 2024-11-01T19:15:55.8338469Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a45e7b1d30f9eb4c.xml (deflated 42%) 2024-11-01T19:15:55.8340424Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bfcf2f57502a1bb6.xml (deflated 42%) 2024-11-01T19:15:55.8342457Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a3268ebdd37ee70d.xml (deflated 42%) 2024-11-01T19:15:55.8344413Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ee710de32584300c.xml (deflated 42%) 2024-11-01T19:15:55.8346382Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-50e1a44e956c9560.xml (deflated 42%) 2024-11-01T19:15:55.8348641Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ad28e981770df1fc.xml (deflated 42%) 2024-11-01T19:15:55.8350625Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9abb894678469f37.xml (deflated 42%) 2024-11-01T19:15:55.8352583Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-cb060a8d62d590ff.xml (deflated 42%) 2024-11-01T19:15:55.8354556Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-781c2765cfed200f.xml (deflated 42%) 2024-11-01T19:15:55.8356518Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-afeb4a8c0c3c3b30.xml (deflated 42%) 2024-11-01T19:15:55.8358486Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-60de6f43d89fc232.xml (deflated 42%) 2024-11-01T19:15:55.8360618Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b525f4ef2c777527.xml (deflated 42%) 2024-11-01T19:15:55.8362577Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3465157c15996753.xml (deflated 42%) 2024-11-01T19:15:55.8364534Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8a18d2141b22a40e.xml (deflated 42%) 2024-11-01T19:15:55.8366499Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1a0ffeac1341258d.xml (deflated 42%) 2024-11-01T19:15:55.8368466Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3eea46af145a23ca.xml (deflated 42%) 2024-11-01T19:15:55.8370428Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-97e2060884fc6546.xml (deflated 42%) 2024-11-01T19:15:55.8372388Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-af186afe93e013a6.xml (deflated 41%) 2024-11-01T19:15:55.8374360Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-760171d6b5b5876c.xml (deflated 41%) 2024-11-01T19:15:55.8376325Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9551ec0a085b3745.xml (deflated 41%) 2024-11-01T19:15:55.8378430Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-39df1645c176b031.xml (deflated 41%) 2024-11-01T19:15:55.8380385Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-df155ae4c99d5c69.xml (deflated 41%) 2024-11-01T19:15:55.8382350Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-50b76de47c73c5bc.xml (deflated 41%) 2024-11-01T19:15:55.8384316Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e9382c30ce18e6d5.xml (deflated 41%) 2024-11-01T19:15:55.8386399Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2c53d207fe8161ae.xml (deflated 41%) 2024-11-01T19:15:55.8388371Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bbbfcb321368694f.xml (deflated 41%) 2024-11-01T19:15:55.8390402Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8c1db0a607e6ab89.xml (deflated 41%) 2024-11-01T19:15:55.8392441Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d647ad400f554d08.xml (deflated 41%) 2024-11-01T19:15:55.8394398Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1420ee5131117492.xml (deflated 41%) 2024-11-01T19:15:55.8396361Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-83c5a553f486b086.xml (deflated 41%) 2024-11-01T19:15:55.8398314Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-44c08853c70bca22.xml (deflated 41%) 2024-11-01T19:15:55.8400275Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-360898a9bbe207cd.xml (deflated 41%) 2024-11-01T19:15:55.8402218Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-86a0820261773e43.xml (deflated 41%) 2024-11-01T19:15:55.8404165Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9268709f18c97854.xml (deflated 41%) 2024-11-01T19:15:55.8406121Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-5718b8c1c434c00a.xml (deflated 42%) 2024-11-01T19:15:55.8408075Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-156dbabd646218c3.xml (deflated 42%) 2024-11-01T19:15:55.8410047Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3d45ba5305db23cf.xml (deflated 42%) 2024-11-01T19:15:55.8412011Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-71ca9d319209747b.xml (deflated 43%) 2024-11-01T19:15:55.8413973Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b891688640891607.xml (deflated 42%) 2024-11-01T19:15:55.8415866Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-33a6b492d1202e89.xml (deflated 36%) 2024-11-01T19:15:55.8417690Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-610d325a532df729.xml (deflated 36%) 2024-11-01T19:15:55.8419617Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a07842b61a385e2e.xml (deflated 36%) 2024-11-01T19:15:55.8421446Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef71a94e85b4cc04.xml (deflated 35%) 2024-11-01T19:15:55.8423285Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2ef719583e483635.xml (deflated 36%) 2024-11-01T19:15:55.8425118Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-957ebce8c0bb06f6.xml (deflated 35%) 2024-11-01T19:15:55.8427031Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-21eb6e2a340d2f5c.xml (deflated 36%) 2024-11-01T19:15:55.8428937Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c9619a66bdc6424e.xml (deflated 35%) 2024-11-01T19:15:55.8430876Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0cdf0bd06d9e8cac.xml (deflated 35%) 2024-11-01T19:15:55.8432716Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bb9351ecbb76cd15.xml (deflated 35%) 2024-11-01T19:15:55.8434547Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-377b9a4912427fba.xml (deflated 36%) 2024-11-01T19:15:55.8436367Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ca548fdc381f94e.xml (deflated 35%) 2024-11-01T19:15:55.8438177Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f1b7200219ebd2c1.xml (deflated 36%) 2024-11-01T19:15:55.8440005Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1557588973899cc1.xml (deflated 36%) 2024-11-01T19:15:55.8441917Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4dbadbab0aaee609.xml (deflated 36%) 2024-11-01T19:15:55.8443750Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a202a9d4f26cfda7.xml (deflated 35%) 2024-11-01T19:15:55.8445579Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-288a7b2a5db52b3a.xml (deflated 35%) 2024-11-01T19:15:55.8447406Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a814c145b2c58633.xml (deflated 35%) 2024-11-01T19:15:55.8449540Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8c774fa1f7631150.xml (deflated 35%) 2024-11-01T19:15:55.8451381Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8b1ed4dcf83e9312.xml (deflated 35%) 2024-11-01T19:15:55.8453202Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-70b3b6ab127d08aa.xml (deflated 35%) 2024-11-01T19:15:55.8455022Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e4aba8880f3610e7.xml (deflated 36%) 2024-11-01T19:15:55.8456826Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fc26a7f8db39d370.xml (deflated 35%) 2024-11-01T19:15:55.8458651Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a6a403fb88d5c1c1.xml (deflated 36%) 2024-11-01T19:15:55.8460727Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3ab7a8d8d290f5b3.xml (deflated 35%) 2024-11-01T19:15:55.8462825Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d939907cb37374e5.xml (deflated 36%) 2024-11-01T19:15:55.8464668Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-041a362e90d6a76e.xml (deflated 35%) 2024-11-01T19:15:55.8466494Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7489d68f0e297d45.xml (deflated 35%) 2024-11-01T19:15:55.8468507Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-821a8e3962c73b40.xml (deflated 36%) 2024-11-01T19:15:55.8470348Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bbebc4786e15f1f6.xml (deflated 36%) 2024-11-01T19:15:55.8472194Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-73f493c04d9ecf1e.xml (deflated 36%) 2024-11-01T19:15:55.8474023Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-57fb4008bba4558c.xml (deflated 35%) 2024-11-01T19:15:55.8475850Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d7de28f18a1d8e5.xml (deflated 35%) 2024-11-01T19:15:55.8477681Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-440bf8de9d695ce7.xml (deflated 35%) 2024-11-01T19:15:55.8479513Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f5437109fa9cfed0.xml (deflated 35%) 2024-11-01T19:15:55.8481341Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e5bf06502ac323c0.xml (deflated 35%) 2024-11-01T19:15:55.8483187Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9da30f9a03e713b3.xml (deflated 36%) 2024-11-01T19:15:55.8485027Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2db1c4a1c487a9bf.xml (deflated 35%) 2024-11-01T19:15:55.8486855Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-476a73dd4402857d.xml (deflated 36%) 2024-11-01T19:15:55.8488714Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6ab87e2c6986477e.xml (deflated 35%) 2024-11-01T19:15:55.8490540Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8414c2d9f39d2cf8.xml (deflated 36%) 2024-11-01T19:15:55.8492346Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b13a02a74e55fa7.xml (deflated 36%) 2024-11-01T19:15:55.8494171Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1c7fc09b3dd9ecf4.xml (deflated 36%) 2024-11-01T19:15:55.8495998Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a44a4923e8cf7a91.xml (deflated 37%) 2024-11-01T19:15:55.8497826Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cd463f009b3e41cb.xml (deflated 36%) 2024-11-01T19:15:55.8499651Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a6e877d939cfcb05.xml (deflated 36%) 2024-11-01T19:15:55.8501467Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-134b919ad33b167e.xml (deflated 35%) 2024-11-01T19:15:55.8503375Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3721d37d49e5ac32.xml (deflated 36%) 2024-11-01T19:15:55.8505196Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-acfc30abf585061d.xml (deflated 36%) 2024-11-01T19:15:55.8507017Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-58914d72bc8ea7b5.xml (deflated 36%) 2024-11-01T19:15:55.8508891Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-810b98f88eec318c.xml (deflated 35%) 2024-11-01T19:15:55.8510779Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e48a723ba087717f.xml (deflated 36%) 2024-11-01T19:15:55.8512589Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-666757847d3beb2c.xml (deflated 36%) 2024-11-01T19:15:55.8514411Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0e355648be9e4ad0.xml (deflated 35%) 2024-11-01T19:15:55.8516242Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6dcbb8e4ed889670.xml (deflated 35%) 2024-11-01T19:15:55.8518070Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-de6808b3228dc28f.xml (deflated 36%) 2024-11-01T19:15:55.8519895Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-80ced6827e030ff0.xml (deflated 36%) 2024-11-01T19:15:55.8521709Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a821f0362b57563d.xml (deflated 37%) 2024-11-01T19:15:55.8523541Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-55e65b8eb8d19fcd.xml (deflated 35%) 2024-11-01T19:15:55.8525366Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a1eda90d3e5b9cd.xml (deflated 35%) 2024-11-01T19:15:55.8527191Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-04a0589ffb2a7617.xml (deflated 36%) 2024-11-01T19:15:55.8528997Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a86d5bc9266fdf9b.xml (deflated 35%) 2024-11-01T19:15:55.8530834Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0dd6c7ad88a2dde9.xml (deflated 36%) 2024-11-01T19:15:55.8532658Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-18e7cf3ffe20967e.xml (deflated 35%) 2024-11-01T19:15:55.8534485Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fb8469d70f8eba6e.xml (deflated 35%) 2024-11-01T19:15:55.8536315Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f89dbbde1cab278.xml (deflated 35%) 2024-11-01T19:15:55.8538143Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a6a739d31661f58.xml (deflated 35%) 2024-11-01T19:15:55.8539961Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-64b401874046ee5d.xml (deflated 35%) 2024-11-01T19:15:55.8541796Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fe35ebfcca67bcf2.xml (deflated 34%) 2024-11-01T19:15:55.8543632Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-01616ac6d4b05f5b.xml (deflated 35%) 2024-11-01T19:15:55.8545549Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a38a349781bd1f1a.xml (deflated 34%) 2024-11-01T19:15:55.8547380Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a5a82d2cd5b7b81e.xml (deflated 35%) 2024-11-01T19:15:55.8549584Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cd4b27293330b9da.xml (deflated 34%) 2024-11-01T19:15:55.8551513Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2b12dd1edb7ee6df.xml (deflated 36%) 2024-11-01T19:15:55.8553341Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-04a3610db3d64d94.xml (deflated 34%) 2024-11-01T19:15:55.8555176Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-56b8c22149d08c15.xml (deflated 35%) 2024-11-01T19:15:55.8556998Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b45fd31849fe5e2e.xml (deflated 35%) 2024-11-01T19:15:55.8558810Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26e94956d7f29e1f.xml (deflated 34%) 2024-11-01T19:15:55.8560836Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a46ab439b37e3890.xml (deflated 36%) 2024-11-01T19:15:55.8562663Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1318e7d39cf17895.xml (deflated 35%) 2024-11-01T19:15:55.8564467Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6227c318413ce30f.xml (deflated 35%) 2024-11-01T19:15:55.8566291Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6394e8fc481e2eef.xml (deflated 36%) 2024-11-01T19:15:55.8568117Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0698dfd2986ce608.xml (deflated 35%) 2024-11-01T19:15:55.8570014Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b4190e12fbe3b1f.xml (deflated 35%) 2024-11-01T19:15:55.8571841Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0869cafd0aac1b21.xml (deflated 35%) 2024-11-01T19:15:55.8573668Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c2b8df755dbabacb.xml (deflated 34%) 2024-11-01T19:15:55.8575491Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-25463ffb51f8e32b.xml (deflated 35%) 2024-11-01T19:15:55.8577304Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-afc2003026918e03.xml (deflated 35%) 2024-11-01T19:15:55.8579116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6a55881183b06b94.xml (deflated 34%) 2024-11-01T19:15:55.8580925Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-51d0fcc19571b687.xml (deflated 35%) 2024-11-01T19:15:55.8582744Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b987e827a6bddf1a.xml (deflated 35%) 2024-11-01T19:15:55.8584568Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1e2423588361dce8.xml (deflated 35%) 2024-11-01T19:15:55.8586553Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-99b20019cc0634e2.xml (deflated 35%) 2024-11-01T19:15:55.8588365Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-35bce4d4a0582732.xml (deflated 35%) 2024-11-01T19:15:55.8590273Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c06e3c9cc64af8f9.xml (deflated 35%) 2024-11-01T19:15:55.8592093Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a0921130d526632.xml (deflated 35%) 2024-11-01T19:15:55.8594012Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7ec88d43efb9cfb1.xml (deflated 34%) 2024-11-01T19:15:55.8595841Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c497fb2a3a1d479e.xml (deflated 34%) 2024-11-01T19:15:55.8597669Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-daa42b0bc8181a60.xml (deflated 35%) 2024-11-01T19:15:55.8599486Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ae7d01c58a416197.xml (deflated 35%) 2024-11-01T19:15:55.8601293Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a7909f67b1f81e1.xml (deflated 37%) 2024-11-01T19:15:55.8603116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ec81ade38a242a2a.xml (deflated 36%) 2024-11-01T19:15:55.8604912Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5be831d019a7e9be.xml (deflated 55%) 2024-11-01T19:15:55.8606774Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2252d13d0dce4b5c.xml (deflated 55%) 2024-11-01T19:15:55.8608598Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab1159d8a741f39d.xml (deflated 34%) 2024-11-01T19:15:55.8610425Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3fad0bea38cabca.xml (deflated 37%) 2024-11-01T19:15:55.8612247Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eee7728deba2a517.xml (deflated 37%) 2024-11-01T19:15:55.8614066Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-95c826e3bc89523d.xml (deflated 37%) 2024-11-01T19:15:55.8615881Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-464f39a7ee257868.xml (deflated 36%) 2024-11-01T19:15:55.8617704Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-970dee3c00b873c1.xml (deflated 37%) 2024-11-01T19:15:55.8619510Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-33beac9940f87ea4.xml (deflated 37%) 2024-11-01T19:15:55.8621311Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5f53c4d7f0776d6b.xml (deflated 37%) 2024-11-01T19:15:55.8623127Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ac31f5ea49c67c8f.xml (deflated 37%) 2024-11-01T19:15:55.8624947Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-31c6c621896ed16b.xml (deflated 36%) 2024-11-01T19:15:55.8626829Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a46409c70760558.xml (deflated 37%) 2024-11-01T19:15:55.8628728Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-03166bdc9dc66404.xml (deflated 36%) 2024-11-01T19:15:55.8630542Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-08986f1e949a1565.xml (deflated 37%) 2024-11-01T19:15:55.8632355Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-27a27317ddcdc337.xml (deflated 36%) 2024-11-01T19:15:55.8634257Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2df218cbe0417a63.xml (deflated 37%) 2024-11-01T19:15:55.8636068Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-87851f626d68d92b.xml (deflated 36%) 2024-11-01T19:15:55.8637876Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-96335f5ad436d514.xml (deflated 37%) 2024-11-01T19:15:55.8639673Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-299b485b877bfa8e.xml (deflated 36%) 2024-11-01T19:15:55.8641476Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-60a0fb53c72b2d20.xml (deflated 35%) 2024-11-01T19:15:55.8643290Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-107973da192a92db.xml (deflated 36%) 2024-11-01T19:15:55.8645109Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-51e27b282d11a742.xml (deflated 36%) 2024-11-01T19:15:55.8646929Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3aac21d2e6ca483.xml (deflated 36%) 2024-11-01T19:15:55.8649070Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f42e83b000744902.xml (deflated 35%) 2024-11-01T19:15:55.8650895Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f4c3875b2f38d31e.xml (deflated 36%) 2024-11-01T19:15:55.8652713Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab8d3b732c52c9c8.xml (deflated 35%) 2024-11-01T19:15:55.8654546Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b653080f833283bf.xml (deflated 36%) 2024-11-01T19:15:55.8656359Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ec76c6c634ab0aa8.xml (deflated 35%) 2024-11-01T19:15:55.8658167Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e76907372b17dda0.xml (deflated 35%) 2024-11-01T19:15:55.8660173Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8f2e31b348dda801.xml (deflated 35%) 2024-11-01T19:15:55.8661987Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-689333d696379c88.xml (deflated 36%) 2024-11-01T19:15:55.8663819Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3b5ffb754c4b4a44.xml (deflated 35%) 2024-11-01T19:15:55.8665641Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-248461bbdb5f8249.xml (deflated 35%) 2024-11-01T19:15:55.8667448Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-efe030f771935a9e.xml (deflated 36%) 2024-11-01T19:15:55.8669487Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-844b4df945872522.xml (deflated 35%) 2024-11-01T19:15:55.8671308Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a05694742acb68c5.xml (deflated 35%) 2024-11-01T19:15:55.8673126Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f2dcb8c5e3b60b0d.xml (deflated 36%) 2024-11-01T19:15:55.8675020Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-392f8e3995708e3d.xml (deflated 35%) 2024-11-01T19:15:55.8676825Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3090a26d40a2a66d.xml (deflated 35%) 2024-11-01T19:15:55.8678655Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-865f57241e0f9d81.xml (deflated 36%) 2024-11-01T19:15:55.8680470Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-15c729eb3663cb6d.xml (deflated 35%) 2024-11-01T19:15:55.8682291Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e19d230598af7e58.xml (deflated 36%) 2024-11-01T19:15:55.8684103Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c2bc180fb069c25e.xml (deflated 36%) 2024-11-01T19:15:55.8685934Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e9fa3bfd6bb08381.xml (deflated 35%) 2024-11-01T19:15:55.8687745Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4c3348bb45e8fefb.xml (deflated 36%) 2024-11-01T19:15:55.8689558Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5d146644ee08d147.xml (deflated 36%) 2024-11-01T19:15:55.8691361Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-efc500cccc5ff428.xml (deflated 35%) 2024-11-01T19:15:55.8693170Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-861e18eb014ed2b5.xml (deflated 35%) 2024-11-01T19:15:55.8694984Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e4322df47f8e4541.xml (deflated 36%) 2024-11-01T19:15:55.8696812Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72ce00bbfdeb8d31.xml (deflated 36%) 2024-11-01T19:15:55.8698638Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-18844d43df5c6b44.xml (deflated 35%) 2024-11-01T19:15:55.8700445Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-04d472112a73b905.xml (deflated 35%) 2024-11-01T19:15:55.8702253Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-aa7613d2d5485b07.xml (deflated 36%) 2024-11-01T19:15:55.8704063Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a9ec165f0501711e.xml (deflated 35%) 2024-11-01T19:15:55.8705891Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eff208c43aa8a577.xml (deflated 36%) 2024-11-01T19:15:55.8707704Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e7ee351d47cbb7ea.xml (deflated 35%) 2024-11-01T19:15:55.8709748Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-627f630a693c1c02.xml (deflated 36%) 2024-11-01T19:15:55.8711576Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-97fc55d9bae4450e.xml (deflated 36%) 2024-11-01T19:15:55.8713385Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-860a32f735af9b89.xml (deflated 35%) 2024-11-01T19:15:55.8715202Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-88dbbdeffe4d94e1.xml (deflated 36%) 2024-11-01T19:15:55.8717106Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3b7a61c6a832eec5.xml (deflated 36%) 2024-11-01T19:15:55.8718922Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-650b9a92d64bb018.xml (deflated 36%) 2024-11-01T19:15:55.8720749Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3b5bae33439ba5c6.xml (deflated 36%) 2024-11-01T19:15:55.8722567Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7d145ff204ab29e9.xml (deflated 36%) 2024-11-01T19:15:55.8724503Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8c86e9dcb670371d.xml (deflated 36%) 2024-11-01T19:15:55.8726320Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d7a984225c84e76.xml (deflated 36%) 2024-11-01T19:15:55.8728125Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c8d336521a2d74f6.xml (deflated 35%) 2024-11-01T19:15:55.8729945Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b1a4746eb123c9f.xml (deflated 35%) 2024-11-01T19:15:55.8731801Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-096aa6d99d781c9b.xml (deflated 35%) 2024-11-01T19:15:55.8733611Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2562ec70d7563d64.xml (deflated 35%) 2024-11-01T19:15:55.8735426Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-644e96cc3ab19b4b.xml (deflated 35%) 2024-11-01T19:15:55.8737255Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bcd64bbf14790d92.xml (deflated 35%) 2024-11-01T19:15:55.8739065Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-151495d2f1e92f62.xml (deflated 35%) 2024-11-01T19:15:55.8740888Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b95deb77885ece6.xml (deflated 35%) 2024-11-01T19:15:55.8742695Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-948688c6bdc2747d.xml (deflated 37%) 2024-11-01T19:15:55.8744511Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fec24d9cfe18546e.xml (deflated 37%) 2024-11-01T19:15:55.8746349Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d87484785fa02279.xml (deflated 34%) 2024-11-01T19:15:55.8748162Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ddfa8a544344a09b.xml (deflated 34%) 2024-11-01T19:15:55.8750462Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a5f549d85d38c448.xml (deflated 35%) 2024-11-01T19:15:55.8752287Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-59131a65d5de1862.xml (deflated 35%) 2024-11-01T19:15:55.8754103Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-77d0ad0fea30c54a.xml (deflated 35%) 2024-11-01T19:15:55.8755915Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b8cd301765283e70.xml (deflated 35%) 2024-11-01T19:15:55.8757804Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-051e4e559bfebc9e.xml (deflated 35%) 2024-11-01T19:15:55.8759811Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75bb630b493eb8e7.xml (deflated 34%) 2024-11-01T19:15:55.8761649Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-222fde73a0f2edaa.xml (deflated 34%) 2024-11-01T19:15:55.8763455Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75edc141bb61fb87.xml (deflated 36%) 2024-11-01T19:15:55.8765269Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2c5b551b806886d8.xml (deflated 35%) 2024-11-01T19:15:55.8767094Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72ac888d935c02ba.xml (deflated 35%) 2024-11-01T19:15:55.8768924Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-512206ce1b3bbda5.xml (deflated 35%) 2024-11-01T19:15:55.8770744Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4bc6f95b56ee2625.xml (deflated 35%) 2024-11-01T19:15:55.8772567Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67ec64fb41d3b842.xml (deflated 36%) 2024-11-01T19:15:55.8774391Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7fe6b170a8be5fa.xml (deflated 36%) 2024-11-01T19:15:55.8776217Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8a5aba171e440982.xml (deflated 35%) 2024-11-01T19:15:55.8778033Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b9d81ca8723ceb9b.xml (deflated 35%) 2024-11-01T19:15:55.8779857Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef3da579f05674f4.xml (deflated 35%) 2024-11-01T19:15:55.8781659Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d4d27757d92b84d5.xml (deflated 35%) 2024-11-01T19:15:55.8783481Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f62decfedb95ecb4.xml (deflated 35%) 2024-11-01T19:15:55.8785302Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c05f9b2a9da6c288.xml (deflated 35%) 2024-11-01T19:15:55.8787134Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eebd91afab72dfdf.xml (deflated 35%) 2024-11-01T19:15:55.8789030Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e5f1ac35d944c07a.xml (deflated 35%) 2024-11-01T19:15:55.8790853Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c0d21e94ad538bd6.xml (deflated 35%) 2024-11-01T19:15:55.8792823Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-39588c8b75119ae9.xml (deflated 35%) 2024-11-01T19:15:55.8794647Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef73cb7761ba1f11.xml (deflated 37%) 2024-11-01T19:15:55.8796455Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1c6053c778b31e78.xml (deflated 36%) 2024-11-01T19:15:55.8798264Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-650a0363cf919ef7.xml (deflated 35%) 2024-11-01T19:15:55.8800154Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2cb9f0fd2f625d9f.xml (deflated 55%) 2024-11-01T19:15:55.8801972Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7f7f88ec0d1349e1.xml (deflated 36%) 2024-11-01T19:15:55.8803788Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-96ca1336b8fcf83b.xml (deflated 35%) 2024-11-01T19:15:55.8805608Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d473759fd902634e.xml (deflated 36%) 2024-11-01T19:15:55.8807430Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40c1f9817db5b4de.xml (deflated 41%) 2024-11-01T19:15:55.8809251Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1426c1037dd75773.xml (deflated 36%) 2024-11-01T19:15:55.8811062Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4f3bd686376e5aa6.xml (deflated 37%) 2024-11-01T19:15:55.8812883Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cda5eb690a90bd21.xml (deflated 37%) 2024-11-01T19:15:55.8814696Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d84ea0b19151979f.xml (deflated 37%) 2024-11-01T19:15:55.8816494Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0ed3037209dd93ee.xml (deflated 37%) 2024-11-01T19:15:55.8818315Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1be440ddf602dcbb.xml (deflated 37%) 2024-11-01T19:15:55.8820149Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e80a4b4cba624258.xml (deflated 37%) 2024-11-01T19:15:55.8821965Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-86486f21887aea3d.xml (deflated 38%) 2024-11-01T19:15:55.8823783Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-feea29219b4c40bc.xml (deflated 37%) 2024-11-01T19:15:55.8825607Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cac64d047e047555.xml (deflated 37%) 2024-11-01T19:15:55.8827411Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6e57032883f0b2e2.xml (deflated 38%) 2024-11-01T19:15:55.8829295Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f861b79eb2b940d4.xml (deflated 36%) 2024-11-01T19:15:55.8831107Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-63c5945e23c67b78.xml (deflated 36%) 2024-11-01T19:15:55.8832991Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9caa27253b82812f.xml (deflated 36%) 2024-11-01T19:15:55.8834788Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-275616fa11bfe9d5.xml (deflated 36%) 2024-11-01T19:15:55.8836601Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5fab0932a2e2b750.xml (deflated 37%) 2024-11-01T19:15:55.8838416Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7eed68af34c33f8.xml (deflated 37%) 2024-11-01T19:15:55.8840327Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f5e2f389efe9e516.xml (deflated 36%) 2024-11-01T19:15:55.8842134Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bdc7a9a7c85e2873.xml (deflated 37%) 2024-11-01T19:15:55.8843947Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-874661a821ad0942.xml (deflated 37%) 2024-11-01T19:15:55.8845753Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bcec9f030146bfe0.xml (deflated 37%) 2024-11-01T19:15:55.8847676Z adding: test/test-reports/python-pytest/distributed.fsdp.test_distributed_checkpoint/distributed.fsdp.test_distributed_checkpoint-9f4577265284bd5f.xml (deflated 77%) 2024-11-01T19:15:55.8850098Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding/distributed._shard.sharded_tensor.ops.test_embedding-c2023642784142d0.xml (deflated 68%) 2024-11-01T19:15:55.8852295Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding_bag/distributed._shard.sharded_tensor.ops.test_embedding_bag-2aaf9ad6e25621e5.xml (deflated 68%) 2024-11-01T19:15:55.8854686Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.test_sharded_tensor_reshard/distributed._shard.sharded_tensor.test_sharded_tensor_reshard-89e8d50f78b83515.xml (deflated 70%) 2024-11-01T19:15:55.8856609Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2f3f05c07747a697.xml (deflated 35%) 2024-11-01T19:15:55.8858173Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-924acc6e083aeb9d.xml (deflated 38%) 2024-11-01T19:15:55.8859915Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0242a3b613b32b7f.xml (deflated 35%) 2024-11-01T19:15:55.8861475Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b48739bf765d6998.xml (deflated 42%) 2024-11-01T19:15:55.8863112Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6631f469781a9e79.xml (deflated 35%) 2024-11-01T19:15:55.8864775Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-72789aff41184dad.xml (deflated 36%) 2024-11-01T19:15:55.8866433Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9a1c48d03ff41ab0.xml (deflated 35%) 2024-11-01T19:15:55.8867990Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b6798d4001dd4d38.xml (deflated 35%) 2024-11-01T19:15:55.8869600Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f2430ba1e268a30f.xml (deflated 35%) 2024-11-01T19:15:55.8871159Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-47fa78a6cb6df21d.xml (deflated 35%) 2024-11-01T19:15:55.8872719Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0eca93d9c27bd526.xml (deflated 43%) 2024-11-01T19:15:55.8874430Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ee3d2103184b6b85.xml (deflated 35%) 2024-11-01T19:15:55.8875985Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-53bb3362162be92e.xml (deflated 43%) 2024-11-01T19:15:55.8877538Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cbb5aaaac0e64c79.xml (deflated 36%) 2024-11-01T19:15:55.8879090Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c2c16c266f7b0864.xml (deflated 35%) 2024-11-01T19:15:55.8880726Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-927b1e879c4e5207.xml (deflated 36%) 2024-11-01T19:15:55.8882265Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b9da7c9c5de0f10c.xml (deflated 36%) 2024-11-01T19:15:55.8883822Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7bdbcafb008d4b5f.xml (deflated 43%) 2024-11-01T19:15:55.8885373Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c739106f47779bcd.xml (deflated 36%) 2024-11-01T19:15:55.8886923Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-49250ed2ceba57b2.xml (deflated 36%) 2024-11-01T19:15:55.8888465Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-be222704faa9b8f4.xml (deflated 43%) 2024-11-01T19:15:55.8890012Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ea9628583bf0634c.xml (deflated 35%) 2024-11-01T19:15:55.8891566Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2d7a3f7bae078c1b.xml (deflated 35%) 2024-11-01T19:15:55.8893112Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9b67e83bf5e6fd95.xml (deflated 43%) 2024-11-01T19:15:55.8894650Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5deb03d07cae9ae9.xml (deflated 35%) 2024-11-01T19:15:55.8896197Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7b890b710b7bb9b4.xml (deflated 36%) 2024-11-01T19:15:55.8897741Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1738396fc8b81a6c.xml (deflated 43%) 2024-11-01T19:15:55.8899278Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4349c29e2ebf2058.xml (deflated 36%) 2024-11-01T19:15:55.8900817Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8226866f8ab3163d.xml (deflated 36%) 2024-11-01T19:15:55.8902368Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a197918dec7ec7a8.xml (deflated 43%) 2024-11-01T19:15:55.8903908Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-34582031307cbae5.xml (deflated 35%) 2024-11-01T19:15:55.8905587Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-be61eba97a7f4fa9.xml (deflated 36%) 2024-11-01T19:15:55.8907165Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-110cbcdbe94a0f28.xml (deflated 36%) 2024-11-01T19:15:55.8908787Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a800ed8b743aaae9.xml (deflated 43%) 2024-11-01T19:15:55.8910349Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-30a8b2190a6c4a40.xml (deflated 35%) 2024-11-01T19:15:55.8911903Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-909a129ddf421cbe.xml (deflated 35%) 2024-11-01T19:15:55.8913448Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-08afc71ebcc660e7.xml (deflated 43%) 2024-11-01T19:15:55.8915090Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-39ae2588a5506246.xml (deflated 36%) 2024-11-01T19:15:55.8916641Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dafd1f55dcd51925.xml (deflated 35%) 2024-11-01T19:15:55.8918207Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-413ab9fb603ff3ca.xml (deflated 35%) 2024-11-01T19:15:55.8919747Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-697631dd05da1273.xml (deflated 36%) 2024-11-01T19:15:55.8921350Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0acbbde253dddcd6.xml (deflated 43%) 2024-11-01T19:15:55.8922896Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-217b4929b91171cb.xml (deflated 36%) 2024-11-01T19:15:55.8924513Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c6e9f0b4291bba26.xml (deflated 42%) 2024-11-01T19:15:55.8926057Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9f5c102f859dde82.xml (deflated 36%) 2024-11-01T19:15:55.8927601Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7dcc7750828cc67f.xml (deflated 35%) 2024-11-01T19:15:55.8929147Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d064a9550c7addad.xml (deflated 47%) 2024-11-01T19:15:55.8930707Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d09ffc00495349a0.xml (deflated 35%) 2024-11-01T19:15:55.8932246Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0f823e89cbdbd8b9.xml (deflated 37%) 2024-11-01T19:15:55.8933800Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-afdf6ee5aad32810.xml (deflated 35%) 2024-11-01T19:15:55.8935330Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d00f3daa0351862.xml (deflated 43%) 2024-11-01T19:15:55.8936874Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6d726b89d4b398b2.xml (deflated 36%) 2024-11-01T19:15:55.8938408Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5d0b8711022168c4.xml (deflated 43%) 2024-11-01T19:15:55.8939937Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7173889e94587ff6.xml (deflated 43%) 2024-11-01T19:15:55.8941479Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8b10fb663cd350e6.xml (deflated 43%) 2024-11-01T19:15:55.8943025Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-842fa99dc4c554b5.xml (deflated 42%) 2024-11-01T19:15:55.8944993Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-208e8718c833267b.xml (deflated 42%) 2024-11-01T19:15:55.8946529Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-896c1e7f75ca5e93.xml (deflated 42%) 2024-11-01T19:15:55.8948063Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a2523e2e3d8536f4.xml (deflated 42%) 2024-11-01T19:15:55.8950004Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fb96ac92b4d3af8b.xml (deflated 42%) 2024-11-01T19:15:55.8951564Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-20d0454514370bf4.xml (deflated 42%) 2024-11-01T19:15:55.8953104Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f1a9c88015466072.xml (deflated 42%) 2024-11-01T19:15:55.8954852Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-942635ebdc577262.xml (deflated 42%) 2024-11-01T19:15:55.8956401Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8918583ba897d117.xml (deflated 42%) 2024-11-01T19:15:55.8957951Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-85445cae8fe83147.xml (deflated 42%) 2024-11-01T19:15:55.8959655Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-17106c6e4f6f916b.xml (deflated 42%) 2024-11-01T19:15:55.8961338Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cf2a5f4454ef8a4b.xml (deflated 42%) 2024-11-01T19:15:55.8962870Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2ae925ee3f2233b6.xml (deflated 42%) 2024-11-01T19:15:55.8964457Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-97a1392116311602.xml (deflated 36%) 2024-11-01T19:15:55.8966136Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c82ac85c7cdc1c12.xml (deflated 43%) 2024-11-01T19:15:55.8967685Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-68132d7ea5fd9594.xml (deflated 36%) 2024-11-01T19:15:55.8969221Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c28a5304d4867185.xml (deflated 36%) 2024-11-01T19:15:55.8970761Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5769de22cc2494c0.xml (deflated 36%) 2024-11-01T19:15:55.8972303Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b1947775fbd2d0a6.xml (deflated 36%) 2024-11-01T19:15:55.8973848Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-da9544198ecb3f6d.xml (deflated 45%) 2024-11-01T19:15:55.8975385Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d95634af4c133bba.xml (deflated 44%) 2024-11-01T19:15:55.8976931Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a131d9687b24209c.xml (deflated 44%) 2024-11-01T19:15:55.8978467Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-82cf5eb062201f37.xml (deflated 43%) 2024-11-01T19:15:55.8980009Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-57e393984f34bcf9.xml (deflated 44%) 2024-11-01T19:15:55.8981561Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0c365ea7f2ca1e00.xml (deflated 44%) 2024-11-01T19:15:55.8983108Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b47563c08c4b7d5c.xml (deflated 44%) 2024-11-01T19:15:55.8984659Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6be8a2b07d3f9fcc.xml (deflated 44%) 2024-11-01T19:15:55.8986212Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3af014af84bfca8f.xml (deflated 37%) 2024-11-01T19:15:55.8987738Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e3799051b869c4b2.xml (deflated 36%) 2024-11-01T19:15:55.8989344Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b66759a93d9a49a0.xml (deflated 36%) 2024-11-01T19:15:55.8990897Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-68d3e3a7badbfd3a.xml (deflated 36%) 2024-11-01T19:15:55.8992445Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-30c5aa4ad5f2533f.xml (deflated 44%) 2024-11-01T19:15:55.8993989Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4084f0c64f336e2f.xml (deflated 35%) 2024-11-01T19:15:55.8995670Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0b7be8d4c7c08f90.xml (deflated 57%) 2024-11-01T19:15:55.8997222Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a14a2ad724df03e6.xml (deflated 37%) 2024-11-01T19:15:55.8998770Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6f8486d1d18472d6.xml (deflated 37%) 2024-11-01T19:15:55.9000293Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c25fe842304c2d0a.xml (deflated 42%) 2024-11-01T19:15:55.9001930Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4b667ce3b6451499.xml (deflated 42%) 2024-11-01T19:15:55.9003464Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9918c9dfa2745f1d.xml (deflated 35%) 2024-11-01T19:15:55.9005020Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-30f5fd325b13e6f6.xml (deflated 36%) 2024-11-01T19:15:55.9006563Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-225ab18ae6643544.xml (deflated 36%) 2024-11-01T19:15:55.9008108Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2b8fabf68865fd84.xml (deflated 37%) 2024-11-01T19:15:55.9009645Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d769d5126e8f4717.xml (deflated 36%) 2024-11-01T19:15:55.9011195Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5afdb50af6849b3e.xml (deflated 38%) 2024-11-01T19:15:55.9012739Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-979a42f51647c133.xml (deflated 35%) 2024-11-01T19:15:55.9014266Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f13035092f010cfb.xml (deflated 36%) 2024-11-01T19:15:55.9015802Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-09f5ef5553b0219d.xml (deflated 44%) 2024-11-01T19:15:55.9017402Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ab4c47e4b923d97a.xml (deflated 44%) 2024-11-01T19:15:55.9018941Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-943e60f40cce0680.xml (deflated 44%) 2024-11-01T19:15:55.9020486Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4fa26de283e66d7c.xml (deflated 43%) 2024-11-01T19:15:55.9022032Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-137f7a23cb6c5d07.xml (deflated 43%) 2024-11-01T19:15:55.9023580Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-50da6e1bffb42a83.xml (deflated 43%) 2024-11-01T19:15:55.9025142Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d3025ded5106cd0b.xml (deflated 43%) 2024-11-01T19:15:55.9026672Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f18f1e11063ce0c5.xml (deflated 43%) 2024-11-01T19:15:55.9028216Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6bf21d4d4be6e563.xml (deflated 43%) 2024-11-01T19:15:55.9029839Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-36effe42a01c9206.xml (deflated 34%) 2024-11-01T19:15:55.9031394Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c484e7dcdb202f35.xml (deflated 34%) 2024-11-01T19:15:55.9032937Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e4494efa36e0fc5a.xml (deflated 34%) 2024-11-01T19:15:55.9034560Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8c96fcf4fff40e8b.xml (deflated 35%) 2024-11-01T19:15:55.9036112Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8db112fc033332cc.xml (deflated 34%) 2024-11-01T19:15:55.9037652Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-34a066bc39083588.xml (deflated 34%) 2024-11-01T19:15:55.9039182Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8f4137c7c0a90416.xml (deflated 34%) 2024-11-01T19:15:55.9040787Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b34ec2a647e8f3a1.xml (deflated 34%) 2024-11-01T19:15:55.9042333Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-afb04c2af4609841.xml (deflated 35%) 2024-11-01T19:15:55.9043883Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2b260489a9440907.xml (deflated 35%) 2024-11-01T19:15:55.9045506Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dffe6e318422fe94.xml (deflated 38%) 2024-11-01T19:15:55.9047202Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-20e2bdf530d3cb3b.xml (deflated 43%) 2024-11-01T19:15:55.9049224Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-05ad540b12e766db.xml (deflated 37%) 2024-11-01T19:15:55.9050927Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bf011da62e1517a.xml (deflated 57%) 2024-11-01T19:15:55.9052614Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6b100abf246c6911.xml (deflated 37%) 2024-11-01T19:15:55.9054279Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c095e3eb2bf083d6.xml (deflated 36%) 2024-11-01T19:15:55.9055964Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2248bd7cf145076b.xml (deflated 37%) 2024-11-01T19:15:55.9057648Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ab1f285d060e4e3d.xml (deflated 36%) 2024-11-01T19:15:55.9059561Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-812079312dc8b0fb.xml (deflated 36%) 2024-11-01T19:15:55.9061255Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd73e296c2a409a8.xml (deflated 35%) 2024-11-01T19:15:55.9062940Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2a192a72a553cf98.xml (deflated 36%) 2024-11-01T19:15:55.9064619Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3924b6ed1a443a83.xml (deflated 36%) 2024-11-01T19:15:55.9066300Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-99b338476d8a564f.xml (deflated 42%) 2024-11-01T19:15:55.9067979Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eeeef5e47d294ba9.xml (deflated 37%) 2024-11-01T19:15:55.9069711Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1796b2c8b937a80d.xml (deflated 37%) 2024-11-01T19:15:55.9071394Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b9ef4cf548741e1.xml (deflated 37%) 2024-11-01T19:15:55.9073079Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e78805a47a0b9fc.xml (deflated 37%) 2024-11-01T19:15:55.9074894Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b5b132effbae33a.xml (deflated 37%) 2024-11-01T19:15:55.9076581Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-679547102c9327ef.xml (deflated 42%) 2024-11-01T19:15:55.9078253Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5eed759e130deb0e.xml (deflated 36%) 2024-11-01T19:15:55.9079935Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98e075f2c04fcf0f.xml (deflated 35%) 2024-11-01T19:15:55.9081687Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5a947edfff2e0274.xml (deflated 36%) 2024-11-01T19:15:55.9083354Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-361309016741f42d.xml (deflated 36%) 2024-11-01T19:15:55.9085044Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4c4d0c3d59db2ee.xml (deflated 36%) 2024-11-01T19:15:55.9086710Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e3b9c33dd358b5c4.xml (deflated 36%) 2024-11-01T19:15:55.9088390Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72e3e6abf245fabf.xml (deflated 36%) 2024-11-01T19:15:55.9090072Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b38bf06691ae36e.xml (deflated 36%) 2024-11-01T19:15:55.9091757Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c9c4c0b15a925755.xml (deflated 36%) 2024-11-01T19:15:55.9093444Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a65ff36aa5fbe110.xml (deflated 36%) 2024-11-01T19:15:55.9095122Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df72af1c3b9f5544.xml (deflated 36%) 2024-11-01T19:15:55.9096803Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8beda70e8e965eb5.xml (deflated 43%) 2024-11-01T19:15:55.9098486Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d72b27e6f0cf29a0.xml (deflated 43%) 2024-11-01T19:15:55.9100156Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-55f876d14fa3e3eb.xml (deflated 36%) 2024-11-01T19:15:55.9101832Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-178b7acb897da76c.xml (deflated 36%) 2024-11-01T19:15:55.9103513Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebba34e2dfa62ed1.xml (deflated 45%) 2024-11-01T19:15:55.9105205Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f04aec1af5043a4.xml (deflated 45%) 2024-11-01T19:15:55.9106879Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-11cd23a5a9160e89.xml (deflated 36%) 2024-11-01T19:15:55.9108621Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ba46e2712978ba24.xml (deflated 35%) 2024-11-01T19:15:55.9110294Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43040f31433267b7.xml (deflated 44%) 2024-11-01T19:15:55.9111966Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f247684f3ff30448.xml (deflated 36%) 2024-11-01T19:15:55.9113642Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be353ac6af74788c.xml (deflated 36%) 2024-11-01T19:15:55.9115389Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-22ec0c7d0e66364f.xml (deflated 36%) 2024-11-01T19:15:55.9117060Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48918eeb5135ef45.xml (deflated 36%) 2024-11-01T19:15:55.9118741Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1add21c1d49cf822.xml (deflated 36%) 2024-11-01T19:15:55.9120432Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc04bf0b3fc0ea6b.xml (deflated 36%) 2024-11-01T19:15:55.9122179Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4134f2b30d93feef.xml (deflated 36%) 2024-11-01T19:15:55.9123862Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cbfe35cc03f3bcea.xml (deflated 36%) 2024-11-01T19:15:55.9125544Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1b6167f217107cba.xml (deflated 36%) 2024-11-01T19:15:55.9127217Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edcabc23d5dded52.xml (deflated 36%) 2024-11-01T19:15:55.9128893Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-18232c06fa557f64.xml (deflated 36%) 2024-11-01T19:15:55.9130544Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6db002655cfe5486.xml (deflated 36%) 2024-11-01T19:15:55.9132221Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e27993af6361712.xml (deflated 36%) 2024-11-01T19:15:55.9133891Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fd7b715aeaec4865.xml (deflated 36%) 2024-11-01T19:15:55.9135574Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e9a5b0333e069244.xml (deflated 36%) 2024-11-01T19:15:55.9137246Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cb41e88962776eef.xml (deflated 36%) 2024-11-01T19:15:55.9138920Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dfe6f21ca0004897.xml (deflated 36%) 2024-11-01T19:15:55.9140605Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3af3cbdc4dbe46a4.xml (deflated 35%) 2024-11-01T19:15:55.9142283Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e68fb88c78a5204b.xml (deflated 35%) 2024-11-01T19:15:55.9143958Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-da69081c22ff7d51.xml (deflated 35%) 2024-11-01T19:15:55.9145625Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e3c01bf7f596d96.xml (deflated 36%) 2024-11-01T19:15:55.9147292Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e30a7d474c6b9781.xml (deflated 36%) 2024-11-01T19:15:55.9149297Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35ca07cf7e33ba08.xml (deflated 36%) 2024-11-01T19:15:55.9150993Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a58438420994122b.xml (deflated 36%) 2024-11-01T19:15:55.9152663Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-637906d7a96a8214.xml (deflated 36%) 2024-11-01T19:15:55.9154330Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1f1b056675f6a96.xml (deflated 36%) 2024-11-01T19:15:55.9156117Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48f73af44aad22d6.xml (deflated 36%) 2024-11-01T19:15:55.9157805Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b31eb7b21dcdb929.xml (deflated 36%) 2024-11-01T19:15:55.9159668Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7d788ceb2d08616.xml (deflated 36%) 2024-11-01T19:15:55.9161469Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0b2a543b95fff8cc.xml (deflated 36%) 2024-11-01T19:15:55.9163150Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80c5ab22948f1277.xml (deflated 36%) 2024-11-01T19:15:55.9164829Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3445fd47b0687fd1.xml (deflated 44%) 2024-11-01T19:15:55.9166494Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-92657669a6b09655.xml (deflated 43%) 2024-11-01T19:15:55.9168163Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-77cef0b119bf3b7a.xml (deflated 44%) 2024-11-01T19:15:55.9169895Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-83d099938d3e706f.xml (deflated 43%) 2024-11-01T19:15:55.9171569Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-446f8191a114febb.xml (deflated 43%) 2024-11-01T19:15:55.9173250Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f3c6297cbe990e63.xml (deflated 43%) 2024-11-01T19:15:55.9174927Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f7ca90ffa4d2246e.xml (deflated 43%) 2024-11-01T19:15:55.9192796Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1582bd022e6a8f46.xml (deflated 44%) 2024-11-01T19:15:55.9194517Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f49ddd3e37c23fb5.xml (deflated 44%) 2024-11-01T19:15:55.9196224Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-256213c04aea9b22.xml (deflated 44%) 2024-11-01T19:15:55.9197928Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-865525f4aa5bbb40.xml (deflated 45%) 2024-11-01T19:15:55.9199619Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a3aa04537315435c.xml (deflated 44%) 2024-11-01T19:15:55.9201300Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5185d2715f750fcf.xml (deflated 44%) 2024-11-01T19:15:55.9202976Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70052c799e020236.xml (deflated 44%) 2024-11-01T19:15:55.9204658Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f58f51bc873c9245.xml (deflated 44%) 2024-11-01T19:15:55.9206334Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-14fe3008712116cd.xml (deflated 44%) 2024-11-01T19:15:55.9208017Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-694b8ec8549b6c74.xml (deflated 44%) 2024-11-01T19:15:55.9209685Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a3b7f36e78e247b.xml (deflated 44%) 2024-11-01T19:15:55.9211552Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25819ca41e0e6621.xml (deflated 45%) 2024-11-01T19:15:55.9213240Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0032070bf20c1a8a.xml (deflated 44%) 2024-11-01T19:15:55.9214928Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-14af2fa3f7052500.xml (deflated 44%) 2024-11-01T19:15:55.9216612Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3372669537d5370e.xml (deflated 44%) 2024-11-01T19:15:55.9218364Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09d14dbde1d6001d.xml (deflated 44%) 2024-11-01T19:15:55.9220047Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2e3521dd1b9d594.xml (deflated 44%) 2024-11-01T19:15:55.9221730Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57ed2ba630f08ab2.xml (deflated 36%) 2024-11-01T19:15:55.9223400Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-61a97424b56b24ee.xml (deflated 36%) 2024-11-01T19:15:55.9225059Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-768a209bad9d8f86.xml (deflated 36%) 2024-11-01T19:15:55.9226734Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-13288f27c88d8b80.xml (deflated 35%) 2024-11-01T19:15:55.9228415Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-64f53a1425738e1f.xml (deflated 35%) 2024-11-01T19:15:55.9230223Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-247969d00e13acec.xml (deflated 35%) 2024-11-01T19:15:55.9231914Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8a1e3c2ad6984d6d.xml (deflated 36%) 2024-11-01T19:15:55.9233586Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6152800210406f59.xml (deflated 36%) 2024-11-01T19:15:55.9235262Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bbce44f78717bc60.xml (deflated 50%) 2024-11-01T19:15:55.9236949Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5dbbae0000675c63.xml (deflated 36%) 2024-11-01T19:15:55.9238639Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5e5c3c2a03040fb.xml (deflated 36%) 2024-11-01T19:15:55.9240309Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a3c44e1dc03e880f.xml (deflated 36%) 2024-11-01T19:15:55.9241979Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-86637527990a109d.xml (deflated 42%) 2024-11-01T19:15:55.9243661Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f542dd1e6e7eb74a.xml (deflated 42%) 2024-11-01T19:15:55.9245342Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8c75cc2fce9865cd.xml (deflated 42%) 2024-11-01T19:15:55.9247022Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48ee686af0d233c6.xml (deflated 42%) 2024-11-01T19:15:55.9248963Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f386ab5bb6c0c6c7.xml (deflated 42%) 2024-11-01T19:15:55.9250658Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4339b944a4dd6c48.xml (deflated 42%) 2024-11-01T19:15:55.9252436Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1cc510f3171bec72.xml (deflated 42%) 2024-11-01T19:15:55.9254121Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1f4f54a65144f3c.xml (deflated 36%) 2024-11-01T19:15:55.9255790Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a6950d70bf651f1.xml (deflated 36%) 2024-11-01T19:15:55.9257475Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e08b84ab77b846c8.xml (deflated 36%) 2024-11-01T19:15:55.9259719Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-121b621d103e7ba9.xml (deflated 36%) 2024-11-01T19:15:55.9261414Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e314d57164d3afd3.xml (deflated 47%) 2024-11-01T19:15:55.9263093Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7207360bd8759680.xml (deflated 47%) 2024-11-01T19:15:55.9264809Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edd49c3033de25c4.xml (deflated 47%) 2024-11-01T19:15:55.9266485Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-555fac8941537b80.xml (deflated 36%) 2024-11-01T19:15:55.9268153Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b4d5350e556c7d1.xml (deflated 36%) 2024-11-01T19:15:55.9269905Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72f0a9b6381736b5.xml (deflated 36%) 2024-11-01T19:15:55.9271563Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-40fcd5586ab3d6d4.xml (deflated 36%) 2024-11-01T19:15:55.9273245Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bfd10ef0311a68d5.xml (deflated 36%) 2024-11-01T19:15:55.9274935Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c834bb98e3c5ff6c.xml (deflated 36%) 2024-11-01T19:15:55.9276623Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d4ceba286c6948a8.xml (deflated 36%) 2024-11-01T19:15:55.9278297Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6518651b58599997.xml (deflated 36%) 2024-11-01T19:15:55.9279967Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-24776c58858e4318.xml (deflated 36%) 2024-11-01T19:15:55.9281642Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d6dd58fb54b90090.xml (deflated 36%) 2024-11-01T19:15:55.9283324Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e67885c98f6b3949.xml (deflated 35%) 2024-11-01T19:15:55.9284997Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72968b67cd9c0119.xml (deflated 36%) 2024-11-01T19:15:55.9286667Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5959adacc844c37e.xml (deflated 43%) 2024-11-01T19:15:55.9288355Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1dbeab70db8ed1d6.xml (deflated 36%) 2024-11-01T19:15:55.9290042Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ffbb6ab8742fa642.xml (deflated 36%) 2024-11-01T19:15:55.9291723Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c5aa8e93aa6a308f.xml (deflated 36%) 2024-11-01T19:15:55.9293534Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5df58f9deb243680.xml (deflated 36%) 2024-11-01T19:15:55.9295217Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f1beb64084c3cf23.xml (deflated 35%) 2024-11-01T19:15:55.9296901Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-56bc879eb878c808.xml (deflated 36%) 2024-11-01T19:15:55.9298660Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-01bf126c51e20c5c.xml (deflated 36%) 2024-11-01T19:15:55.9300340Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f400c77e758c4cc.xml (deflated 48%) 2024-11-01T19:15:55.9302003Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d10df51d105798b6.xml (deflated 36%) 2024-11-01T19:15:55.9303673Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8125c48a5300ef7d.xml (deflated 35%) 2024-11-01T19:15:55.9305355Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-37e0715638e2b539.xml (deflated 35%) 2024-11-01T19:15:55.9307031Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1b2bb32eeb8af0be.xml (deflated 35%) 2024-11-01T19:15:55.9308804Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f4065e33ac04b454.xml (deflated 43%) 2024-11-01T19:15:55.9310479Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b79e1b42076ab330.xml (deflated 36%) 2024-11-01T19:15:55.9312199Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0068b05f984f6e7c.xml (deflated 36%) 2024-11-01T19:15:55.9313874Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a9753520b407c92.xml (deflated 35%) 2024-11-01T19:15:55.9315547Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1af38406f74d418.xml (deflated 36%) 2024-11-01T19:15:55.9317218Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe6fbfe92740af45.xml (deflated 36%) 2024-11-01T19:15:55.9318905Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0029dead0b81b5d7.xml (deflated 36%) 2024-11-01T19:15:55.9320580Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00f525c333f145c3.xml (deflated 36%) 2024-11-01T19:15:55.9322263Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4bad4b968fc3f5c5.xml (deflated 37%) 2024-11-01T19:15:55.9323943Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3736dd1571375eee.xml (deflated 37%) 2024-11-01T19:15:55.9325630Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aa70a49a6ed5f5f6.xml (deflated 37%) 2024-11-01T19:15:55.9327313Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ec10f783b45a6ef7.xml (deflated 37%) 2024-11-01T19:15:55.9328998Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0dd6f45e74478984.xml (deflated 37%) 2024-11-01T19:15:55.9330726Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6997d650a0b12399.xml (deflated 36%) 2024-11-01T19:15:55.9332480Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ce97a0a48024bd9.xml (deflated 36%) 2024-11-01T19:15:55.9334160Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25eda9462d71d0a3.xml (deflated 37%) 2024-11-01T19:15:55.9335840Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48b82f572f280e19.xml (deflated 36%) 2024-11-01T19:15:55.9337527Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b98e90802899e6e7.xml (deflated 36%) 2024-11-01T19:15:55.9339277Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-abaa17f842b5a89d.xml (deflated 44%) 2024-11-01T19:15:55.9340970Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f0e3e1a399366ec0.xml (deflated 43%) 2024-11-01T19:15:55.9342660Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9fdb18cc20eb41e6.xml (deflated 36%) 2024-11-01T19:15:55.9344340Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c204fdc2525373d5.xml (deflated 36%) 2024-11-01T19:15:55.9346015Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c2534e797930246.xml (deflated 36%) 2024-11-01T19:15:55.9347675Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-90ea81fd237608b3.xml (deflated 36%) 2024-11-01T19:15:55.9349715Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d92e59f1e8c2c31b.xml (deflated 36%) 2024-11-01T19:15:55.9351400Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-30c017a1af06da30.xml (deflated 43%) 2024-11-01T19:15:55.9353094Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c70e5abf8fb76478.xml (deflated 36%) 2024-11-01T19:15:55.9354779Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6cea06fffff0e998.xml (deflated 47%) 2024-11-01T19:15:55.9356466Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a6ae1823def657e4.xml (deflated 36%) 2024-11-01T19:15:55.9358147Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ab47a8dcfef7460.xml (deflated 35%) 2024-11-01T19:15:55.9360285Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3758d6d4558aaf85.xml (deflated 35%) 2024-11-01T19:15:55.9361974Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5def6cfca993e6a1.xml (deflated 36%) 2024-11-01T19:15:55.9363644Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f54519398ba380ed.xml (deflated 35%) 2024-11-01T19:15:55.9365318Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0645660e91445998.xml (deflated 36%) 2024-11-01T19:15:55.9367000Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e9cf996af97ddc03.xml (deflated 36%) 2024-11-01T19:15:55.9368681Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b6f0e8a80b51b27.xml (deflated 35%) 2024-11-01T19:15:55.9370369Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1a40c8384ec34a80.xml (deflated 36%) 2024-11-01T19:15:55.9372051Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-812e2e04bbb8d66b.xml (deflated 36%) 2024-11-01T19:15:55.9373905Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f0e393e8eeb6a89.xml (deflated 36%) 2024-11-01T19:15:55.9375597Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d1dde2cd30a3f90.xml (deflated 35%) 2024-11-01T19:15:55.9377263Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1278e3078ee26a42.xml (deflated 36%) 2024-11-01T19:15:55.9378940Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8d716d9c687fde1c.xml (deflated 36%) 2024-11-01T19:15:55.9380771Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-42086a3fe0497db4.xml (deflated 43%) 2024-11-01T19:15:55.9382456Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2fee1eec967a258b.xml (deflated 36%) 2024-11-01T19:15:55.9384141Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eea322665c49626c.xml (deflated 36%) 2024-11-01T19:15:55.9385826Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cc0e8ca1dd571a8b.xml (deflated 36%) 2024-11-01T19:15:55.9387517Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b2389680b21ba53.xml (deflated 36%) 2024-11-01T19:15:55.9389275Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-758cc8408dff7cde.xml (deflated 37%) 2024-11-01T19:15:55.9390963Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-183d0f263eb22ef1.xml (deflated 36%) 2024-11-01T19:15:55.9392616Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c6547c90adbe1f52.xml (deflated 36%) 2024-11-01T19:15:55.9394294Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c9a6457f59a5bb50.xml (deflated 36%) 2024-11-01T19:15:55.9395980Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de45013c8c6fde1b.xml (deflated 35%) 2024-11-01T19:15:55.9397670Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-68f2dff57ebb2e9a.xml (deflated 36%) 2024-11-01T19:15:55.9399346Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0d4716aba010164c.xml (deflated 36%) 2024-11-01T19:15:55.9401034Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-94f15db7003a81a5.xml (deflated 36%) 2024-11-01T19:15:55.9402708Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-40de296dcde2e61c.xml (deflated 36%) 2024-11-01T19:15:55.9404387Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-95298ddd1cc8116a.xml (deflated 37%) 2024-11-01T19:15:55.9406068Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc05377d5433b477.xml (deflated 36%) 2024-11-01T19:15:55.9407731Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32660c1b5559f233.xml (deflated 36%) 2024-11-01T19:15:55.9409410Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2aed9ea4dc352903.xml (deflated 36%) 2024-11-01T19:15:55.9411105Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-59ace4ab4d3f7d6e.xml (deflated 36%) 2024-11-01T19:15:55.9412783Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ef90391b056d547.xml (deflated 37%) 2024-11-01T19:15:55.9414532Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3f319f6e0bc235ab.xml (deflated 36%) 2024-11-01T19:15:55.9416209Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3dce33773801ed04.xml (deflated 36%) 2024-11-01T19:15:55.9417886Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c99f1c7edd5c4b30.xml (deflated 36%) 2024-11-01T19:15:55.9419627Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d42074bcc5b0dee.xml (deflated 36%) 2024-11-01T19:15:55.9421298Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-727fbcf0700f8166.xml (deflated 45%) 2024-11-01T19:15:55.9422968Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2a3b809cc69e1900.xml (deflated 45%) 2024-11-01T19:15:55.9424645Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a77f71f686bf8a8f.xml (deflated 45%) 2024-11-01T19:15:55.9426494Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e93fe257c946d583.xml (deflated 45%) 2024-11-01T19:15:55.9428181Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c05bec21c1ce7646.xml (deflated 45%) 2024-11-01T19:15:55.9429944Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c53e23136ebfa985.xml (deflated 43%) 2024-11-01T19:15:55.9431627Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-41405794ca70db27.xml (deflated 43%) 2024-11-01T19:15:55.9433312Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d7e977e6882f983.xml (deflated 43%) 2024-11-01T19:15:55.9435035Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3247c029b1e0f60e.xml (deflated 36%) 2024-11-01T19:15:55.9436946Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-deda667c3dd9c76e.xml (deflated 36%) 2024-11-01T19:15:55.9438633Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-461e22f47739cd01.xml (deflated 43%) 2024-11-01T19:15:55.9440315Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2fda2580aacb3aba.xml (deflated 43%) 2024-11-01T19:15:55.9441990Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6822f0820fc38973.xml (deflated 36%) 2024-11-01T19:15:55.9443675Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-28ce1b6bc3f4d59a.xml (deflated 36%) 2024-11-01T19:15:55.9445355Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bedc4a6c8613144f.xml (deflated 35%) 2024-11-01T19:15:55.9447024Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9931227c7d38d3b6.xml (deflated 35%) 2024-11-01T19:15:55.9449001Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1187c254638df519.xml (deflated 35%) 2024-11-01T19:15:55.9450686Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a29c73f8e5169b6.xml (deflated 35%) 2024-11-01T19:15:55.9452370Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f7053f4e9e0d9cd5.xml (deflated 35%) 2024-11-01T19:15:55.9454139Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17a3a494336b81e2.xml (deflated 35%) 2024-11-01T19:15:55.9455818Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-03e23a1f21a26e9d.xml (deflated 35%) 2024-11-01T19:15:55.9457570Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-622553ba1f85290f.xml (deflated 35%) 2024-11-01T19:15:55.9459433Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-acba3099cb079558.xml (deflated 35%) 2024-11-01T19:15:55.9461296Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b2a66a109b575170.xml (deflated 36%) 2024-11-01T19:15:55.9462982Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bd226a8ec047a34.xml (deflated 36%) 2024-11-01T19:15:55.9464672Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8661e81140aa5bde.xml (deflated 35%) 2024-11-01T19:15:55.9466355Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ed01aca56d3a92a3.xml (deflated 36%) 2024-11-01T19:15:55.9468113Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3dbe5bcc5fe0ebc4.xml (deflated 36%) 2024-11-01T19:15:55.9469877Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-411314b67bd58890.xml (deflated 35%) 2024-11-01T19:15:55.9471568Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b8ff04fd9896879.xml (deflated 36%) 2024-11-01T19:15:55.9473243Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7bfc0b543e07579a.xml (deflated 36%) 2024-11-01T19:15:55.9474931Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d3a1093ac0defd1.xml (deflated 36%) 2024-11-01T19:15:55.9476616Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d81a5a6e00f5abca.xml (deflated 45%) 2024-11-01T19:15:55.9478298Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-014954b08a20ab4c.xml (deflated 44%) 2024-11-01T19:15:55.9479973Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac8d8e94693573e1.xml (deflated 36%) 2024-11-01T19:15:55.9481658Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51e872f49188eedc.xml (deflated 43%) 2024-11-01T19:15:55.9483329Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6f1530885aa09e62.xml (deflated 43%) 2024-11-01T19:15:55.9484988Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1689568658238a9.xml (deflated 36%) 2024-11-01T19:15:55.9486657Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8d40459b8a2f46e0.xml (deflated 37%) 2024-11-01T19:15:55.9488344Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-958f459d0bb0decd.xml (deflated 36%) 2024-11-01T19:15:55.9490033Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-410b2590890449c4.xml (deflated 36%) 2024-11-01T19:15:55.9491704Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-119653781339efea.xml (deflated 43%) 2024-11-01T19:15:55.9493391Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e37d26ff02aedc11.xml (deflated 42%) 2024-11-01T19:15:55.9495226Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8d1bacda8198d3da.xml (deflated 35%) 2024-11-01T19:15:55.9496912Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d4608963337e9ce.xml (deflated 36%) 2024-11-01T19:15:55.9498581Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e04477847435c762.xml (deflated 36%) 2024-11-01T19:15:55.9500238Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65e017edc26d4647.xml (deflated 36%) 2024-11-01T19:15:55.9501993Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3dd5b436d0de0835.xml (deflated 36%) 2024-11-01T19:15:55.9503673Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f9952a1bbf3e89a2.xml (deflated 36%) 2024-11-01T19:15:55.9505362Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c04c32b84ea3d5c5.xml (deflated 36%) 2024-11-01T19:15:55.9507035Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c51ca6cd84e06c1.xml (deflated 36%) 2024-11-01T19:15:55.9508774Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6bcb13e6a585e154.xml (deflated 41%) 2024-11-01T19:15:55.9510456Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80302c0329682d84.xml (deflated 41%) 2024-11-01T19:15:55.9512131Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f03e7ec82da7b67d.xml (deflated 42%) 2024-11-01T19:15:55.9513806Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f8db2fe391e6c626.xml (deflated 36%) 2024-11-01T19:15:55.9515469Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f055878d34ca9770.xml (deflated 36%) 2024-11-01T19:15:55.9517137Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c50fd40700c55385.xml (deflated 36%) 2024-11-01T19:15:55.9518817Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1c2d9e2be4c14c4.xml (deflated 36%) 2024-11-01T19:15:55.9520499Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee1b103a2f2f70f3.xml (deflated 36%) 2024-11-01T19:15:55.9522179Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25b948072de6abb9.xml (deflated 36%) 2024-11-01T19:15:55.9523844Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0d7a85906fd0654e.xml (deflated 37%) 2024-11-01T19:15:55.9525529Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88bd67b6f2b765ab.xml (deflated 36%) 2024-11-01T19:15:55.9527207Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a0086279f5b8cee.xml (deflated 35%) 2024-11-01T19:15:55.9528886Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db75de9bcb2d8cb1.xml (deflated 35%) 2024-11-01T19:15:55.9530554Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ae6c119bb9f5c7e5.xml (deflated 37%) 2024-11-01T19:15:55.9532235Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-405e5bb777ffb4a6.xml (deflated 36%) 2024-11-01T19:15:55.9533919Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c04be64020bfe1a7.xml (deflated 36%) 2024-11-01T19:15:55.9535676Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f81bbc2959ba19e.xml (deflated 37%) 2024-11-01T19:15:55.9537363Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0fb4f8dbb7a15a1e.xml (deflated 43%) 2024-11-01T19:15:55.9539049Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c6b444b96031cb9.xml (deflated 37%) 2024-11-01T19:15:55.9540779Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-662d9017d1ad0248.xml (deflated 57%) 2024-11-01T19:15:55.9542457Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-330d7e2fe3eca368.xml (deflated 37%) 2024-11-01T19:15:55.9544125Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-754abfe8814543b0.xml (deflated 37%) 2024-11-01T19:15:55.9545784Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ff2bf21221d71dc.xml (deflated 37%) 2024-11-01T19:15:55.9547457Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7fc75f6185fbd0a.xml (deflated 36%) 2024-11-01T19:15:55.9549564Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c1168c68c517b49.xml (deflated 36%) 2024-11-01T19:15:55.9551256Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7df7fef99a10a1ff.xml (deflated 35%) 2024-11-01T19:15:55.9552939Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3dcdc0990b961b07.xml (deflated 35%) 2024-11-01T19:15:55.9554629Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2757f4addf0ad088.xml (deflated 36%) 2024-11-01T19:15:55.9556445Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3b4443990fa1232.xml (deflated 42%) 2024-11-01T19:15:55.9558129Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-92569d1b950f1ce2.xml (deflated 36%) 2024-11-01T19:15:55.9560023Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-947bf6e7882baf5f.xml (deflated 37%) 2024-11-01T19:15:55.9561700Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-97e0efc390c696c3.xml (deflated 36%) 2024-11-01T19:15:55.9563381Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-28bcfb4705a0fc24.xml (deflated 37%) 2024-11-01T19:15:55.9565072Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d9d335ba2074fd01.xml (deflated 37%) 2024-11-01T19:15:55.9566897Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-04691a17c83cbd65.xml (deflated 42%) 2024-11-01T19:15:55.9568613Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cc28f01f1437825b.xml (deflated 36%) 2024-11-01T19:15:55.9570284Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17039c0aee2a3bcc.xml (deflated 35%) 2024-11-01T19:15:55.9571972Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-27b62a74f3a4dab7.xml (deflated 36%) 2024-11-01T19:15:55.9573646Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80d0ef01465e42a8.xml (deflated 36%) 2024-11-01T19:15:55.9575478Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2806d882e5af409b.xml (deflated 36%) 2024-11-01T19:15:55.9577147Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f15b4501da204959.xml (deflated 36%) 2024-11-01T19:15:55.9578826Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-76d62fc8d341dbd5.xml (deflated 36%) 2024-11-01T19:15:55.9580511Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-204e82196c9efec8.xml (deflated 36%) 2024-11-01T19:15:55.9582274Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-409727da5fa75cd2.xml (deflated 36%) 2024-11-01T19:15:55.9583958Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f0be55cf70b7ecf1.xml (deflated 36%) 2024-11-01T19:15:55.9585644Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b924ec428c6ae7a6.xml (deflated 35%) 2024-11-01T19:15:55.9587334Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f98ffefe0d7749ed.xml (deflated 43%) 2024-11-01T19:15:55.9589085Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e940f6e6851f24b9.xml (deflated 43%) 2024-11-01T19:15:55.9590773Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-54ff1c604fba3a1f.xml (deflated 36%) 2024-11-01T19:15:55.9592445Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edcc27913859ada9.xml (deflated 36%) 2024-11-01T19:15:55.9594121Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8bafc010d1b2d94c.xml (deflated 45%) 2024-11-01T19:15:55.9595809Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c9e9e242a5cd80e.xml (deflated 45%) 2024-11-01T19:15:55.9597490Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35224e6665c638bd.xml (deflated 36%) 2024-11-01T19:15:55.9599164Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c22ac5af1e7d2900.xml (deflated 36%) 2024-11-01T19:15:55.9600844Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e5aeb87f762b20a0.xml (deflated 44%) 2024-11-01T19:15:55.9602526Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b80c79bac15be186.xml (deflated 35%) 2024-11-01T19:15:55.9604214Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ff4dd8e66caba98b.xml (deflated 36%) 2024-11-01T19:15:55.9605895Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-29f158a15befd35d.xml (deflated 36%) 2024-11-01T19:15:55.9607554Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c07c4fd94726c3ca.xml (deflated 36%) 2024-11-01T19:15:55.9609229Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bbcb285ae9c79a39.xml (deflated 35%) 2024-11-01T19:15:55.9610912Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f47fb11c3051fe5.xml (deflated 36%) 2024-11-01T19:15:55.9612597Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-319a8452ee11bc6b.xml (deflated 36%) 2024-11-01T19:15:55.9614276Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f455d06fa859d13.xml (deflated 36%) 2024-11-01T19:15:55.9616021Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-801e0f7b06174351.xml (deflated 36%) 2024-11-01T19:15:55.9617697Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c07b75d912571e87.xml (deflated 36%) 2024-11-01T19:15:55.9619366Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-166b0063e56cdbb2.xml (deflated 36%) 2024-11-01T19:15:55.9621031Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-320c866926d7c39d.xml (deflated 37%) 2024-11-01T19:15:55.9622796Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-debc2cc07b5311ac.xml (deflated 36%) 2024-11-01T19:15:55.9624471Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-37511f82c0baf521.xml (deflated 36%) 2024-11-01T19:15:55.9626150Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-838494fcdf9285f0.xml (deflated 35%) 2024-11-01T19:15:55.9627840Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f62ae02eb533c6f5.xml (deflated 35%) 2024-11-01T19:15:55.9629612Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cf8aff9235c73fb1.xml (deflated 36%) 2024-11-01T19:15:55.9631305Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cce2fe12dfbb7e73.xml (deflated 36%) 2024-11-01T19:15:55.9632999Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-21181e4bdfa3dbd4.xml (deflated 36%) 2024-11-01T19:15:55.9634673Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88e4b0c9908b30a5.xml (deflated 35%) 2024-11-01T19:15:55.9636362Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d8336bee097ccb5.xml (deflated 36%) 2024-11-01T19:15:55.9638032Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09b3183f09ace418.xml (deflated 35%) 2024-11-01T19:15:55.9639715Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25c83eca9445016d.xml (deflated 36%) 2024-11-01T19:15:55.9641431Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43eabc29098d767b.xml (deflated 36%) 2024-11-01T19:15:55.9643119Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-86fcb02072d63901.xml (deflated 36%) 2024-11-01T19:15:55.9644788Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c01688ec050d7e91.xml (deflated 36%) 2024-11-01T19:15:55.9646471Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e7039eae303a8124.xml (deflated 35%) 2024-11-01T19:15:55.9648147Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-764bf60234c34015.xml (deflated 36%) 2024-11-01T19:15:55.9650131Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96a02de291c2a804.xml (deflated 36%) 2024-11-01T19:15:55.9651812Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f4155d3239dbe2c3.xml (deflated 36%) 2024-11-01T19:15:55.9653482Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-23a9fb2c9a94ca9e.xml (deflated 36%) 2024-11-01T19:15:55.9655163Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3270882768c32c0f.xml (deflated 43%) 2024-11-01T19:15:55.9656914Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4caaabfde306c453.xml (deflated 43%) 2024-11-01T19:15:55.9658602Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bd3cdf2fbce5c9a.xml (deflated 44%) 2024-11-01T19:15:55.9660511Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db019e2b12206b24.xml (deflated 43%) 2024-11-01T19:15:55.9662182Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-193210a97f2d7d7a.xml (deflated 43%) 2024-11-01T19:15:55.9663968Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca354fe5cd520de4.xml (deflated 43%) 2024-11-01T19:15:55.9665650Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7340f3ea9d7262ed.xml (deflated 43%) 2024-11-01T19:15:55.9667337Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-41e2a4fca35d0a00.xml (deflated 44%) 2024-11-01T19:15:55.9669064Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e0d028bf8f67357d.xml (deflated 44%) 2024-11-01T19:15:55.9670742Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-532cf9e21abae667.xml (deflated 44%) 2024-11-01T19:15:55.9672433Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c8d2fb47ced0a87.xml (deflated 45%) 2024-11-01T19:15:55.9674110Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17297445fca59799.xml (deflated 44%) 2024-11-01T19:15:55.9675794Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98ad2dacb79892e2.xml (deflated 44%) 2024-11-01T19:15:55.9677472Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1cb0ebf98c9e4255.xml (deflated 44%) 2024-11-01T19:15:55.9679141Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a368ad17389afa8.xml (deflated 44%) 2024-11-01T19:15:55.9680808Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6d3777153992e71d.xml (deflated 45%) 2024-11-01T19:15:55.9682474Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-429399fcc2f06102.xml (deflated 44%) 2024-11-01T19:15:55.9684138Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-08debd46415584e6.xml (deflated 44%) 2024-11-01T19:15:55.9685808Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-678f4cd6dab210eb.xml (deflated 45%) 2024-11-01T19:15:55.9687481Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a7f82ca33532dc0.xml (deflated 44%) 2024-11-01T19:15:55.9689154Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ed5f5e6a2529b17.xml (deflated 44%) 2024-11-01T19:15:55.9690837Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d4dfd791ad87adf1.xml (deflated 44%) 2024-11-01T19:15:55.9692524Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-562c7879e8cddec2.xml (deflated 44%) 2024-11-01T19:15:55.9694194Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4fe45f85445037a4.xml (deflated 44%) 2024-11-01T19:15:55.9695963Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-47ef3d2749546f29.xml (deflated 36%) 2024-11-01T19:15:55.9697636Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96a6736b1692e6d9.xml (deflated 36%) 2024-11-01T19:15:55.9699295Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6db626bdaf117749.xml (deflated 36%) 2024-11-01T19:15:55.9700977Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e7ab348e58e0ea53.xml (deflated 35%) 2024-11-01T19:15:55.9702719Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd83fbd4346e0395.xml (deflated 36%) 2024-11-01T19:15:55.9704399Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-04bd1f7f46c7c7b9.xml (deflated 36%) 2024-11-01T19:15:55.9706077Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7973afeeb44634cc.xml (deflated 36%) 2024-11-01T19:15:55.9707759Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-726bc1c5b910e4ac.xml (deflated 36%) 2024-11-01T19:15:55.9709510Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e259c33650c1b77.xml (deflated 50%) 2024-11-01T19:15:55.9711193Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e71a467c611ef99d.xml (deflated 36%) 2024-11-01T19:15:55.9712876Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7db7b38f51b82a59.xml (deflated 35%) 2024-11-01T19:15:55.9714547Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-61e47f78ee4361d9.xml (deflated 36%) 2024-11-01T19:15:55.9716237Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-90b22ed6ba2078dd.xml (deflated 42%) 2024-11-01T19:15:55.9717918Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4606b002c333e200.xml (deflated 42%) 2024-11-01T19:15:55.9719583Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80385176cb44545a.xml (deflated 42%) 2024-11-01T19:15:55.9721244Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-77bcce5ed7e9297d.xml (deflated 42%) 2024-11-01T19:15:55.9722929Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2da70f14ac2cbdc3.xml (deflated 42%) 2024-11-01T19:15:55.9724608Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edd85a9c3e615a83.xml (deflated 42%) 2024-11-01T19:15:55.9726289Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-64dec042c5a12cb0.xml (deflated 42%) 2024-11-01T19:15:55.9727953Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-36bc8af74f1c5137.xml (deflated 36%) 2024-11-01T19:15:55.9729623Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-77a76918fcae30c4.xml (deflated 36%) 2024-11-01T19:15:55.9731303Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1aea6643b1b57db1.xml (deflated 35%) 2024-11-01T19:15:55.9733000Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cc55846affaf5edb.xml (deflated 36%) 2024-11-01T19:15:55.9734672Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-38d93d38d5ab63a1.xml (deflated 47%) 2024-11-01T19:15:55.9736413Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7db06760403cd206.xml (deflated 47%) 2024-11-01T19:15:55.9738099Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cd6b8e068ab9d47d.xml (deflated 47%) 2024-11-01T19:15:55.9739772Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7585e8401adf271.xml (deflated 36%) 2024-11-01T19:15:55.9741444Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1673ba147943c905.xml (deflated 36%) 2024-11-01T19:15:55.9743162Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5d4721cdae2192f.xml (deflated 36%) 2024-11-01T19:15:55.9744839Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe29d0e5944a48ee.xml (deflated 36%) 2024-11-01T19:15:55.9746520Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e5a257457501ddbe.xml (deflated 36%) 2024-11-01T19:15:55.9748200Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3b303bac5e99206.xml (deflated 36%) 2024-11-01T19:15:55.9750205Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-704e0748abdae97b.xml (deflated 35%) 2024-11-01T19:15:55.9751895Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f18d716e5b570d61.xml (deflated 36%) 2024-11-01T19:15:55.9753600Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-68d665c52d0f3898.xml (deflated 36%) 2024-11-01T19:15:55.9755273Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6329451bc95b1f4b.xml (deflated 36%) 2024-11-01T19:15:55.9756949Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2088e5b517fa79c.xml (deflated 36%) 2024-11-01T19:15:55.9758614Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b0dd6320df816b2.xml (deflated 35%) 2024-11-01T19:15:55.9760474Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ac3ced8e22e676d.xml (deflated 43%) 2024-11-01T19:15:55.9762155Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-031040b36767fc1d.xml (deflated 36%) 2024-11-01T19:15:55.9763841Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7b9c79463e3f849e.xml (deflated 36%) 2024-11-01T19:15:55.9765514Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-49c106522726ae5c.xml (deflated 36%) 2024-11-01T19:15:55.9767192Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8c96a259747e243.xml (deflated 36%) 2024-11-01T19:15:55.9768865Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1892a055ed77d24.xml (deflated 36%) 2024-11-01T19:15:55.9770543Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8d0282fd0aa4bdf.xml (deflated 36%) 2024-11-01T19:15:55.9772228Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b6ef429e7fe3047a.xml (deflated 35%) 2024-11-01T19:15:55.9773898Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ea38a49e948476fd.xml (deflated 49%) 2024-11-01T19:15:55.9775574Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e5c97c56d26efb45.xml (deflated 36%) 2024-11-01T19:15:55.9777405Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a6a43d33ea826f1a.xml (deflated 36%) 2024-11-01T19:15:55.9779093Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-148ece32a12532c3.xml (deflated 36%) 2024-11-01T19:15:55.9780767Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be89c0bfc06735b7.xml (deflated 35%) 2024-11-01T19:15:55.9782443Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32e4c9399462b724.xml (deflated 42%) 2024-11-01T19:15:55.9784188Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f8674504ceca6a40.xml (deflated 36%) 2024-11-01T19:15:55.9785864Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32fff44392938d5f.xml (deflated 36%) 2024-11-01T19:15:55.9787554Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39cb154e42f9a5ce.xml (deflated 35%) 2024-11-01T19:15:55.9789315Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e38cfb2bd5abf5c.xml (deflated 36%) 2024-11-01T19:15:55.9790996Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e35a797d17dd3f3.xml (deflated 35%) 2024-11-01T19:15:55.9792696Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9f62ffc6cfe6f626.xml (deflated 36%) 2024-11-01T19:15:55.9794394Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f4bdd6cd645af85.xml (deflated 36%) 2024-11-01T19:15:55.9796083Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c3e30fb1d1bf5a0d.xml (deflated 37%) 2024-11-01T19:15:55.9797769Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-027aa5990968a573.xml (deflated 36%) 2024-11-01T19:15:55.9799445Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5435192db7290cff.xml (deflated 36%) 2024-11-01T19:15:55.9801112Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-38016440c72dc59c.xml (deflated 36%) 2024-11-01T19:15:55.9801936Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8a8a01360173db05.xml (deflated 36%) 2024-11-01T19:15:55.9802762Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-07f0f01bc0220466.xml (deflated 36%) 2024-11-01T19:15:55.9803581Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17ff10f5de3500d7.xml (deflated 36%) 2024-11-01T19:15:55.9804413Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-188c45c59d934ec0.xml (deflated 36%) 2024-11-01T19:15:55.9805230Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be56ab5b0b282e5a.xml (deflated 36%) 2024-11-01T19:15:55.9806059Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-59ef5f88e9f49517.xml (deflated 36%) 2024-11-01T19:15:55.9806883Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9132cb9a1bf7e0ad.xml (deflated 44%) 2024-11-01T19:15:55.9807699Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f00182811c0807a4.xml (deflated 43%) 2024-11-01T19:15:55.9808577Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d5209669e225a135.xml (deflated 36%) 2024-11-01T19:15:55.9809398Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-262e67e230eda89a.xml (deflated 36%) 2024-11-01T19:15:55.9810213Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48692055af0660b0.xml (deflated 35%) 2024-11-01T19:15:55.9811030Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9eea6f04b0dbf2f1.xml (deflated 36%) 2024-11-01T19:15:55.9811925Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dce7673f179f25f0.xml (deflated 36%) 2024-11-01T19:15:55.9812738Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3f52fa972f3329b1.xml (deflated 43%) 2024-11-01T19:15:55.9813571Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b3699cc671acc14.xml (deflated 36%) 2024-11-01T19:15:55.9814389Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2c08496f4c2c913.xml (deflated 47%) 2024-11-01T19:15:55.9815214Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7e87d95392234859.xml (deflated 35%) 2024-11-01T19:15:55.9816021Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9558cd8244276180.xml (deflated 35%) 2024-11-01T19:15:55.9816854Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-60dbb41dea99dcce.xml (deflated 35%) 2024-11-01T19:15:55.9817671Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e429c23d757e627.xml (deflated 36%) 2024-11-01T19:15:55.9818503Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc357ec8b7818ea5.xml (deflated 36%) 2024-11-01T19:15:55.9819323Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-94d431057ea6a813.xml (deflated 36%) 2024-11-01T19:15:55.9820151Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b226e0bdbdabab41.xml (deflated 36%) 2024-11-01T19:15:55.9820967Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-92d904ff2e550cf8.xml (deflated 36%) 2024-11-01T19:15:55.9821783Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c5c9a71c2c864b8.xml (deflated 36%) 2024-11-01T19:15:55.9822611Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6750192300672d8b.xml (deflated 36%) 2024-11-01T19:15:55.9823428Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0218f11fa1b3ba56.xml (deflated 36%) 2024-11-01T19:15:55.9824258Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e6d3cefdae06ba1f.xml (deflated 35%) 2024-11-01T19:15:55.9825064Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6553a29cce95fc94.xml (deflated 36%) 2024-11-01T19:15:55.9825892Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ae72b7badeaa1162.xml (deflated 36%) 2024-11-01T19:15:55.9826714Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f9e2a9656f172b70.xml (deflated 43%) 2024-11-01T19:15:55.9827543Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cabf9cd09f2be707.xml (deflated 36%) 2024-11-01T19:15:55.9828497Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac7b8a32a4fdf9cb.xml (deflated 36%) 2024-11-01T19:15:55.9829337Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9567245ee1b2f39b.xml (deflated 35%) 2024-11-01T19:15:55.9830146Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a3e08fc48c58994.xml (deflated 35%) 2024-11-01T19:15:55.9830970Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd8f09438114270c.xml (deflated 36%) 2024-11-01T19:15:55.9831844Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-117687217e48d29f.xml (deflated 36%) 2024-11-01T19:15:55.9832672Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f4f249246ca1020b.xml (deflated 36%) 2024-11-01T19:15:55.9833476Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0713657011605075.xml (deflated 36%) 2024-11-01T19:15:55.9834305Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-21572f73207abfbf.xml (deflated 35%) 2024-11-01T19:15:55.9835118Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9430a751d8fc740e.xml (deflated 35%) 2024-11-01T19:15:55.9835947Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-453cef184a97ec5b.xml (deflated 36%) 2024-11-01T19:15:55.9836769Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e95aeca92038c6e9.xml (deflated 36%) 2024-11-01T19:15:55.9837582Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-56608e80d504e7c3.xml (deflated 36%) 2024-11-01T19:15:55.9838416Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-62fee2532b5bfcd3.xml (deflated 36%) 2024-11-01T19:15:55.9839228Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-080e7925352d9433.xml (deflated 36%) 2024-11-01T19:15:55.9840053Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e97d0ce50d8c7e09.xml (deflated 36%) 2024-11-01T19:15:55.9840863Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32e2a47d42671e44.xml (deflated 36%) 2024-11-01T19:15:55.9841695Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5e750f8811c75f4.xml (deflated 36%) 2024-11-01T19:15:55.9842507Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-063a96a1e64b369d.xml (deflated 37%) 2024-11-01T19:15:55.9843337Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e5e56e923a11763.xml (deflated 36%) 2024-11-01T19:15:55.9844151Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1502edecb477bf80.xml (deflated 36%) 2024-11-01T19:15:55.9844971Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1505821c16f2680b.xml (deflated 36%) 2024-11-01T19:15:55.9845779Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3935162dc3421049.xml (deflated 36%) 2024-11-01T19:15:55.9846612Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02ae414868c37339.xml (deflated 45%) 2024-11-01T19:15:55.9847424Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-603413bef34e467a.xml (deflated 45%) 2024-11-01T19:15:55.9848304Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cea74e10993549ba.xml (deflated 45%) 2024-11-01T19:15:55.9849417Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-36659de6570b3499.xml (deflated 45%) 2024-11-01T19:15:55.9850245Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bd52116ef1c2efe8.xml (deflated 45%) 2024-11-01T19:15:55.9851064Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cd0ad8a3d3d041a9.xml (deflated 43%) 2024-11-01T19:15:55.9851965Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bfdfbccbef822080.xml (deflated 43%) 2024-11-01T19:15:55.9852807Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ef0c6709be595f8.xml (deflated 43%) 2024-11-01T19:15:55.9853627Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2f4ce24dfaad977.xml (deflated 36%) 2024-11-01T19:15:55.9854454Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5473a8f6b5fe633.xml (deflated 37%) 2024-11-01T19:15:55.9855266Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ca8e7c54a9e12a8.xml (deflated 43%) 2024-11-01T19:15:55.9856097Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c267463bc9a3a328.xml (deflated 44%) 2024-11-01T19:15:55.9856917Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e70e36fc2ae6a64.xml (deflated 36%) 2024-11-01T19:15:55.9857738Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b2a085605e471ebc.xml (deflated 36%) 2024-11-01T19:15:55.9858558Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d92795b43ff5d020.xml (deflated 36%) 2024-11-01T19:15:55.9859577Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50a8ea7130c1ff07.xml (deflated 36%) 2024-11-01T19:15:55.9860399Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b0d4af146f052c4e.xml (deflated 36%) 2024-11-01T19:15:55.9861240Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fa606d61e0ecb560.xml (deflated 35%) 2024-11-01T19:15:55.9862054Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0945f5348cb1cfe3.xml (deflated 35%) 2024-11-01T19:15:55.9862885Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9db56f6ac079f351.xml (deflated 36%) 2024-11-01T19:15:55.9863709Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-da255f7c9dbd889e.xml (deflated 36%) 2024-11-01T19:15:55.9864540Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5534b47f939ea44.xml (deflated 36%) 2024-11-01T19:15:55.9865398Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3abe4f025adf1ee3.xml (deflated 36%) 2024-11-01T19:15:55.9866239Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b18c02dcac5dd76c.xml (deflated 36%) 2024-11-01T19:15:55.9867053Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e060ea3f20e3de61.xml (deflated 36%) 2024-11-01T19:15:55.9867995Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8aced357a40ee0a7.xml (deflated 36%) 2024-11-01T19:15:55.9868891Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-616d18ffb435307f.xml (deflated 36%) 2024-11-01T19:15:55.9869706Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58a5f789c1959541.xml (deflated 36%) 2024-11-01T19:15:55.9870540Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2eda99c1f6e99b5a.xml (deflated 35%) 2024-11-01T19:15:55.9871424Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0982576c637209e2.xml (deflated 37%) 2024-11-01T19:15:55.9872254Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-84f60fb231b929d9.xml (deflated 36%) 2024-11-01T19:15:55.9873075Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8fb6417df4a25edf.xml (deflated 36%) 2024-11-01T19:15:55.9873906Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ae8f8e1cede6a09.xml (deflated 45%) 2024-11-01T19:15:55.9874720Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a0931debb8efcba8.xml (deflated 45%) 2024-11-01T19:15:55.9875550Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc1ecaba8fe967a8.xml (deflated 36%) 2024-11-01T19:15:55.9876375Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac2ec9cb8eb25a3f.xml (deflated 43%) 2024-11-01T19:15:55.9877197Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e36309519c64c252.xml (deflated 43%) 2024-11-01T19:15:55.9878008Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-897f20174259c2a3.xml (deflated 36%) 2024-11-01T19:15:55.9878836Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a887bc23e3931a3f.xml (deflated 36%) 2024-11-01T19:15:55.9879652Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b4e7d718ac6b34ec.xml (deflated 36%) 2024-11-01T19:15:55.9880480Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f2b29ea9a9c38ab.xml (deflated 35%) 2024-11-01T19:15:55.9881296Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2258df5afe12982.xml (deflated 42%) 2024-11-01T19:15:55.9882114Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5f311fbfefe4e96.xml (deflated 42%) 2024-11-01T19:15:55.9882947Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ba8a1822947dfd2.xml (deflated 35%) 2024-11-01T19:15:55.9883768Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a56ab9fb424bad72.xml (deflated 36%) 2024-11-01T19:15:55.9884590Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-04897be10429fad7.xml (deflated 35%) 2024-11-01T19:15:55.9885402Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7b0634c40ae6a46a.xml (deflated 36%) 2024-11-01T19:15:55.9886235Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9debf55d41355b8b.xml (deflated 36%) 2024-11-01T19:15:55.9887052Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fdbbee7177267067.xml (deflated 36%) 2024-11-01T19:15:55.9887933Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-302d84b558bef531.xml (deflated 36%) 2024-11-01T19:15:55.9888758Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7852149c279f8a59.xml (deflated 36%) 2024-11-01T19:15:55.9889581Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-63a0530a0048479a.xml (deflated 41%) 2024-11-01T19:15:55.9890392Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-386d55a080f1b838.xml (deflated 41%) 2024-11-01T19:15:55.9891274Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ee90543080769ab.xml (deflated 42%) 2024-11-01T19:15:55.9892085Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7d17e6c4246a0451.xml (deflated 36%) 2024-11-01T19:15:55.9892921Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad55cb2e663a0e30.xml (deflated 36%) 2024-11-01T19:15:55.9893741Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d094e809b255e7db.xml (deflated 36%) 2024-11-01T19:15:55.9894570Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cc2b96ac9695a242.xml (deflated 36%) 2024-11-01T19:15:55.9895386Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ede68b84a590e754.xml (deflated 36%) 2024-11-01T19:15:55.9896221Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1fa26acfe1405978.xml (deflated 36%) 2024-11-01T19:15:55.9897041Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5daefeadf10cbcd7.xml (deflated 36%) 2024-11-01T19:15:55.9897860Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c2c7dab451774704.xml (deflated 36%) 2024-11-01T19:15:55.9898688Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-44c73288d983faaf.xml (deflated 36%) 2024-11-01T19:15:55.9899495Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09f4078d4611273a.xml (deflated 36%) 2024-11-01T19:15:55.9900326Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cbbbc64051f9e449.xml (deflated 37%) 2024-11-01T19:15:55.9901148Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2b28bf52d2ca7a2.xml (deflated 36%) 2024-11-01T19:15:55.9901982Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bcba5496f3b0a2fb.xml (deflated 35%) 2024-11-01T19:15:55.9903109Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-94efb3ddf7e2d06d.xml (deflated 38%) 2024-11-01T19:15:55.9904248Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-3dceca9544499980.xml (deflated 38%) 2024-11-01T19:15:55.9905364Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-9cb16bc8258cd065.xml (deflated 48%) 2024-11-01T19:15:55.9906493Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-5de5dc5425817ce6.xml (deflated 48%) 2024-11-01T19:15:55.9907612Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-294285b6e52eec77.xml (deflated 48%) 2024-11-01T19:15:55.9908889Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-f14e8941669a0099.xml (deflated 48%) 2024-11-01T19:15:55.9910128Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-3c678e7531de3cb5.xml (deflated 38%) 2024-11-01T19:15:55.9911264Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-5b6a7b311afdc65b.xml (deflated 37%) 2024-11-01T19:15:55.9912456Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-bfa88de6dd5677c2.xml (deflated 48%) 2024-11-01T19:15:55.9913585Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-fc7d55698b658f88.xml (deflated 48%) 2024-11-01T19:15:55.9914703Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-a2b414611f41fc7b.xml (deflated 48%) 2024-11-01T19:15:55.9915825Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-32cdf6a6b3b7726a.xml (deflated 48%) 2024-11-01T19:15:55.9943267Z ##[group]Run # Remove any previous usage logs if they exist 2024-11-01T19:15:55.9943540Z # Remove any previous usage logs if they exist 2024-11-01T19:15:55.9943672Z rm -f logs-*.zip 2024-11-01T19:15:55.9944114Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-11-01T19:15:55.9944319Z # so check to see if the file exists first 2024-11-01T19:15:55.9944461Z if [ -f 'usage_log.txt' ]; then 2024-11-01T19:15:55.9944685Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-11-01T19:15:55.9944793Z fi 2024-11-01T19:15:55.9945126Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2024-11-01T19:15:55.9945420Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2024-11-01T19:15:55.9945513Z fi 2024-11-01T19:15:55.9951876Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:55.9951978Z env: 2024-11-01T19:15:55.9952116Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:55.9952521Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:55.9952780Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T19:15:55.9952883Z ##[endgroup] 2024-11-01T19:15:56.0083004Z adding: usage_log.txt (deflated 92%) 2024-11-01T19:15:56.0218472Z adding: test/test-reports/distributed.test_dynamo_distributed_1.1_f4bada9ef9154ba9_.log (deflated 88%) 2024-11-01T19:15:56.0219171Z adding: test/test-reports/distributed._tools.test_mem_tracker_1.1_e0414b32e8a3b16e_.log (deflated 61%) 2024-11-01T19:15:56.0219762Z adding: test/test-reports/distributed._composable.test_contract_1.1_76b5499738930dfe_.log (deflated 66%) 2024-11-01T19:15:56.0220317Z adding: test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_d2b369e0690d1d0d_.log (deflated 53%) 2024-11-01T19:15:56.0223308Z adding: test/test-reports/distributed.test_symmetric_memory_1.1_f67a39d05562ed1b_.log (deflated 94%) 2024-11-01T19:15:56.0224797Z adding: test/test-reports/distributed._tensor.test_dtensor_1.1_c187f4d958aaf6bc_.log (deflated 87%) 2024-11-01T19:15:56.1994525Z adding: test/test-reports/distributed._tensor.test_dtensor_ops_1.1_f3d7f34250884438_.log (deflated 96%) 2024-11-01T19:15:56.1995263Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_5a977a98e6246c04_.log (deflated 53%) 2024-11-01T19:15:56.1995877Z adding: test/test-reports/distributed.optim.test_named_optimizer_1.1_e1bb06832bf8ef40_.log (deflated 35%) 2024-11-01T19:15:56.1996776Z adding: test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_ca37e489bab03362_.log (deflated 56%) 2024-11-01T19:15:56.1997458Z adding: test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_c7643e894c061912_.log (deflated 71%) 2024-11-01T19:15:56.1999102Z adding: test/test-reports/distributed._tensor.test_random_ops_1.1_fef8be5448004a7f_.log (deflated 77%) 2024-11-01T19:15:56.2002283Z adding: test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_d3c4273ea61b9697_.log (deflated 93%) 2024-11-01T19:15:56.2003844Z adding: test/test-reports/distributed._tensor.experimental.test_local_map_1.1_824cd285319aaa06_.log (deflated 71%) 2024-11-01T19:15:56.2005156Z adding: test/test-reports/distributed._tensor.experimental.test_tp_transform_1.1_b9c520459eb8bd5c_.log (deflated 68%) 2024-11-01T19:15:56.2006395Z adding: test/test-reports/distributed.checkpoint.e2e.test_fine_tuning_1.1_36a29344b62860d9_.log (deflated 55%) 2024-11-01T19:15:56.2007527Z adding: test/test-reports/distributed._tensor.test_pointwise_ops_1.1_86f9f573d6135262_.log (deflated 69%) 2024-11-01T19:15:56.2008748Z adding: test/test-reports/distributed.checkpoint.e2e.test_pipeline_1.1_940324b6a1e676fc_.log (deflated 52%) 2024-11-01T19:15:56.2010034Z adding: test/test-reports/distributed.checkpoint.test_dtensor_checkpoint_1.1_6cc6ce8a5c0480fc_.log (deflated 57%) 2024-11-01T19:15:56.2011270Z adding: test/test-reports/distributed.checkpoint.test_compatibility_1.1_db2114e55ea358b0_.log (deflated 65%) 2024-11-01T19:15:56.2012548Z adding: test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_8f6c7ca987ae2dc9_.log (deflated 77%) 2024-11-01T19:15:56.2013860Z adding: test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_64ea4d378979f3ee_.log (deflated 56%) 2024-11-01T19:15:56.2015015Z adding: test/test-reports/distributed._tensor.test_embedding_ops_1.1_ab0aa5d948be47e0_.log (deflated 71%) 2024-11-01T19:15:56.2016335Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_3db2390d83c5843a_.log (deflated 55%) 2024-11-01T19:15:56.2017592Z adding: test/test-reports/distributed.checkpoint.test_state_dict_utils_1.1_4f1c12ddc1c7a94b_.log (deflated 78%) 2024-11-01T19:15:56.2018845Z adding: test/test-reports/distributed.checkpoint.test_hsdp_checkpoint_1.1_7cf8ec42d0070472_.log (deflated 63%) 2024-11-01T19:15:56.2019970Z adding: test/test-reports/distributed.checkpoint.test_planner_1.1_810c84a37f07fda3_.log (deflated 66%) 2024-11-01T19:15:56.2021302Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_init_1.1_ad7a5fa7c76c01df_.log (deflated 88%) 2024-11-01T19:15:56.2022752Z adding: test/test-reports/distributed._composable.test_composability.test_pp_composability_1.1_f4945c7c71e491db_.log (deflated 90%) 2024-11-01T19:15:56.2024123Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_grad_scaler_1.1_379f652b65c27e24_.log (deflated 56%) 2024-11-01T19:15:56.2025238Z adding: test/test-reports/distributed._tensor.test_op_strategy_1.1_d86226642140fc12_.log (deflated 78%) 2024-11-01T19:15:56.2026335Z adding: test/test-reports/distributed.test_control_collectives_1.1_006c87823ab829a9_.log (deflated 77%) 2024-11-01T19:15:56.2027428Z adding: test/test-reports/distributed.launcher.test_run_1.1_b94e687eff4ee4d8_.log (deflated 89%) 2024-11-01T19:15:56.2028843Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_3bfee3b2da9c0054_.log (deflated 56%) 2024-11-01T19:15:56.2030501Z adding: test/test-reports/distributed.pipelining.test_schedule_1.1_22d8eab70f18a8ad_.log (deflated 87%) 2024-11-01T19:15:56.2031846Z adding: test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_684d199090f9fb77_.log (deflated 58%) 2024-11-01T19:15:56.2033035Z adding: test/test-reports/distributed.fsdp.test_shard_utils_1.1_ea699aa4e56c6994_.log (deflated 58%) 2024-11-01T19:15:56.2034306Z adding: test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_ad650748823b71a2_.log (deflated 95%) 2024-11-01T19:15:56.2035825Z adding: test/test-reports/distributed._tensor.test_utils_1.1_1033248a6d1ae017_.log (deflated 80%) 2024-11-01T19:15:56.2036782Z adding: test/test-reports/distributed.test_nccl_1.1_9bb554eef355bf48_.log (deflated 49%) 2024-11-01T19:15:56.2038730Z adding: test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_707d18ada0feb8d1_.log (deflated 55%) 2024-11-01T19:15:56.2039982Z adding: test/test-reports/distributed.fsdp.test_fsdp_dtensor_state_dict_1.1_0a56d4ce62e6de2a_.log (deflated 76%) 2024-11-01T19:15:56.2041294Z adding: test/test-reports/distributed.checkpoint.test_checkpoint_1.1_7a1a467687b414e1_.log (deflated 81%) 2024-11-01T19:15:56.2042573Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_e1551cb3a1a2b8b5_.log (deflated 72%) 2024-11-01T19:15:56.2043682Z adding: test/test-reports/distributed._composable.test_replicate_1.1_80a7870f45ae8f0f_.log (deflated 81%) 2024-11-01T19:15:56.2044726Z adding: test/test-reports/distributed.test_distributed_spawn_1.1_e21267dcae444fe2_.log (deflated 37%) 2024-11-01T19:15:56.2045745Z adding: test/test-reports/distributed.test_distributed_spawn_1.1_75a5c032756d8383_.log (deflated 37%) 2024-11-01T19:15:56.2089275Z adding: test/test-reports/distributed.test_distributed_spawn_1.1_3e130e68ca397cf0_.log (deflated 97%) 2024-11-01T19:15:56.2134354Z adding: test/test-reports/distributed.test_distributed_spawn_1.1_6009667a1954d7cd_.log (deflated 97%) 2024-11-01T19:15:56.2135598Z adding: test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_868a1d9a19c8ee79_.log (deflated 65%) 2024-11-01T19:15:56.2137062Z adding: test/test-reports/distributed._composable.test_composability.test_2d_composability_1.1_fb0e6180bbf09474_.log (deflated 85%) 2024-11-01T19:15:56.2138226Z adding: test/test-reports/distributed.test_c10d_object_collectives_1.1_e29dc3faddaaa5c1_.log (deflated 76%) 2024-11-01T19:15:56.2139353Z adding: test/test-reports/distributed.nn.jit.test_instantiator_1.1_398c5fe0ea818ff8_.log (deflated 63%) 2024-11-01T19:15:56.2140643Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_comm_1.1_d664e3a7bf533c9f_.log (deflated 83%) 2024-11-01T19:15:56.2141634Z adding: test/test-reports/distributed.fsdp.test_utils_1.1_66fb96588f1412c8_.log (deflated 64%) 2024-11-01T19:15:56.2142767Z adding: test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_c7e25f8d0a9b5548_.log (deflated 79%) 2024-11-01T19:15:56.2144068Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_training_1.1_029c7c874eac3320_.log (deflated 86%) 2024-11-01T19:15:56.2145412Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a4c59fe9ce6d7e3b_.log (stored 0%) 2024-11-01T19:15:56.2147056Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a649879eebad4a56_.log (stored 0%) 2024-11-01T19:15:56.2148670Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_a68084db4dba309a_.log (deflated 90%) 2024-11-01T19:15:56.2150009Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_93f3f086de6e8331_.log (deflated 90%) 2024-11-01T19:15:56.2151075Z adding: test/test-reports/distributed.test_multi_threaded_pg_1.1_9e8a02dda53b959b_.log (deflated 86%) 2024-11-01T19:15:56.2152377Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_runtime_1.1_8810ce4495a34005_.log (deflated 62%) 2024-11-01T19:15:56.2153450Z adding: test/test-reports/distributed.fsdp.test_fsdp_input_1.1_217411ec2e1f0355_.log (deflated 58%) 2024-11-01T19:15:56.2154868Z adding: test/test-reports/distributed.checkpoint.test_file_system_checkpoint_cpu_1.1_8371232d68f263cb_.log (deflated 94%) 2024-11-01T19:15:56.2158044Z adding: test/test-reports/distributed.fsdp.test_fsdp_core_1.1_705bdd0d469e8c35_.log (deflated 91%) 2024-11-01T19:15:56.2159857Z adding: test/test-reports/distributed.fsdp.test_fsdp_multiple_wrapping_1.1_dc9054d438e7e8ca_.log (deflated 55%) 2024-11-01T19:15:56.2161195Z adding: test/test-reports/distributed.test_pg_wrapper_1.1_56b1f10d506ca12e_.log (deflated 93%) 2024-11-01T19:15:56.2165341Z adding: test/test-reports/distributed.test_c10d_common_1.1_6aade8f869650b2f_.log (deflated 94%) 2024-11-01T19:15:56.2166986Z adding: test/test-reports/distributed.fsdp.test_fsdp_comm_hooks_1.1_0627618c735a0c47_.log (deflated 89%) 2024-11-01T19:15:56.2168073Z adding: test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_e0b23017b0f4b7d6_.log (deflated 68%) 2024-11-01T19:15:56.2169966Z adding: test/test-reports/distributed.test_data_parallel_1.1_f2fe5db7b3d55e60_.log (deflated 88%) 2024-11-01T19:15:56.2171376Z adding: test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_cba565fa89a291af_.log (deflated 77%) 2024-11-01T19:15:56.2172536Z adding: test/test-reports/distributed.fsdp.test_fsdp_meta_1.1_d5648b2ebafe1ecc_.log (deflated 83%) 2024-11-01T19:15:56.2173861Z adding: test/test-reports/distributed.fsdp.test_fsdp_unshard_params_1.1_0b7626bb2e24e9b2_.log (deflated 83%) 2024-11-01T19:15:56.2198287Z adding: test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_bc54d9f2e47409b1_.log (deflated 98%) 2024-11-01T19:15:56.2241158Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_4add288ec9bb3ff3_.log (deflated 97%) 2024-11-01T19:15:56.2282081Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_efdbe620e9343cdf_.log (deflated 97%) 2024-11-01T19:15:56.2283462Z adding: test/test-reports/distributed.fsdp.test_distributed_checkpoint_1.1_1681ce28bfc0ff53_.log (deflated 65%) 2024-11-01T19:15:56.2284655Z adding: test/test-reports/distributed.test_c10d_ucc_1.1_1bcb19bce3463df1_.log (stored 0%) 2024-11-01T19:15:56.2285929Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_1.1_f49cecb338d4d063_.log (deflated 62%) 2024-11-01T19:15:56.2287382Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_bag_1.1_96fd1703ffe1d127_.log (deflated 63%) 2024-11-01T19:15:56.2288881Z adding: test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_reshard_1.1_43eff6ecd3cadf20_.log (deflated 64%) 2024-11-01T19:15:56.2306431Z adding: test/test-reports/distributed.test_c10d_gloo_1.1_a4c65ce9c02eda48_.log (deflated 96%) 2024-11-01T19:15:56.2853985Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-11-01T19:15:56.2854730Z # Remove any previous debugging artifacts if they exist 2024-11-01T19:15:56.2855293Z rm -f debug-*.zip 2024-11-01T19:15:56.2855666Z if [ -d 'test/debug' ]; then 2024-11-01T19:15:56.2856167Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-11-01T19:15:56.2856638Z fi 2024-11-01T19:15:56.2863462Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:56.2863953Z env: 2024-11-01T19:15:56.2864241Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:56.2864892Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:56.2865708Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_32396543967 2024-11-01T19:15:56.2866227Z ##[endgroup] 2024-11-01T19:15:56.2958495Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-11-01T19:15:56.2958945Z with: 2024-11-01T19:15:56.2959469Z s3-bucket: gha-artifacts 2024-11-01T19:15:56.2959908Z s3-prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:56.2960383Z retention-days: 14 2024-11-01T19:15:56.2960704Z if-no-files-found: warn 2024-11-01T19:15:56.2961075Z path: test-jsons-*.zip 2024-11-01T19:15:56.2961404Z name: artifact 2024-11-01T19:15:56.2961679Z region: us-east-1 2024-11-01T19:15:56.2961968Z env: 2024-11-01T19:15:56.2962228Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:56.2973983Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:56.2974799Z ##[endgroup] 2024-11-01T19:15:56.7121401Z NOTE: s3-prefix specified, ignoring name parameter 2024-11-01T19:15:56.7122834Z With the provided path, there will be 1 file uploaded 2024-11-01T19:15:56.7123478Z Uploading to s3 prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:56.8591631Z Starting upload of test-jsons-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:56.9778778Z Finished upload of test-jsons-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:56.9993482Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-11-01T19:15:56.9993930Z with: 2024-11-01T19:15:56.9994203Z s3-bucket: gha-artifacts 2024-11-01T19:15:56.9994781Z s3-prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:56.9995258Z retention-days: 14 2024-11-01T19:15:56.9995589Z if-no-files-found: error 2024-11-01T19:15:56.9995954Z path: test-reports-*.zip 2024-11-01T19:15:56.9996298Z name: artifact 2024-11-01T19:15:56.9996579Z region: us-east-1 2024-11-01T19:15:56.9996869Z env: 2024-11-01T19:15:56.9997139Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:56.9997769Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:56.9998435Z ##[endgroup] 2024-11-01T19:15:57.3894735Z NOTE: s3-prefix specified, ignoring name parameter 2024-11-01T19:15:57.3895505Z With the provided path, there will be 1 file uploaded 2024-11-01T19:15:57.3896125Z Uploading to s3 prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:57.3935996Z Starting upload of test-reports-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:57.6784596Z Finished upload of test-reports-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:57.6982022Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-11-01T19:15:57.6982471Z with: 2024-11-01T19:15:57.6982763Z s3-bucket: gha-artifacts 2024-11-01T19:15:57.6983191Z s3-prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:57.6983657Z retention-days: 14 2024-11-01T19:15:57.6983980Z if-no-files-found: ignore 2024-11-01T19:15:57.6984327Z path: logs-*.zip 2024-11-01T19:15:57.6984634Z name: artifact 2024-11-01T19:15:57.6984927Z region: us-east-1 2024-11-01T19:15:57.6985212Z env: 2024-11-01T19:15:57.6985471Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:57.6986088Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:57.6986810Z ##[endgroup] 2024-11-01T19:15:58.0872948Z NOTE: s3-prefix specified, ignoring name parameter 2024-11-01T19:15:58.0873748Z With the provided path, there will be 1 file uploaded 2024-11-01T19:15:58.0874375Z Uploading to s3 prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:58.0914017Z Starting upload of logs-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:58.2624916Z Finished upload of logs-test-distributed-2-2-linux.2xlarge_32396543967.zip 2024-11-01T19:15:58.2820729Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-11-01T19:15:58.2821174Z with: 2024-11-01T19:15:58.2821470Z s3-bucket: gha-artifacts 2024-11-01T19:15:58.2821906Z s3-prefix: pytorch/pytorch/11632514903/1/artifact 2024-11-01T19:15:58.2822377Z retention-days: 14 2024-11-01T19:15:58.2822699Z if-no-files-found: ignore 2024-11-01T19:15:58.2823047Z path: debug-*.zip 2024-11-01T19:15:58.2823337Z name: artifact 2024-11-01T19:15:58.2823628Z region: us-east-1 2024-11-01T19:15:58.2823913Z env: 2024-11-01T19:15:58.2824175Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:58.2824792Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:58.2825455Z ##[endgroup] 2024-11-01T19:15:58.6642627Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-11-01T19:15:58.6838943Z ##[group]Run # shellcheck disable=SC2156 2024-11-01T19:15:58.6839435Z # shellcheck disable=SC2156 2024-11-01T19:15:58.6840267Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-11-01T19:15:58.6846754Z shell: /usr/bin/bash -e {0} 2024-11-01T19:15:58.6847106Z env: 2024-11-01T19:15:58.6847369Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:58.6847991Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:58.6848667Z ##[endgroup] 2024-11-01T19:15:58.9196734Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-11-01T19:15:58.9197281Z with: 2024-11-01T19:15:58.9197531Z env: 2024-11-01T19:15:58.9197796Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:58.9198428Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:58.9199244Z ##[endgroup] 2024-11-01T19:15:58.9220659Z ##[group]Run set -eou pipefail 2024-11-01T19:15:58.9221062Z set -eou pipefail 2024-11-01T19:15:58.9221404Z  2024-11-01T19:15:58.9221911Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-11-01T19:15:58.9222561Z for _ in $(seq 1440); do 2024-11-01T19:15:58.9223027Z  # Break if no ssh session exists anymore 2024-11-01T19:15:58.9223510Z  if [ "$(who)" = "" ]; then 2024-11-01T19:15:58.9223907Z  break 2024-11-01T19:15:58.9224209Z  fi 2024-11-01T19:15:58.9224539Z  echo "." 2024-11-01T19:15:58.9224843Z  sleep 5 2024-11-01T19:15:58.9225143Z done 2024-11-01T19:15:58.9231184Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:58.9231687Z env: 2024-11-01T19:15:58.9231951Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:58.9232573Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:58.9233268Z ##[endgroup] 2024-11-01T19:15:58.9257605Z Holding runner for 2 hours until all ssh sessions have logged out 2024-11-01T19:15:58.9365084Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-11-01T19:15:58.9365866Z # ignore expansion of "docker ps -q" since it could be empty 2024-11-01T19:15:58.9366462Z # shellcheck disable=SC2046 2024-11-01T19:15:58.9366955Z docker stop $(docker ps -q) || true 2024-11-01T19:15:58.9367428Z # Prune all of the docker images 2024-11-01T19:15:58.9367878Z docker system prune -af 2024-11-01T19:15:58.9373733Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:15:58.9374224Z env: 2024-11-01T19:15:58.9374492Z GIT_DEFAULT_BRANCH: main 2024-11-01T19:15:58.9375119Z DOCKER_CONTAINER_ID: 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:15:58.9375784Z ##[endgroup] 2024-11-01T19:16:09.5399279Z 7afe1bd6a4a7 2024-11-01T19:16:09.9029839Z Deleted Containers: 2024-11-01T19:16:09.9030638Z 7afe1bd6a4a7f0aed58bf772189d1911f73c61e7df9132471414305e008fbd33 2024-11-01T19:16:09.9031256Z 2024-11-01T19:16:13.7314440Z Deleted Images: 2024-11-01T19:16:13.7316362Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:bdd298b12da59246147f016e0693ffd722419941 2024-11-01T19:16:13.7319526Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11@sha256:68d308b5ab9729d840ef6882af267b00db6e15ae40d6c8de9da61fef478f8a18 2024-11-01T19:16:13.7321497Z deleted: sha256:acd5ab414b6754b1ba1fbfceff9d37aa2af65d736e970c726d477963e8596d49 2024-11-01T19:16:13.7322406Z deleted: sha256:93d4c75f8615120fabeeba1f8213410a94a4ba687993261f88de5cc89bcbf906 2024-11-01T19:16:13.7323293Z deleted: sha256:b63de2ee0c28ad19c4b1c104bf86117de9b8910b607e03ae4d23205b4d148692 2024-11-01T19:16:13.7324165Z deleted: sha256:0a53ccbaa95fb1a992cc6c5e65510999516c30369c756bf31ca672cbc64fb9b3 2024-11-01T19:16:13.7325059Z deleted: sha256:d78307e26844a1efaffd88d6f73ce0f57b842be250bb227e42eeef4747662f84 2024-11-01T19:16:13.7325940Z deleted: sha256:c31baeac25f19cf5310f19aae7d284b1210c38b3420e5380985a90845bbb3ce6 2024-11-01T19:16:13.7326988Z deleted: sha256:8777d65601fce44cfc563e1c10bc5fcab4bc999fcf5fb993482e8b87be10893f 2024-11-01T19:16:13.7327886Z deleted: sha256:e916dd94c9d50b354fcaaa29e4d62f47f9de54074151253dabb04146dab6e011 2024-11-01T19:16:13.7328773Z deleted: sha256:1b6b584aa7ce85e635c8bbddc60ac91b9739e6024f8fbf9f06fb4dcbd29845d1 2024-11-01T19:16:13.7329979Z deleted: sha256:2c1df409b0bc3c603cff4d93e404ad37b8f239a22c249b619fece0ae4ea9401d 2024-11-01T19:16:13.7330870Z deleted: sha256:64d683cb97b5d2594640455cc9abda679180d03fde8042fe1eb42f5c11339211 2024-11-01T19:16:13.7331743Z deleted: sha256:52d56c43eadccf8502b8b135fcb8977834757560c7203223db9636e09e33d84c 2024-11-01T19:16:13.7332639Z deleted: sha256:e5fa9a8a5cdfe96d9803f8d75ab7bfa100dac25e8f5a2796c4da5263defc2a41 2024-11-01T19:16:13.7333655Z deleted: sha256:05394b4a9c017e772570d96d044015ec9a91ebc9a4d1801eb4542a1277ab20c3 2024-11-01T19:16:13.7334513Z deleted: sha256:fa175c9721a866b0a80d601ae54178dbcfd1958c1f707946999873c113ae9d67 2024-11-01T19:16:13.7335367Z deleted: sha256:1e8f530a59c243c9b668032780b0f009c4f01d39414229567de23fbaffec9cfa 2024-11-01T19:16:13.7336234Z deleted: sha256:6db5bde9f97b983b138f7bda4f891595437b5d1aa505bb05d66f3ef85c45127b 2024-11-01T19:16:13.7337116Z deleted: sha256:8469ffb0d1c0dc2e20854f1a4008c12f3b78335682af5ba92d1930a5adbc7028 2024-11-01T19:16:13.7337997Z deleted: sha256:89302d65daebdd48960bcdfcc4baafd9b1b999d15347822b5c224d412bad1075 2024-11-01T19:16:13.7338876Z deleted: sha256:c3306463289e9c13cb9693fffa9d751830069dc6dea34fb0f246bd6a2d68f501 2024-11-01T19:16:13.7339750Z deleted: sha256:7cadc42c996bfd4e5ef638a0c39f4833b0e8b56c799ef47ef6b0796e718a8e2c 2024-11-01T19:16:13.7340616Z deleted: sha256:66dd4211375278d63533557df9880e017092a2279bcf1aa4b2026ceb1f79aee6 2024-11-01T19:16:13.7341455Z deleted: sha256:6a3e6ae5f03a8e430cfb7fc8ba67044c4193e8687608d5807166fdc637d76c51 2024-11-01T19:16:13.7342350Z deleted: sha256:7fb11ba653fd3f0ac5254b80dc431bcc70ace76abfa5a6c54db12b5fada1f628 2024-11-01T19:16:13.7343234Z deleted: sha256:1df534e180693f6c931b18ad42094de6c6da937b8a947d0df367ae372f07c252 2024-11-01T19:16:13.7344113Z deleted: sha256:b4674aad1e9f30bc4a21079d55e516bedc8d0dbbc4fbb6e33353d436107f7d0e 2024-11-01T19:16:13.7344984Z deleted: sha256:b157d9219906e9a181856f4ea238e28d2ef3a7e2a9620682a2f97938a57c16c7 2024-11-01T19:16:13.7345869Z deleted: sha256:ec1b84ee35628aea2e4be97caecf75e470a7f3fc0ffcf7c9ece8b6b5c0350179 2024-11-01T19:16:13.7346747Z deleted: sha256:c641d29fa165b9df2e600522be43a800058e264119d786ae5169ea44d9c6d633 2024-11-01T19:16:13.7347677Z deleted: sha256:f6cab744e96c900941f08148a16559b0bf8d082d3708437293d9efde965b7e05 2024-11-01T19:16:13.7349210Z deleted: sha256:0e7d20ba5f6c8240de8a882de5db511016bda1151d8789c59da7a22c8abb871a 2024-11-01T19:16:13.7350193Z deleted: sha256:56c722cb5dea3a08f1a0d7ec11d78a96c79621694093c8277d19ecab3ce88c65 2024-11-01T19:16:13.7351096Z deleted: sha256:e91a23eb11d67c2e9366e9feeabf19fb04dbce8560b4aa25e5f59409473360e6 2024-11-01T19:16:13.7351988Z deleted: sha256:6c701e81fdbe6d18019ad98862dab19332ff13df1f7b7deb79906deeb406662f 2024-11-01T19:16:13.7352849Z deleted: sha256:8ffc0852321d71307b2d814b44439d326ccd3585e620fd5f9d2b9d14c2f57c76 2024-11-01T19:16:13.7353707Z deleted: sha256:0231028281bd3abe9274ff1789f476b5d04f462b397b7bfd7aabec966895429b 2024-11-01T19:16:13.7354570Z deleted: sha256:d2a62f6ff0b36141922e69d55eee63f81172048e7e47eb02d317f8d43569a63e 2024-11-01T19:16:13.7355448Z deleted: sha256:936d9afc1499b541e2af4d535c445c1a92f2781bd362bdee530836e3ca2805ca 2024-11-01T19:16:13.7356374Z deleted: sha256:e4adf4a1ffb66e2392341556aa2d581b152bdfbd6249f925d873fce18e7daa9f 2024-11-01T19:16:13.7357247Z deleted: sha256:02509fb4f4a80806b2b7a773fd3ec833d429ddf548ee59c6280e28c541d007de 2024-11-01T19:16:13.7358112Z deleted: sha256:171f4ecd31f7318928abdb2d2235d1de266a9b5a50b92b0b0e134b1337a82419 2024-11-01T19:16:13.7359331Z deleted: sha256:caddba564eb4b90759f3f9d507b22a338c8d04a98d022c5225d9496885c23819 2024-11-01T19:16:13.7360237Z deleted: sha256:2f61b6d34ee2ab83fc8ed06c11087a7590732dd8d5a4d9428e7da9afbcd93e1f 2024-11-01T19:16:13.7361253Z deleted: sha256:0884213b056d2d710178f6e379521e1ee5ba0a52bd76eaa718147e082bdfd37a 2024-11-01T19:16:13.7362802Z deleted: sha256:6e2bd1e98ead15cfae2a20c0bef74b19098b8f339dd9cbbcf89d26d23076744d 2024-11-01T19:16:13.7363688Z deleted: sha256:13c0075bc3e89c37804dfeb3260a6a84741e753284bdeb4b8ed36431042edcd1 2024-11-01T19:16:13.7364566Z deleted: sha256:4ba7d9d48d20ffed1c4a0da01450453f959c1543f598b513ef2d4acbaf0f5ec2 2024-11-01T19:16:13.7365611Z deleted: sha256:ce931da4e7c258b233bff780e36e85ac997d8b49afa07b4535cc304cd31a11e7 2024-11-01T19:16:13.7366510Z deleted: sha256:3aaa5d72e932a5a15d8c59b85a871e9ee8bb84fd440ac8ee2add33d814484324 2024-11-01T19:16:13.7367403Z deleted: sha256:d1e2263c25c8e26ae2a2cd0647d58dbb585b7854e3a3bcdba930c920fa5af61d 2024-11-01T19:16:13.7368392Z deleted: sha256:a98147b873bd881afb3f40ac863183865857d7e51d03c77e62680a12d67bcdec 2024-11-01T19:16:13.7369263Z deleted: sha256:66f106e0ac50ae8a76edd59595174b50c242c2c2ac23acec7ef73c82d66297a1 2024-11-01T19:16:13.7370149Z deleted: sha256:b5d2c21b1dd9bc44170d5905fb53feb18cc36bffab40a77563393e1486846dd4 2024-11-01T19:16:13.7371019Z deleted: sha256:b72cce60f852d323a47ea10b266624ed08b955a6c05f06f0b49b7c20216388aa 2024-11-01T19:16:13.7371887Z deleted: sha256:74c7c4685920472ace75441f01522a55c24af0ccaa115d00d9dbe18df18e30ee 2024-11-01T19:16:13.7372745Z deleted: sha256:8630ef75057e74e403d57a98f74309dba1e7f85b1ed408525faa637bee221790 2024-11-01T19:16:13.7373607Z deleted: sha256:97528f5f870aa4a450943a8fc8c5a1c1c7c283f402bab249b6b508f9b27c3c3d 2024-11-01T19:16:13.7374467Z deleted: sha256:278371c37229c8c9e7351d8f0d93348f15b7cc5f3cdac826c0445d69aa2d6a10 2024-11-01T19:16:13.7375334Z deleted: sha256:a9c94a6aa0d059039d1ba4bcbc77966ecee565900a8cc818aa0285d1ed66c4ad 2024-11-01T19:16:13.7376214Z deleted: sha256:39bb64d0c3a9b6cf6b76d7cd6eaa1ca2eeb20297d2cd72ac5c44755b30c3aef6 2024-11-01T19:16:13.7377101Z deleted: sha256:644445c3b37180be4e526c5b00c7b41d00d0ccd98ef74c19ea25a0af4008ff2e 2024-11-01T19:16:13.7377976Z deleted: sha256:9a75bbfa0a4ea81a239dd0220499dce009590f2c04d00ee632c2f83113386a8a 2024-11-01T19:16:13.7378847Z deleted: sha256:d21955a1bb21e611e644c48daa5282a91a2916d0e786d1a7dd192109316b9557 2024-11-01T19:16:13.7379704Z deleted: sha256:fcaa556b6854c19b200a05f96fe84b229840e1de575ca7f50d213230fe25b26f 2024-11-01T19:16:13.7380574Z deleted: sha256:9cebf1d2e389c1903a89af6e5c69f174a5269e3e6638bd8909f829cf63187e5a 2024-11-01T19:16:13.7381458Z deleted: sha256:aaaf586d8bf742b00c3c36dc64756ca8caf46fb3993fbd74cf0b5ffc9dc7068e 2024-11-01T19:16:13.7382334Z deleted: sha256:4ccd5e5d28cbc0024a056a771e9255c7d7f2652a84e7f986cb759bb78eec3d42 2024-11-01T19:16:13.7383207Z deleted: sha256:e1d4b9f05a40316ed16ac9d2782512a3c8c93ff0138a4ad9da7818e4727ca5f9 2024-11-01T19:16:13.7384088Z deleted: sha256:25910dca7d8ea1cf745d816a127da821049bfa380e6ddefb0b087d200226648b 2024-11-01T19:16:13.7384976Z deleted: sha256:3d78aa41921e460e91e7aad88c3d8c7087bdf8be4fadecbd735cb9bc77247abe 2024-11-01T19:16:13.7385847Z deleted: sha256:8f7d14624ecb8bf5b3a22e2821004915a10523800b48ec38ca41321838901943 2024-11-01T19:16:13.7386729Z deleted: sha256:bbd6146f62f341eae7965473aa9bf21fdaff3b915eaf3ad68b485161344527b0 2024-11-01T19:16:13.7387590Z deleted: sha256:6e4831d26492ce0d0f9cd5dd20eb43fca2756f0d53250dfe73007d1411ad0c5e 2024-11-01T19:16:13.7388533Z deleted: sha256:4c6fec9010edcd2fc690a58502aa7e7c40b4eb068efef822d78144219ba05aff 2024-11-01T19:16:13.7389408Z deleted: sha256:bb0a52775a7a09803c91c960dd86264b220b897371fae4e11a3c390ff0f76055 2024-11-01T19:16:13.7390278Z deleted: sha256:73e5b22cc89ad45e5730af3f6c908c454f5aeeb29b5d77995490543d662c2886 2024-11-01T19:16:13.7391145Z deleted: sha256:9b8350f631b365a72c8c3f19b5f579691d959aa38becbde32cdd39c6267d6454 2024-11-01T19:16:13.7392006Z deleted: sha256:e62a33aecd92746d8329b9212f36c1a173de2a65f36a488631a88ca162c64e73 2024-11-01T19:16:13.7392845Z deleted: sha256:6544f00a8f0bd424906c4493d6148760d4c94638022f4e7cb90681bf8444b084 2024-11-01T19:16:13.7393690Z deleted: sha256:95a2497c520f10dc257e56e30a553efb2b8bf46ec505989e04360488256f758c 2024-11-01T19:16:13.7394557Z deleted: sha256:ba8f96b6ecf286da1f96032fc117f49dea1872b03599708e3e95fe170482b21f 2024-11-01T19:16:13.7395440Z deleted: sha256:2cb3bb0ae28ef1443d20823b5d817e342cc811292ffd2aae5463d9f9ad5f0575 2024-11-01T19:16:13.7396325Z deleted: sha256:55fca8b9b71ddd36a31f9416d73be55815bd0149fe0dd8f2b407e3c2529a2b19 2024-11-01T19:16:13.7397207Z deleted: sha256:92656f9347466a332eba67bfdb5fa55ffce4ea0ca154e5964673c3cc361c481e 2024-11-01T19:16:13.7398153Z deleted: sha256:72e581b367a1bbf15e628dc140eb5c4959a42627139674b1d866a36e8635f2d3 2024-11-01T19:16:13.7399010Z deleted: sha256:3817e88611d8a5885cd27cec7ff3582a072913fcdf526679c5e3ade4bc7d3cb8 2024-11-01T19:16:13.7399888Z deleted: sha256:86dc99fe4b04edc49424ef6166cacb649da3b96bd7f3ddeabe874e214d90e21a 2024-11-01T19:16:13.7400784Z deleted: sha256:7267a3bed3d7c10acdbb147bfa514df85f9616b3eff70a65f480f2e94c62ab11 2024-11-01T19:16:13.7402209Z deleted: sha256:d4f1a7de408e56eb63c85e8a2f9f4bb6a869cf603460dac9db302a63d99467ea 2024-11-01T19:16:13.7403120Z deleted: sha256:de0ebf8dc2a0fe35ba3f5017a1e7a479fbaf89cd1f29df8b9fa71e5404ac5e72 2024-11-01T19:16:13.7404016Z deleted: sha256:16045d13bfcf7601cf505c900ce4b924de4276b2298cbcf4368ca549e6c9b253 2024-11-01T19:16:13.7404879Z deleted: sha256:1de9e018f602ea1e82e2fd77e92c6cee5f9b8194701b3fea384bbb7747fdb9d0 2024-11-01T19:16:13.7405781Z deleted: sha256:9f07dc8d8caa9ef8ba9c434b154dfefcdae201f4aa1ee96f9985d367cbdad914 2024-11-01T19:16:13.7406690Z deleted: sha256:1de940da5e07249accfa1463ae4a0ba8970537e754f9d66c156838fb550e4b47 2024-11-01T19:16:13.7407557Z deleted: sha256:c63e4c08818cb327718369cbf8b4ff8428b3d4626f1847768bc31d76217c6c2d 2024-11-01T19:16:13.7408416Z deleted: sha256:0b2b7bcf246325532e79fec05292983083c5d48af4d68f28b98dbd3fc1d6dbee 2024-11-01T19:16:13.7409287Z deleted: sha256:f8486aa1b48ce6b5902d475899ec53f3c5c840ea3ff8fcc4cee0fbb91e53f2d9 2024-11-01T19:16:13.7410195Z deleted: sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465 2024-11-01T19:16:13.7410719Z 2024-11-01T19:16:13.7410863Z Total reclaimed space: 21.58GB 2024-11-01T19:16:13.7494436Z Post job cleanup. 2024-11-01T19:16:13.7565196Z Post job cleanup. 2024-11-01T19:16:13.8529844Z [command]/usr/bin/git version 2024-11-01T19:16:13.8574744Z git version 2.40.1 2024-11-01T19:16:13.8613883Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/54d65217-58fc-43ad-8c4a-c02441b1d354' before making global git config changes 2024-11-01T19:16:13.8615195Z Adding repository directory to the temporary git global config as a safe directory 2024-11-01T19:16:13.8618863Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-11-01T19:16:13.8660250Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-11-01T19:16:13.8693497Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-11-01T19:16:13.9065662Z Entering 'android/libs/fbjni' 2024-11-01T19:16:13.9118686Z Entering 'third_party/FP16' 2024-11-01T19:16:13.9169291Z Entering 'third_party/FXdiv' 2024-11-01T19:16:13.9218764Z Entering 'third_party/NNPACK' 2024-11-01T19:16:13.9271197Z Entering 'third_party/NVTX' 2024-11-01T19:16:13.9321720Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T19:16:13.9372731Z Entering 'third_party/XNNPACK' 2024-11-01T19:16:13.9440716Z Entering 'third_party/benchmark' 2024-11-01T19:16:13.9493239Z Entering 'third_party/composable_kernel' 2024-11-01T19:16:13.9550259Z Entering 'third_party/cpp-httplib' 2024-11-01T19:16:13.9601402Z Entering 'third_party/cpuinfo' 2024-11-01T19:16:13.9652675Z Entering 'third_party/cudnn_frontend' 2024-11-01T19:16:13.9703069Z Entering 'third_party/cutlass' 2024-11-01T19:16:13.9763915Z Entering 'third_party/eigen' 2024-11-01T19:16:13.9815519Z Entering 'third_party/fbgemm' 2024-11-01T19:16:13.9866050Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T19:16:13.9916772Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T19:16:13.9967419Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T19:16:14.0024127Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T19:16:14.0074725Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T19:16:14.0127259Z Entering 'third_party/flatbuffers' 2024-11-01T19:16:14.0182940Z Entering 'third_party/fmt' 2024-11-01T19:16:14.0234117Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T19:16:14.0285779Z Entering 'third_party/gloo' 2024-11-01T19:16:14.0334715Z Entering 'third_party/googletest' 2024-11-01T19:16:14.0386583Z Entering 'third_party/ideep' 2024-11-01T19:16:14.0436031Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T19:16:14.0494901Z Entering 'third_party/ittapi' 2024-11-01T19:16:14.0545449Z Entering 'third_party/kineto' 2024-11-01T19:16:14.0597685Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T19:16:14.0647535Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T19:16:14.0699709Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T19:16:14.0749863Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T19:16:14.0799404Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T19:16:14.0849938Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T19:16:14.0904344Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T19:16:14.0956068Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T19:16:14.1006895Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T19:16:14.1057856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T19:16:14.1111038Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T19:16:14.1160061Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T19:16:14.1211170Z Entering 'third_party/mimalloc' 2024-11-01T19:16:14.1263969Z Entering 'third_party/nccl/nccl' 2024-11-01T19:16:14.1314798Z Entering 'third_party/nlohmann' 2024-11-01T19:16:14.1366638Z Entering 'third_party/onnx' 2024-11-01T19:16:14.1432883Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T19:16:14.1487163Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T19:16:14.1539438Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T19:16:14.1589540Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T19:16:14.1638404Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T19:16:14.1689374Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T19:16:14.1741398Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T19:16:14.1791163Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T19:16:14.1841460Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T19:16:14.1890424Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T19:16:14.1942437Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T19:16:14.1994148Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T19:16:14.2064398Z Entering 'third_party/pocketfft' 2024-11-01T19:16:14.2115294Z Entering 'third_party/protobuf' 2024-11-01T19:16:14.2169613Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T19:16:14.2218836Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T19:16:14.2270244Z Entering 'third_party/psimd' 2024-11-01T19:16:14.2320311Z Entering 'third_party/pthreadpool' 2024-11-01T19:16:14.2370563Z Entering 'third_party/pybind11' 2024-11-01T19:16:14.2421328Z Entering 'third_party/python-peachpy' 2024-11-01T19:16:14.2473675Z Entering 'third_party/sleef' 2024-11-01T19:16:14.2524575Z Entering 'third_party/tensorpipe' 2024-11-01T19:16:14.2575297Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T19:16:14.2625417Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T19:16:14.2674293Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T19:16:14.2724379Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T19:16:14.2773083Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T19:16:14.2842525Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-11-01T19:16:14.2872297Z http.https://github.com/.extraheader 2024-11-01T19:16:14.2880934Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-11-01T19:16:14.2917103Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-11-01T19:16:14.3208616Z Entering 'android/libs/fbjni' 2024-11-01T19:16:14.3243775Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3279380Z Entering 'third_party/FP16' 2024-11-01T19:16:14.3314315Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3345565Z Entering 'third_party/FXdiv' 2024-11-01T19:16:14.3380533Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3411310Z Entering 'third_party/NNPACK' 2024-11-01T19:16:14.3445135Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3477190Z Entering 'third_party/NVTX' 2024-11-01T19:16:14.3510682Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3543063Z Entering 'third_party/VulkanMemoryAllocator' 2024-11-01T19:16:14.3578178Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3609934Z Entering 'third_party/XNNPACK' 2024-11-01T19:16:14.3644444Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3693870Z Entering 'third_party/benchmark' 2024-11-01T19:16:14.3729017Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3762102Z Entering 'third_party/composable_kernel' 2024-11-01T19:16:14.3797557Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3836235Z Entering 'third_party/cpp-httplib' 2024-11-01T19:16:14.3871946Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3905351Z Entering 'third_party/cpuinfo' 2024-11-01T19:16:14.3941097Z http.https://github.com/.extraheader 2024-11-01T19:16:14.3973067Z Entering 'third_party/cudnn_frontend' 2024-11-01T19:16:14.4008100Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4041101Z Entering 'third_party/cutlass' 2024-11-01T19:16:14.4076308Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4117834Z Entering 'third_party/eigen' 2024-11-01T19:16:14.4152959Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4187397Z Entering 'third_party/fbgemm' 2024-11-01T19:16:14.4222480Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4255830Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-11-01T19:16:14.4290071Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4321956Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-11-01T19:16:14.4355017Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4387127Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-11-01T19:16:14.4420329Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4460460Z Entering 'third_party/fbgemm/third_party/googletest' 2024-11-01T19:16:14.4495368Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4527414Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-11-01T19:16:14.4562605Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4596542Z Entering 'third_party/flatbuffers' 2024-11-01T19:16:14.4632178Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4668002Z Entering 'third_party/fmt' 2024-11-01T19:16:14.4703278Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4736621Z Entering 'third_party/gemmlowp/gemmlowp' 2024-11-01T19:16:14.4772494Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4805307Z Entering 'third_party/gloo' 2024-11-01T19:16:14.4839739Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4873322Z Entering 'third_party/googletest' 2024-11-01T19:16:14.4908624Z http.https://github.com/.extraheader 2024-11-01T19:16:14.4941288Z Entering 'third_party/ideep' 2024-11-01T19:16:14.4976295Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5007919Z Entering 'third_party/ideep/mkl-dnn' 2024-11-01T19:16:14.5041771Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5081819Z Entering 'third_party/ittapi' 2024-11-01T19:16:14.5116617Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5148406Z Entering 'third_party/kineto' 2024-11-01T19:16:14.5182747Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5214902Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-11-01T19:16:14.5249122Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5281769Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-11-01T19:16:14.5315152Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5348610Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-11-01T19:16:14.5384258Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5416146Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-11-01T19:16:14.5449419Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5481856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-11-01T19:16:14.5514792Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5545804Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-11-01T19:16:14.5579823Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5613885Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-11-01T19:16:14.5652021Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5685841Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-11-01T19:16:14.5719457Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5753012Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-11-01T19:16:14.5786967Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5820565Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-11-01T19:16:14.5853905Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5888164Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-11-01T19:16:14.5921543Z http.https://github.com/.extraheader 2024-11-01T19:16:14.5952724Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-11-01T19:16:14.5985719Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6018577Z Entering 'third_party/mimalloc' 2024-11-01T19:16:14.6053807Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6087236Z Entering 'third_party/nccl/nccl' 2024-11-01T19:16:14.6121977Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6153970Z Entering 'third_party/nlohmann' 2024-11-01T19:16:14.6189969Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6222227Z Entering 'third_party/onnx' 2024-11-01T19:16:14.6255612Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6304022Z Entering 'third_party/onnx/third_party/pybind11' 2024-11-01T19:16:14.6338382Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6373329Z Entering 'third_party/opentelemetry-cpp' 2024-11-01T19:16:14.6407855Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6442767Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-11-01T19:16:14.6478158Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6510394Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-11-01T19:16:14.6543384Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6576234Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-11-01T19:16:14.6610107Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6642731Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-11-01T19:16:14.6676797Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6710326Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-11-01T19:16:14.6743111Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6777900Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-11-01T19:16:14.6811022Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6843045Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-11-01T19:16:14.6876382Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6908173Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-11-01T19:16:14.6942005Z http.https://github.com/.extraheader 2024-11-01T19:16:14.6977662Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-11-01T19:16:14.7011135Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7045136Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-11-01T19:16:14.7082369Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7137586Z Entering 'third_party/pocketfft' 2024-11-01T19:16:14.7173509Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7206381Z Entering 'third_party/protobuf' 2024-11-01T19:16:14.7240678Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7277433Z Entering 'third_party/protobuf/third_party/benchmark' 2024-11-01T19:16:14.7311206Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7343281Z Entering 'third_party/protobuf/third_party/googletest' 2024-11-01T19:16:14.7377869Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7412496Z Entering 'third_party/psimd' 2024-11-01T19:16:14.7448574Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7482331Z Entering 'third_party/pthreadpool' 2024-11-01T19:16:14.7518279Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7551983Z Entering 'third_party/pybind11' 2024-11-01T19:16:14.7587627Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7621056Z Entering 'third_party/python-peachpy' 2024-11-01T19:16:14.7655603Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7688619Z Entering 'third_party/sleef' 2024-11-01T19:16:14.7722489Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7755936Z Entering 'third_party/tensorpipe' 2024-11-01T19:16:14.7791185Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7823024Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-11-01T19:16:14.7856729Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7890365Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-11-01T19:16:14.7923209Z http.https://github.com/.extraheader 2024-11-01T19:16:14.7954672Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-11-01T19:16:14.7988303Z http.https://github.com/.extraheader 2024-11-01T19:16:14.8020397Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-11-01T19:16:14.8053485Z http.https://github.com/.extraheader 2024-11-01T19:16:14.8085168Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-11-01T19:16:14.8118981Z http.https://github.com/.extraheader 2024-11-01T19:16:14.8236807Z A job completed hook has been configured by the self-hosted runner administrator 2024-11-01T19:16:14.8256522Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-11-01T19:16:14.8262831Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-11-01T19:16:14.8263354Z ##[endgroup] 2024-11-01T19:16:22.1640153Z Cleaning up orphan processes