2024-12-18T00:09:40.8247785Z Current runner version: '2.321.0' 2024-12-18T00:09:40.8255703Z Runner name: 'i-0feeb5a43c4657cc6' 2024-12-18T00:09:40.8256700Z Runner group name: 'Default' 2024-12-18T00:09:40.8257895Z Machine name: 'ip-10-0-37-101' 2024-12-18T00:09:40.8262671Z ##[group]GITHUB_TOKEN Permissions 2024-12-18T00:09:40.8265926Z Actions: read 2024-12-18T00:09:40.8266601Z Attestations: read 2024-12-18T00:09:40.8267731Z Checks: read 2024-12-18T00:09:40.8268393Z Contents: read 2024-12-18T00:09:40.8269057Z Deployments: read 2024-12-18T00:09:40.8269788Z Discussions: read 2024-12-18T00:09:40.8270426Z Issues: read 2024-12-18T00:09:40.8271080Z Metadata: read 2024-12-18T00:09:40.8271966Z Packages: read 2024-12-18T00:09:40.8272647Z Pages: read 2024-12-18T00:09:40.8273356Z PullRequests: read 2024-12-18T00:09:40.8274032Z RepositoryProjects: read 2024-12-18T00:09:40.8274788Z SecurityEvents: read 2024-12-18T00:09:40.8275559Z Statuses: read 2024-12-18T00:09:40.8276242Z ##[endgroup] 2024-12-18T00:09:40.8280266Z Secret source: Actions 2024-12-18T00:09:40.8281584Z Prepare workflow directory 2024-12-18T00:09:41.1709490Z Prepare all required actions 2024-12-18T00:09:41.1756764Z Getting action download info 2024-12-18T00:09:41.3996270Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c) 2024-12-18T00:09:43.1600982Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:09:56.0491493Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-12-18T00:09:56.2501245Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-12-18T00:09:56.5446979Z Getting action download info 2024-12-18T00:09:56.6863912Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-12-18T00:09:56.9144897Z Getting action download info 2024-12-18T00:09:57.0395105Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2024-12-18T00:09:57.2161484Z Getting action download info 2024-12-18T00:09:57.3514762Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-12-18T00:09:57.5208111Z Getting action download info 2024-12-18T00:09:57.6427336Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e) 2024-12-18T00:09:59.0915538Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7) 2024-12-18T00:09:59.0917743Z ##[group] Inputs 2024-12-18T00:09:59.0918115Z build-environment: linux-jammy-py3.9-gcc11 2024-12-18T00:09:59.0921153Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]} 2024-12-18T00:09:59.0924499Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:09:59.0925244Z sync-tag: 2024-12-18T00:09:59.0926111Z timeout-minutes: 240 2024-12-18T00:09:59.0926395Z use-gha: 2024-12-18T00:09:59.0926918Z dashboard-tag: 2024-12-18T00:09:59.0927291Z s3-bucket: gha-artifacts 2024-12-18T00:09:59.0927588Z aws-role-to-assume: 2024-12-18T00:09:59.0928255Z disable-monitor: false 2024-12-18T00:09:59.0928560Z ##[endgroup] 2024-12-18T00:09:59.0928993Z Complete job name: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:09:59.1380718Z A job started hook has been configured by the self-hosted runner administrator 2024-12-18T00:09:59.1486074Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-12-18T00:09:59.1495847Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:09:59.1496561Z ##[endgroup] 2024-12-18T00:10:00.9600547Z Runner Type: linux.2xlarge 2024-12-18T00:10:00.9601135Z Instance Type: c5.2xlarge 2024-12-18T00:10:00.9601432Z AMI Name: unknown 2024-12-18T00:10:00.9626878Z AMI ID: ami-0fff1b9a61dec8a5f 2024-12-18T00:10:07.2373699Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6 2024-12-18T00:10:07.2374213Z with: 2024-12-18T00:10:07.2374940Z github-secret: *** 2024-12-18T00:10:07.2375674Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-12-18T00:10:07.2376482Z activate-with-label: false 2024-12-18T00:10:07.2376787Z label: with-ssh 2024-12-18T00:10:07.2377055Z remove-existing-keys: true 2024-12-18T00:10:07.2377365Z fail-silently: true 2024-12-18T00:10:07.2377619Z env: 2024-12-18T00:10:07.2409400Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:10:07.2409778Z ##[endgroup] 2024-12-18T00:10:07.3709689Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-12-18T00:10:07.3711051Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2024-12-18T00:10:07.3846944Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6 2024-12-18T00:10:07.3847459Z with: 2024-12-18T00:10:07.3847698Z no-sudo: true 2024-12-18T00:10:07.3847995Z submodules: recursive 2024-12-18T00:10:07.3848262Z fetch-depth: 0 2024-12-18T00:10:07.3848512Z env: 2024-12-18T00:10:07.3848746Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:10:07.3849028Z ##[endgroup] 2024-12-18T00:10:07.3935228Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:10:07.3936260Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:10:07.3944829Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:10:07.3945245Z env: 2024-12-18T00:10:07.3945473Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:10:07.3945758Z ##[endgroup] 2024-12-18T00:10:07.4043631Z ##[group]Run retry () { 2024-12-18T00:10:07.4043984Z retry () { 2024-12-18T00:10:07.4044361Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-12-18T00:10:07.4044837Z } 2024-12-18T00:10:07.4045094Z echo "${GITHUB_WORKSPACE}" 2024-12-18T00:10:07.4045453Z if [ -z "${NO_SUDO}" ]; then 2024-12-18T00:10:07.4045823Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:10:07.4046173Z else 2024-12-18T00:10:07.4046456Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-12-18T00:10:07.4046799Z fi 2024-12-18T00:10:07.4047054Z mkdir "${GITHUB_WORKSPACE}" 2024-12-18T00:10:07.4052868Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:10:07.4053283Z env: 2024-12-18T00:10:07.4053518Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:10:07.4053806Z NO_SUDO: true 2024-12-18T00:10:07.4054058Z ##[endgroup] 2024-12-18T00:10:07.4077699Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:10:10.5567371Z ##[group]Run malfet/checkout@silent-checkout 2024-12-18T00:10:10.5567732Z with: 2024-12-18T00:10:10.5568000Z ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:10:10.5568583Z fetch-depth: 0 2024-12-18T00:10:10.5568837Z submodules: recursive 2024-12-18T00:10:10.5569102Z quiet-checkout: true 2024-12-18T00:10:10.5569385Z repository: pytorch/pytorch 2024-12-18T00:10:10.5569802Z token: *** 2024-12-18T00:10:10.5570039Z ssh-strict: true 2024-12-18T00:10:10.5570305Z persist-credentials: true 2024-12-18T00:10:10.5570590Z clean: true 2024-12-18T00:10:10.5570832Z sparse-checkout-cone-mode: true 2024-12-18T00:10:10.5571139Z lfs: false 2024-12-18T00:10:10.5571377Z set-safe-directory: true 2024-12-18T00:10:10.5571651Z env: 2024-12-18T00:10:10.5571862Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:10:10.5572135Z ##[endgroup] 2024-12-18T00:10:10.6481914Z Syncing repository: pytorch/pytorch 2024-12-18T00:10:10.6483378Z ##[group]Getting Git version info 2024-12-18T00:10:10.6483927Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:10:10.6484619Z [command]/usr/bin/git version 2024-12-18T00:10:10.6484925Z git version 2.40.1 2024-12-18T00:10:10.6488128Z ##[endgroup] 2024-12-18T00:10:10.6501623Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/e6255bfc-5e87-4547-bc93-142c9a5cc359' before making global git config changes 2024-12-18T00:10:10.6502622Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T00:10:10.6505765Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:10:10.6534634Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-12-18T00:10:10.6537769Z ##[group]Initializing the repository 2024-12-18T00:10:10.6540387Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:10:10.6653660Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-12-18T00:10:10.6654658Z hint: is subject to change. To configure the initial branch name to use in all 2024-12-18T00:10:10.6655634Z hint: of your new repositories, which will suppress this warning, call: 2024-12-18T00:10:10.6656334Z hint: 2024-12-18T00:10:10.6656814Z hint: git config --global init.defaultBranch 2024-12-18T00:10:10.6657427Z hint: 2024-12-18T00:10:10.6657979Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-12-18T00:10:10.6658753Z hint: 'development'. The just-created branch can be renamed via this command: 2024-12-18T00:10:10.6659219Z hint: 2024-12-18T00:10:10.6659459Z hint: git branch -m 2024-12-18T00:10:10.6660061Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-12-18T00:10:10.6666255Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-12-18T00:10:10.6698242Z ##[endgroup] 2024-12-18T00:10:10.6698795Z ##[group]Disabling automatic garbage collection 2024-12-18T00:10:10.6701604Z [command]/usr/bin/git config --local gc.auto 0 2024-12-18T00:10:10.6726823Z ##[endgroup] 2024-12-18T00:10:10.6727254Z ##[group]Setting up auth 2024-12-18T00:10:10.6731822Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T00:10:10.6755794Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T00:10:10.7021000Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T00:10:10.7046088Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T00:10:10.7306482Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:10:10.7348166Z ##[endgroup] 2024-12-18T00:10:10.7348636Z ##[group]Fetching the repository 2024-12-18T00:10:10.7353864Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-12-18T00:10:13.5675803Z remote: Enumerating objects: 1056462 2024-12-18T00:10:13.5676538Z remote: Enumerating objects: 1057261, done. 2024-12-18T00:10:13.5677083Z remote: Counting objects: 0% (1/799) 2024-12-18T00:10:13.5677477Z remote: Counting objects: 1% (8/799) 2024-12-18T00:10:13.5680461Z remote: Counting objects: 2% (16/799) 2024-12-18T00:10:13.5680897Z remote: Counting objects: 3% (24/799) 2024-12-18T00:10:13.5681292Z remote: Counting objects: 4% (32/799) 2024-12-18T00:10:13.5681679Z remote: Counting objects: 5% (40/799) 2024-12-18T00:10:13.5682052Z remote: Counting objects: 6% (48/799) 2024-12-18T00:10:13.5682473Z remote: Counting objects: 7% (56/799) 2024-12-18T00:10:13.5682940Z remote: Counting objects: 8% (64/799) 2024-12-18T00:10:13.5683321Z remote: Counting objects: 9% (72/799) 2024-12-18T00:10:13.5683720Z remote: Counting objects: 10% (80/799) 2024-12-18T00:10:13.5684085Z remote: Counting objects: 11% (88/799) 2024-12-18T00:10:13.5684462Z remote: Counting objects: 12% (96/799) 2024-12-18T00:10:13.5684852Z remote: Counting objects: 13% (104/799) 2024-12-18T00:10:13.5685442Z remote: Counting objects: 14% (112/799) 2024-12-18T00:10:13.5685955Z remote: Counting objects: 15% (120/799) 2024-12-18T00:10:13.5686523Z remote: Counting objects: 16% (128/799) 2024-12-18T00:10:13.5687107Z remote: Counting objects: 17% (136/799) 2024-12-18T00:10:13.5687696Z remote: Counting objects: 18% (144/799) 2024-12-18T00:10:13.5688305Z remote: Counting objects: 19% (152/799) 2024-12-18T00:10:13.5689348Z remote: Counting objects: 20% (160/799) 2024-12-18T00:10:13.5690018Z remote: Counting objects: 21% (168/799) 2024-12-18T00:10:13.5690646Z remote: Counting objects: 22% (176/799) 2024-12-18T00:10:13.5691293Z remote: Counting objects: 23% (184/799) 2024-12-18T00:10:13.5691923Z remote: Counting objects: 24% (192/799) 2024-12-18T00:10:13.5692577Z remote: Counting objects: 25% (200/799) 2024-12-18T00:10:13.5693235Z remote: Counting objects: 26% (208/799) 2024-12-18T00:10:13.5693954Z remote: Counting objects: 27% (216/799) 2024-12-18T00:10:13.5694583Z remote: Counting objects: 28% (224/799) 2024-12-18T00:10:13.5695243Z remote: Counting objects: 29% (232/799) 2024-12-18T00:10:13.5695876Z remote: Counting objects: 30% (240/799) 2024-12-18T00:10:13.5696521Z remote: Counting objects: 31% (248/799) 2024-12-18T00:10:13.5697191Z remote: Counting objects: 32% (256/799) 2024-12-18T00:10:13.5697883Z remote: Counting objects: 33% (264/799) 2024-12-18T00:10:13.5698527Z remote: Counting objects: 34% (272/799) 2024-12-18T00:10:13.5699296Z remote: Counting objects: 35% (280/799) 2024-12-18T00:10:13.5699960Z remote: Counting objects: 36% (288/799) 2024-12-18T00:10:13.5700623Z remote: Counting objects: 37% (296/799) 2024-12-18T00:10:13.5701247Z remote: Counting objects: 38% (304/799) 2024-12-18T00:10:13.5701898Z remote: Counting objects: 39% (312/799) 2024-12-18T00:10:13.5702536Z remote: Counting objects: 40% (320/799) 2024-12-18T00:10:13.5703218Z remote: Counting objects: 41% (328/799) 2024-12-18T00:10:13.5703816Z remote: Counting objects: 42% (336/799) 2024-12-18T00:10:13.5704417Z remote: Counting objects: 43% (344/799) 2024-12-18T00:10:13.5704978Z remote: Counting objects: 44% (352/799) 2024-12-18T00:10:13.5705532Z remote: Counting objects: 45% (360/799) 2024-12-18T00:10:13.5706134Z remote: Counting objects: 46% (368/799) 2024-12-18T00:10:13.5706754Z remote: Counting objects: 47% (376/799) 2024-12-18T00:10:13.5707376Z remote: Counting objects: 48% (384/799) 2024-12-18T00:10:13.5707997Z remote: Counting objects: 49% (392/799) 2024-12-18T00:10:13.5709011Z remote: Counting objects: 50% (400/799) 2024-12-18T00:10:13.5709659Z remote: Counting objects: 51% (408/799) 2024-12-18T00:10:13.5710302Z remote: Counting objects: 52% (416/799) 2024-12-18T00:10:13.5710956Z remote: Counting objects: 53% (424/799) 2024-12-18T00:10:13.5711712Z remote: Counting objects: 54% (432/799) 2024-12-18T00:10:13.5712353Z remote: Counting objects: 55% (440/799) 2024-12-18T00:10:13.5712983Z remote: Counting objects: 56% (448/799) 2024-12-18T00:10:13.5713558Z remote: Counting objects: 57% (456/799) 2024-12-18T00:10:13.5714154Z remote: Counting objects: 58% (464/799) 2024-12-18T00:10:13.5714707Z remote: Counting objects: 59% (472/799) 2024-12-18T00:10:13.5715364Z remote: Counting objects: 60% (480/799) 2024-12-18T00:10:13.5716025Z remote: Counting objects: 61% (488/799) 2024-12-18T00:10:13.5716661Z remote: Counting objects: 62% (496/799) 2024-12-18T00:10:13.5717356Z remote: Counting objects: 63% (504/799) 2024-12-18T00:10:13.5718064Z remote: Counting objects: 64% (512/799) 2024-12-18T00:10:13.5718676Z remote: Counting objects: 65% (520/799) 2024-12-18T00:10:13.5719256Z remote: Counting objects: 66% (528/799) 2024-12-18T00:10:13.5719861Z remote: Counting objects: 67% (536/799) 2024-12-18T00:10:13.5720496Z remote: Counting objects: 68% (544/799) 2024-12-18T00:10:13.5721151Z remote: Counting objects: 69% (552/799) 2024-12-18T00:10:13.5721814Z remote: Counting objects: 70% (560/799) 2024-12-18T00:10:13.5722463Z remote: Counting objects: 71% (568/799) 2024-12-18T00:10:13.5723129Z remote: Counting objects: 72% (576/799) 2024-12-18T00:10:13.5724022Z remote: Counting objects: 73% (584/799) 2024-12-18T00:10:13.5724699Z remote: Counting objects: 74% (592/799) 2024-12-18T00:10:13.5725365Z remote: Counting objects: 75% (600/799) 2024-12-18T00:10:13.5725999Z remote: Counting objects: 76% (608/799) 2024-12-18T00:10:13.5726584Z remote: Counting objects: 77% (616/799) 2024-12-18T00:10:13.5727210Z remote: Counting objects: 78% (624/799) 2024-12-18T00:10:13.5727848Z remote: Counting objects: 79% (632/799) 2024-12-18T00:10:13.5728484Z remote: Counting objects: 80% (640/799) 2024-12-18T00:10:13.5729095Z remote: Counting objects: 81% (648/799) 2024-12-18T00:10:13.5729701Z remote: Counting objects: 82% (656/799) 2024-12-18T00:10:13.5730346Z remote: Counting objects: 83% (664/799) 2024-12-18T00:10:13.5730991Z remote: Counting objects: 84% (672/799) 2024-12-18T00:10:13.5731642Z remote: Counting objects: 85% (680/799) 2024-12-18T00:10:13.5732324Z remote: Counting objects: 86% (688/799) 2024-12-18T00:10:13.5732970Z remote: Counting objects: 87% (696/799) 2024-12-18T00:10:13.5733623Z remote: Counting objects: 88% (704/799) 2024-12-18T00:10:13.5734236Z remote: Counting objects: 89% (712/799) 2024-12-18T00:10:13.5734866Z remote: Counting objects: 90% (720/799) 2024-12-18T00:10:13.5735503Z remote: Counting objects: 91% (728/799) 2024-12-18T00:10:13.5736134Z remote: Counting objects: 92% (736/799) 2024-12-18T00:10:13.5736782Z remote: Counting objects: 93% (744/799) 2024-12-18T00:10:13.5737436Z remote: Counting objects: 94% (752/799) 2024-12-18T00:10:13.5738090Z remote: Counting objects: 95% (760/799) 2024-12-18T00:10:13.5738699Z remote: Counting objects: 96% (768/799) 2024-12-18T00:10:13.5739340Z remote: Counting objects: 97% (776/799) 2024-12-18T00:10:13.5740002Z remote: Counting objects: 98% (784/799) 2024-12-18T00:10:13.5740671Z remote: Counting objects: 99% (792/799) 2024-12-18T00:10:13.5741564Z remote: Counting objects: 100% (799/799) 2024-12-18T00:10:13.5742214Z remote: Counting objects: 100% (799/799), done. 2024-12-18T00:10:13.5743243Z remote: Compressing objects: 0% (1/293) 2024-12-18T00:10:13.5844282Z remote: Compressing objects: 1% (3/293) 2024-12-18T00:10:13.5880931Z remote: Compressing objects: 2% (6/293) 2024-12-18T00:10:13.5954542Z remote: Compressing objects: 3% (9/293) 2024-12-18T00:10:13.6125533Z remote: Compressing objects: 4% (12/293) 2024-12-18T00:10:13.6532293Z remote: Compressing objects: 5% (15/293) 2024-12-18T00:10:13.6787742Z remote: Compressing objects: 6% (18/293) 2024-12-18T00:10:13.7542642Z remote: Compressing objects: 7% (21/293) 2024-12-18T00:10:13.8039499Z remote: Compressing objects: 8% (24/293) 2024-12-18T00:10:13.8468579Z remote: Compressing objects: 9% (27/293) 2024-12-18T00:10:13.8741430Z remote: Compressing objects: 10% (30/293) 2024-12-18T00:10:13.8807222Z remote: Compressing objects: 11% (33/293) 2024-12-18T00:10:13.8904226Z remote: Compressing objects: 12% (36/293) 2024-12-18T00:10:13.8971124Z remote: Compressing objects: 13% (39/293) 2024-12-18T00:10:13.8975098Z remote: Compressing objects: 14% (42/293) 2024-12-18T00:10:13.8978801Z remote: Compressing objects: 15% (44/293) 2024-12-18T00:10:13.8981124Z remote: Compressing objects: 16% (47/293) 2024-12-18T00:10:13.8984708Z remote: Compressing objects: 17% (50/293) 2024-12-18T00:10:13.8986992Z remote: Compressing objects: 18% (53/293) 2024-12-18T00:10:13.8989512Z remote: Compressing objects: 19% (56/293) 2024-12-18T00:10:13.8992523Z remote: Compressing objects: 20% (59/293) 2024-12-18T00:10:13.8995176Z remote: Compressing objects: 21% (62/293) 2024-12-18T00:10:13.8999798Z remote: Compressing objects: 22% (65/293) 2024-12-18T00:10:13.9002659Z remote: Compressing objects: 23% (68/293) 2024-12-18T00:10:13.9009817Z remote: Compressing objects: 24% (71/293) 2024-12-18T00:10:13.9016096Z remote: Compressing objects: 25% (74/293) 2024-12-18T00:10:13.9018641Z remote: Compressing objects: 26% (77/293) 2024-12-18T00:10:13.9021512Z remote: Compressing objects: 27% (80/293) 2024-12-18T00:10:13.9023976Z remote: Compressing objects: 28% (83/293) 2024-12-18T00:10:13.9026729Z remote: Compressing objects: 29% (85/293) 2024-12-18T00:10:13.9033651Z remote: Compressing objects: 30% (88/293) 2024-12-18T00:10:13.9035763Z remote: Compressing objects: 31% (91/293) 2024-12-18T00:10:13.9041267Z remote: Compressing objects: 32% (94/293) 2024-12-18T00:10:13.9044059Z remote: Compressing objects: 33% (97/293) 2024-12-18T00:10:13.9048041Z remote: Compressing objects: 34% (100/293) 2024-12-18T00:10:13.9054075Z remote: Compressing objects: 35% (103/293) 2024-12-18T00:10:13.9056377Z remote: Compressing objects: 36% (106/293) 2024-12-18T00:10:13.9058931Z remote: Compressing objects: 37% (109/293) 2024-12-18T00:10:13.9061602Z remote: Compressing objects: 38% (112/293) 2024-12-18T00:10:13.9065766Z remote: Compressing objects: 39% (115/293) 2024-12-18T00:10:13.9072147Z remote: Compressing objects: 40% (118/293) 2024-12-18T00:10:13.9074883Z remote: Compressing objects: 41% (121/293) 2024-12-18T00:10:13.9075556Z remote: Compressing objects: 42% (124/293) 2024-12-18T00:10:13.9080026Z remote: Compressing objects: 43% (126/293) 2024-12-18T00:10:13.9084774Z remote: Compressing objects: 44% (129/293) 2024-12-18T00:10:13.9086955Z remote: Compressing objects: 45% (132/293) 2024-12-18T00:10:13.9090105Z remote: Compressing objects: 46% (135/293) 2024-12-18T00:10:13.9092501Z remote: Compressing objects: 47% (138/293) 2024-12-18T00:10:13.9095104Z remote: Compressing objects: 48% (141/293) 2024-12-18T00:10:13.9097518Z remote: Compressing objects: 49% (144/293) 2024-12-18T00:10:13.9099987Z remote: Compressing objects: 50% (147/293) 2024-12-18T00:10:13.9102628Z remote: Compressing objects: 51% (150/293) 2024-12-18T00:10:13.9105400Z remote: Compressing objects: 52% (153/293) 2024-12-18T00:10:13.9106104Z remote: Compressing objects: 53% (156/293) 2024-12-18T00:10:13.9107972Z remote: Compressing objects: 54% (159/293) 2024-12-18T00:10:13.9110654Z remote: Compressing objects: 55% (162/293) 2024-12-18T00:10:13.9113413Z remote: Compressing objects: 56% (165/293) 2024-12-18T00:10:13.9114143Z remote: Compressing objects: 57% (168/293) 2024-12-18T00:10:13.9115928Z remote: Compressing objects: 58% (170/293) 2024-12-18T00:10:13.9119571Z remote: Compressing objects: 59% (173/293) 2024-12-18T00:10:13.9121966Z remote: Compressing objects: 60% (176/293) 2024-12-18T00:10:13.9124489Z remote: Compressing objects: 61% (179/293) 2024-12-18T00:10:13.9127280Z remote: Compressing objects: 62% (182/293) 2024-12-18T00:10:13.9129699Z remote: Compressing objects: 63% (185/293) 2024-12-18T00:10:13.9133917Z remote: Compressing objects: 64% (188/293) 2024-12-18T00:10:13.9138203Z remote: Compressing objects: 65% (191/293) 2024-12-18T00:10:13.9138872Z remote: Compressing objects: 66% (194/293) 2024-12-18T00:10:13.9140767Z remote: Compressing objects: 67% (197/293) 2024-12-18T00:10:13.9143285Z remote: Compressing objects: 68% (200/293) 2024-12-18T00:10:13.9145880Z remote: Compressing objects: 69% (203/293) 2024-12-18T00:10:13.9149699Z remote: Compressing objects: 70% (206/293) 2024-12-18T00:10:13.9150422Z remote: Compressing objects: 71% (209/293) 2024-12-18T00:10:13.9152477Z remote: Compressing objects: 72% (211/293) 2024-12-18T00:10:13.9155540Z remote: Compressing objects: 73% (214/293) 2024-12-18T00:10:13.9157900Z remote: Compressing objects: 74% (217/293) 2024-12-18T00:10:13.9158580Z remote: Compressing objects: 75% (220/293) 2024-12-18T00:10:13.9160399Z remote: Compressing objects: 76% (223/293) 2024-12-18T00:10:13.9161066Z remote: Compressing objects: 77% (226/293) 2024-12-18T00:10:13.9162927Z remote: Compressing objects: 78% (229/293) 2024-12-18T00:10:13.9163659Z remote: Compressing objects: 79% (232/293) 2024-12-18T00:10:13.9164291Z remote: Compressing objects: 80% (235/293) 2024-12-18T00:10:13.9164974Z remote: Compressing objects: 81% (238/293) 2024-12-18T00:10:13.9167942Z remote: Compressing objects: 82% (241/293) 2024-12-18T00:10:13.9168691Z remote: Compressing objects: 83% (244/293) 2024-12-18T00:10:13.9170157Z remote: Compressing objects: 84% (247/293) 2024-12-18T00:10:13.9170848Z remote: Compressing objects: 85% (250/293) 2024-12-18T00:10:13.9172861Z remote: Compressing objects: 86% (252/293) 2024-12-18T00:10:13.9175480Z remote: Compressing objects: 87% (255/293) 2024-12-18T00:10:13.9179847Z remote: Compressing objects: 88% (258/293) 2024-12-18T00:10:13.9182222Z remote: Compressing objects: 89% (261/293) 2024-12-18T00:10:13.9182936Z remote: Compressing objects: 90% (264/293) 2024-12-18T00:10:13.9184371Z remote: Compressing objects: 91% (267/293) 2024-12-18T00:10:13.9187310Z remote: Compressing objects: 92% (270/293) 2024-12-18T00:10:13.9188084Z remote: Compressing objects: 93% (273/293) 2024-12-18T00:10:13.9188784Z remote: Compressing objects: 94% (276/293) 2024-12-18T00:10:13.9189880Z remote: Compressing objects: 95% (279/293) 2024-12-18T00:10:13.9190611Z remote: Compressing objects: 96% (282/293) 2024-12-18T00:10:13.9191335Z remote: Compressing objects: 97% (285/293) 2024-12-18T00:10:13.9192465Z remote: Compressing objects: 98% (288/293) 2024-12-18T00:10:13.9193206Z remote: Compressing objects: 99% (291/293) 2024-12-18T00:10:13.9193917Z remote: Compressing objects: 100% (293/293) 2024-12-18T00:10:13.9194652Z remote: Compressing objects: 100% (293/293), done. 2024-12-18T00:10:35.7013114Z remote: Total 1057261 (delta 656), reused 506 (delta 506), pack-reused 1056462 (from 4) 2024-12-18T00:11:04.9292946Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object} 2024-12-18T00:11:04.9315596Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:11:04.9317104Z ##[endgroup] 2024-12-18T00:11:04.9317709Z ##[group]Determining the checkout info 2024-12-18T00:11:04.9318673Z ##[endgroup] 2024-12-18T00:11:04.9319162Z ##[group]Checking out the ref 2024-12-18T00:11:04.9321686Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:11:06.3618492Z ##[endgroup] 2024-12-18T00:11:06.3618968Z ##[group]Setting up auth for fetching submodules 2024-12-18T00:11:06.3621884Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-12-18T00:11:06.3660288Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-12-18T00:11:06.3684033Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-12-18T00:11:06.3707525Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-12-18T00:11:06.3731161Z ##[endgroup] 2024-12-18T00:11:06.3731589Z ##[group]Fetching submodules 2024-12-18T00:11:06.3733396Z [command]/usr/bin/git submodule sync --recursive 2024-12-18T00:11:06.4019028Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-12-18T00:11:06.4302290Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-12-18T00:11:06.4303722Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-12-18T00:11:06.4305188Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-12-18T00:11:06.4307548Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-12-18T00:11:06.4309960Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2024-12-18T00:11:06.4313121Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-12-18T00:11:06.4315696Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-12-18T00:11:06.4318736Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-12-18T00:11:06.4321548Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2024-12-18T00:11:06.4324482Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-12-18T00:11:06.4327673Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-12-18T00:11:06.4331588Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-12-18T00:11:06.4334625Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-12-18T00:11:06.4338328Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-12-18T00:11:06.4342601Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-12-18T00:11:06.4346697Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-12-18T00:11:06.4352437Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-12-18T00:11:06.4356991Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:11:06.4361105Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-12-18T00:11:06.4365682Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-12-18T00:11:06.4370056Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-12-18T00:11:06.4374663Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-12-18T00:11:06.4379308Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-12-18T00:11:06.4384171Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-12-18T00:11:06.4388983Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-12-18T00:11:06.4394135Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-12-18T00:11:06.4399131Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-12-18T00:11:06.4404505Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-12-18T00:11:06.4409555Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-12-18T00:11:06.4415129Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-12-18T00:11:06.4420896Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-12-18T00:11:06.4425998Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-12-18T00:11:06.4431751Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-12-18T00:11:06.4439053Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-12-18T00:11:06.4445260Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-12-18T00:11:06.4451201Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-12-18T00:11:06.4482770Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-12-18T00:11:06.7233654Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-12-18T00:11:06.9806020Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-12-18T00:11:07.1704815Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-12-18T00:11:07.4305293Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'... 2024-12-18T00:11:07.7574809Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-12-18T00:11:09.9158844Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-12-18T00:11:23.7352310Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-12-18T00:11:24.1544427Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2024-12-18T00:11:26.3933064Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-12-18T00:11:27.0295365Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-12-18T00:11:27.6547275Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-12-18T00:11:28.8148864Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-12-18T00:11:30.9438954Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-12-18T00:11:36.2525922Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-12-18T00:11:38.0487445Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-12-18T00:11:39.5765826Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-12-18T00:11:41.0844662Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-12-18T00:11:41.5884589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-12-18T00:11:41.9703788Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-12-18T00:11:43.1167198Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-12-18T00:11:43.4835542Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-12-18T00:11:43.7485033Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-12-18T00:11:45.2675342Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-12-18T00:11:46.1709824Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-12-18T00:11:46.5332768Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-12-18T00:11:53.9666208Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-12-18T00:11:56.3255731Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-12-18T00:12:03.9347826Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-12-18T00:12:04.1968045Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-12-18T00:12:14.4829587Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-12-18T00:12:14.6732764Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-12-18T00:12:14.8963324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-12-18T00:12:16.0178701Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-12-18T00:12:16.3250758Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-12-18T00:12:16.9438645Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-12-18T00:12:17.3785225Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-12-18T00:12:17.3903166Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-12-18T00:12:17.3993175Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-12-18T00:12:17.4233545Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-12-18T00:12:17.4568258Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2024-12-18T00:12:17.4923808Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-12-18T00:12:18.1903324Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8' 2024-12-18T00:12:18.2136415Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-12-18T00:12:18.4405108Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57' 2024-12-18T00:12:18.4888546Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-12-18T00:12:18.5847952Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2024-12-18T00:12:18.6182128Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45' 2024-12-18T00:12:19.1084708Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-12-18T00:12:19.3557310Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-12-18T00:12:19.4500045Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-12-18T00:12:19.4518960Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:12:19.4520512Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:12:19.4522852Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:12:19.4525369Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:12:19.4528028Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:12:19.4555538Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-12-18T00:12:20.3562588Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-12-18T00:12:20.9725111Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-12-18T00:12:23.0656555Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-12-18T00:12:24.2260633Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-12-18T00:12:24.6021774Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-12-18T00:12:24.6964314Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-12-18T00:12:25.0913306Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-12-18T00:12:25.1536205Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-12-18T00:12:25.1666443Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-12-18T00:12:25.2956159Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-12-18T00:12:25.3350484Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-12-18T00:12:25.3750421Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-12-18T00:12:25.4010354Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-12-18T00:12:25.4449454Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2024-12-18T00:12:25.4581346Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b' 2024-12-18T00:12:25.4597276Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-12-18T00:12:25.4621714Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-12-18T00:12:40.6238587Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af' 2024-12-18T00:12:40.6422456Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-12-18T00:12:40.7278420Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d' 2024-12-18T00:12:40.7295325Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:12:40.7297292Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:12:40.7299946Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:12:40.7326806Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-12-18T00:12:41.6407147Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-12-18T00:12:43.0276343Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-12-18T00:12:44.2537703Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-12-18T00:12:44.2552721Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:12:44.2555318Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:12:44.2557606Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:12:44.2560698Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:12:44.2563488Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:12:44.2566368Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:12:44.2569239Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:12:44.2572203Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:12:44.2600640Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-12-18T00:12:45.1675716Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-12-18T00:12:45.5531346Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-12-18T00:12:46.9225236Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-12-18T00:12:47.2182928Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-12-18T00:12:47.7148010Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-12-18T00:12:49.3271012Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-12-18T00:12:57.1559671Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-12-18T00:12:57.5682637Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-12-18T00:12:57.5864451Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-12-18T00:12:57.6229281Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-12-18T00:12:57.6366670Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-12-18T00:12:57.6382568Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:12:57.6408720Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-12-18T00:12:57.9765794Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-12-18T00:12:57.9950638Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-12-18T00:12:58.0351657Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-12-18T00:12:58.1411235Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-12-18T00:12:58.1571723Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-12-18T00:12:58.1966529Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-12-18T00:12:58.2552219Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-12-18T00:12:58.2913035Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-12-18T00:12:58.3207861Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-12-18T00:12:58.4284800Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-12-18T00:12:58.7805574Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2024-12-18T00:12:58.7840686Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-12-18T00:12:58.7868210Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-12-18T00:12:59.9651394Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-12-18T00:13:00.0327942Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-12-18T00:13:00.0347670Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:00.0349954Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:00.0352622Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:00.0355368Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:00.0358436Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:00.0361232Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:00.0364234Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:00.0367250Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:00.0395156Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-12-18T00:13:00.4811305Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-12-18T00:13:01.7509279Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-12-18T00:13:02.0830849Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-12-18T00:13:09.5257660Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-12-18T00:13:09.8543678Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-12-18T00:13:10.0579005Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-12-18T00:13:10.3803024Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-12-18T00:13:17.4357485Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-12-18T00:13:17.4757067Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-12-18T00:13:17.4915017Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-12-18T00:13:17.5912863Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-12-18T00:13:17.6042684Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-12-18T00:13:17.6187671Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-12-18T00:13:17.6343797Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-12-18T00:13:17.6359797Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:17.6361902Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:17.6387856Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-12-18T00:13:19.8374435Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-12-18T00:13:21.2064760Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-12-18T00:13:21.2525530Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-12-18T00:13:21.7039924Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-12-18T00:13:21.7158943Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-12-18T00:13:21.9878634Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-12-18T00:13:21.9901834Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:21.9904335Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:21.9929673Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-12-18T00:13:22.4335323Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-12-18T00:13:23.6399065Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-12-18T00:13:23.7108786Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-12-18T00:13:23.7200638Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-12-18T00:13:23.7321371Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-12-18T00:13:23.7677381Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2024-12-18T00:13:23.7967151Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-12-18T00:13:23.8389811Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-12-18T00:13:23.8657662Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-12-18T00:13:23.8675232Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:23.8677781Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:23.8680566Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:23.8683520Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:23.8710546Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-12-18T00:13:25.0212307Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-12-18T00:13:25.2765711Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-12-18T00:13:27.5497952Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-12-18T00:13:28.6999038Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-12-18T00:13:28.7158979Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-12-18T00:13:28.7767700Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-12-18T00:13:28.8059012Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-12-18T00:13:28.8076906Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:28.8102201Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-12-18T00:13:29.0260038Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-12-18T00:13:29.0294310Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-12-18T00:13:29.0579909Z Entering 'android/libs/fbjni' 2024-12-18T00:13:29.0622404Z Entering 'third_party/FP16' 2024-12-18T00:13:29.0663642Z Entering 'third_party/FXdiv' 2024-12-18T00:13:29.0704836Z Entering 'third_party/NNPACK' 2024-12-18T00:13:29.0746714Z Entering 'third_party/NVTX' 2024-12-18T00:13:29.0787233Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:13:29.0827797Z Entering 'third_party/XNNPACK' 2024-12-18T00:13:29.0885599Z Entering 'third_party/benchmark' 2024-12-18T00:13:29.0927123Z Entering 'third_party/composable_kernel' 2024-12-18T00:13:29.0974020Z Entering 'third_party/cpp-httplib' 2024-12-18T00:13:29.1015015Z Entering 'third_party/cpuinfo' 2024-12-18T00:13:29.1055479Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:13:29.1095902Z Entering 'third_party/cutlass' 2024-12-18T00:13:29.1145631Z Entering 'third_party/eigen' 2024-12-18T00:13:29.1189618Z Entering 'third_party/fbgemm' 2024-12-18T00:13:29.1232798Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:13:29.1274740Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:13:29.1315511Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:13:29.1361899Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:13:29.1402579Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:13:29.1443714Z Entering 'third_party/flatbuffers' 2024-12-18T00:13:29.1488471Z Entering 'third_party/fmt' 2024-12-18T00:13:29.1527843Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:13:29.1572756Z Entering 'third_party/gloo' 2024-12-18T00:13:29.1613168Z Entering 'third_party/googletest' 2024-12-18T00:13:29.1652981Z Entering 'third_party/ideep' 2024-12-18T00:13:29.1692640Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:13:29.1741331Z Entering 'third_party/ittapi' 2024-12-18T00:13:29.1783717Z Entering 'third_party/kineto' 2024-12-18T00:13:29.1825700Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:13:29.1865639Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:13:29.1908585Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:13:29.1949168Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:13:29.1990150Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:13:29.2029513Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:13:29.2073255Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:13:29.2113168Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:13:29.2154155Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:13:29.2195950Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:13:29.2238798Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:13:29.2279265Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:13:29.2320390Z Entering 'third_party/mimalloc' 2024-12-18T00:13:29.2363542Z Entering 'third_party/nccl/nccl' 2024-12-18T00:13:29.2404594Z Entering 'third_party/nlohmann' 2024-12-18T00:13:29.2447267Z Entering 'third_party/onnx' 2024-12-18T00:13:29.2503448Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:13:29.2547752Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:13:29.2591137Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:29.2629393Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:29.2668745Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:29.2707490Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:29.2748264Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:29.2787525Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:29.2827473Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:29.2869521Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:29.2910766Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:29.2952588Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:29.3013275Z Entering 'third_party/pocketfft' 2024-12-18T00:13:29.3055957Z Entering 'third_party/protobuf' 2024-12-18T00:13:29.3100133Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:29.3139989Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:29.3182107Z Entering 'third_party/psimd' 2024-12-18T00:13:29.3223422Z Entering 'third_party/pthreadpool' 2024-12-18T00:13:29.3263496Z Entering 'third_party/pybind11' 2024-12-18T00:13:29.3304612Z Entering 'third_party/python-peachpy' 2024-12-18T00:13:29.3344751Z Entering 'third_party/sleef' 2024-12-18T00:13:29.3385014Z Entering 'third_party/tensorpipe' 2024-12-18T00:13:29.3425016Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:29.3464244Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:29.3504152Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:29.3548059Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:29.3587112Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:29.3641716Z ##[endgroup] 2024-12-18T00:13:29.3644266Z ##[group]Persisting credentials for submodules 2024-12-18T00:13:29.3648128Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-12-18T00:13:29.3928274Z Entering 'android/libs/fbjni' 2024-12-18T00:13:29.3982178Z Entering 'third_party/FP16' 2024-12-18T00:13:29.4034377Z Entering 'third_party/FXdiv' 2024-12-18T00:13:29.4086612Z Entering 'third_party/NNPACK' 2024-12-18T00:13:29.4138049Z Entering 'third_party/NVTX' 2024-12-18T00:13:29.4191705Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:13:29.4243723Z Entering 'third_party/XNNPACK' 2024-12-18T00:13:29.4313262Z Entering 'third_party/benchmark' 2024-12-18T00:13:29.4366330Z Entering 'third_party/composable_kernel' 2024-12-18T00:13:29.4424925Z Entering 'third_party/cpp-httplib' 2024-12-18T00:13:29.4478369Z Entering 'third_party/cpuinfo' 2024-12-18T00:13:29.4531730Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:13:29.4585277Z Entering 'third_party/cutlass' 2024-12-18T00:13:29.4646589Z Entering 'third_party/eigen' 2024-12-18T00:13:29.4701392Z Entering 'third_party/fbgemm' 2024-12-18T00:13:29.4754227Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:13:29.4805583Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:13:29.4857790Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:13:29.4917379Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:13:29.4969725Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:13:29.5021827Z Entering 'third_party/flatbuffers' 2024-12-18T00:13:29.5077654Z Entering 'third_party/fmt' 2024-12-18T00:13:29.5130140Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:13:29.5183498Z Entering 'third_party/gloo' 2024-12-18T00:13:29.5236376Z Entering 'third_party/googletest' 2024-12-18T00:13:29.5289227Z Entering 'third_party/ideep' 2024-12-18T00:13:29.5339801Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:13:29.5400712Z Entering 'third_party/ittapi' 2024-12-18T00:13:29.5453035Z Entering 'third_party/kineto' 2024-12-18T00:13:29.5504389Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:13:29.5555909Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:13:29.5609556Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:13:29.5660802Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:13:29.5711436Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:13:29.5763244Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:13:29.5816283Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:13:29.5867383Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:13:29.5917695Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:13:29.5971243Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:13:29.6023745Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:13:29.6074415Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:13:29.6126632Z Entering 'third_party/mimalloc' 2024-12-18T00:13:29.6180465Z Entering 'third_party/nccl/nccl' 2024-12-18T00:13:29.6233700Z Entering 'third_party/nlohmann' 2024-12-18T00:13:29.6289016Z Entering 'third_party/onnx' 2024-12-18T00:13:29.6357974Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:13:29.6412691Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:13:29.6468090Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:29.6519070Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:29.6569555Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:29.6620105Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:29.6671994Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:29.6721900Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:29.6772079Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:29.6821988Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:29.6874990Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:29.6927527Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:29.7000952Z Entering 'third_party/pocketfft' 2024-12-18T00:13:29.7053959Z Entering 'third_party/protobuf' 2024-12-18T00:13:29.7108217Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:29.7161198Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:29.7214173Z Entering 'third_party/psimd' 2024-12-18T00:13:29.7267245Z Entering 'third_party/pthreadpool' 2024-12-18T00:13:29.7319777Z Entering 'third_party/pybind11' 2024-12-18T00:13:29.7372427Z Entering 'third_party/python-peachpy' 2024-12-18T00:13:29.7423727Z Entering 'third_party/sleef' 2024-12-18T00:13:29.7476043Z Entering 'third_party/tensorpipe' 2024-12-18T00:13:29.7526823Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:29.7579828Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:29.7630078Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:29.7681586Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:29.7730460Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:29.7799765Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-12-18T00:13:29.8081715Z Entering 'android/libs/fbjni' 2024-12-18T00:13:29.8132130Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-12-18T00:13:29.8148699Z Entering 'third_party/FP16' 2024-12-18T00:13:29.8198676Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-12-18T00:13:29.8214826Z Entering 'third_party/FXdiv' 2024-12-18T00:13:29.8263338Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-12-18T00:13:29.8279035Z Entering 'third_party/NNPACK' 2024-12-18T00:13:29.8329970Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-12-18T00:13:29.8346752Z Entering 'third_party/NVTX' 2024-12-18T00:13:29.8395503Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2024-12-18T00:13:29.8411949Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:13:29.8461334Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-12-18T00:13:29.8477065Z Entering 'third_party/XNNPACK' 2024-12-18T00:13:29.8525898Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-12-18T00:13:29.8558402Z Entering 'third_party/benchmark' 2024-12-18T00:13:29.8607508Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:13:29.8623534Z Entering 'third_party/composable_kernel' 2024-12-18T00:13:29.8673485Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2024-12-18T00:13:29.8695765Z Entering 'third_party/cpp-httplib' 2024-12-18T00:13:29.8749471Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-12-18T00:13:29.8765364Z Entering 'third_party/cpuinfo' 2024-12-18T00:13:29.8813881Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:13:29.8830211Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:13:29.8880188Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-12-18T00:13:29.8895960Z Entering 'third_party/cutlass' 2024-12-18T00:13:29.8945289Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:13:29.8969539Z Entering 'third_party/eigen' 2024-12-18T00:13:29.9018444Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-12-18T00:13:29.9036549Z Entering 'third_party/fbgemm' 2024-12-18T00:13:29.9086298Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-12-18T00:13:29.9101883Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:13:29.9151460Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-12-18T00:13:29.9166751Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:13:29.9214790Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-12-18T00:13:29.9229880Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:13:29.9280496Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-12-18T00:13:29.9302051Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:13:29.9350011Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:29.9365042Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:13:29.9412354Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-12-18T00:13:29.9428525Z Entering 'third_party/flatbuffers' 2024-12-18T00:13:29.9479526Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-12-18T00:13:29.9497824Z Entering 'third_party/fmt' 2024-12-18T00:13:29.9548397Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:13:29.9564715Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:13:29.9613948Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-12-18T00:13:29.9629706Z Entering 'third_party/gloo' 2024-12-18T00:13:29.9679145Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-12-18T00:13:29.9695305Z Entering 'third_party/googletest' 2024-12-18T00:13:29.9743878Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:29.9759631Z Entering 'third_party/ideep' 2024-12-18T00:13:29.9808667Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-12-18T00:13:29.9823389Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:13:29.9870417Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-12-18T00:13:29.9893363Z Entering 'third_party/ittapi' 2024-12-18T00:13:29.9942352Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-12-18T00:13:29.9957917Z Entering 'third_party/kineto' 2024-12-18T00:13:30.0007994Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-12-18T00:13:30.0023360Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:13:30.0074470Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-12-18T00:13:30.0089465Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:13:30.0139371Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-12-18T00:13:30.0155983Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:13:30.0205724Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-12-18T00:13:30.0221973Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:13:30.0270629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-12-18T00:13:30.0286266Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:13:30.0335953Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-12-18T00:13:30.0350886Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:13:30.0401745Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-12-18T00:13:30.0418836Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:13:30.0469139Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-12-18T00:13:30.0484890Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:13:30.0533287Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:30.0549288Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:13:30.0597439Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-12-18T00:13:30.0614033Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:13:30.0663719Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-12-18T00:13:30.0681493Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:13:30.0731207Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-12-18T00:13:30.0747155Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:13:30.0795442Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-12-18T00:13:30.0813155Z Entering 'third_party/mimalloc' 2024-12-18T00:13:30.0865072Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-12-18T00:13:30.0881780Z Entering 'third_party/nccl/nccl' 2024-12-18T00:13:30.0930525Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-12-18T00:13:30.0948183Z Entering 'third_party/nlohmann' 2024-12-18T00:13:30.0997030Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-12-18T00:13:30.1014569Z Entering 'third_party/onnx' 2024-12-18T00:13:30.1065128Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-12-18T00:13:30.1096304Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:13:30.1147786Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:13:30.1166177Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:13:30.1220335Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-12-18T00:13:30.1237342Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:30.1288585Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:13:30.1303399Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:30.1354307Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:30.1369898Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:30.1417875Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-12-18T00:13:30.1433504Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:30.1482082Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-12-18T00:13:30.1498617Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:30.1548429Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-12-18T00:13:30.1563775Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:30.1611502Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-12-18T00:13:30.1627427Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:30.1675846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-12-18T00:13:30.1690357Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:30.1739399Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-12-18T00:13:30.1756866Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:30.1806650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-12-18T00:13:30.1825940Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:30.1875275Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-12-18T00:13:30.1912064Z Entering 'third_party/pocketfft' 2024-12-18T00:13:30.1961364Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-12-18T00:13:30.1977459Z Entering 'third_party/protobuf' 2024-12-18T00:13:30.2027467Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-12-18T00:13:30.2047016Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:30.2096228Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-12-18T00:13:30.2112239Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:30.2162042Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:30.2179043Z Entering 'third_party/psimd' 2024-12-18T00:13:30.2227834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-12-18T00:13:30.2245620Z Entering 'third_party/pthreadpool' 2024-12-18T00:13:30.2294633Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-12-18T00:13:30.2311279Z Entering 'third_party/pybind11' 2024-12-18T00:13:30.2361376Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:13:30.2377374Z Entering 'third_party/python-peachpy' 2024-12-18T00:13:30.2426015Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-12-18T00:13:30.2441467Z Entering 'third_party/sleef' 2024-12-18T00:13:30.2489213Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-12-18T00:13:30.2505381Z Entering 'third_party/tensorpipe' 2024-12-18T00:13:30.2554716Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-12-18T00:13:30.2570026Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:30.2618245Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-12-18T00:13:30.2633395Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:30.2682615Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-12-18T00:13:30.2697531Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:30.2747233Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-12-18T00:13:30.2762983Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:30.2811486Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-12-18T00:13:30.2825956Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:30.2875323Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-12-18T00:13:30.3455268Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-12-18T00:13:30.3743748Z Entering 'android/libs/fbjni' 2024-12-18T00:13:30.3785225Z Entering 'third_party/FP16' 2024-12-18T00:13:30.3825789Z Entering 'third_party/FXdiv' 2024-12-18T00:13:30.3866306Z Entering 'third_party/NNPACK' 2024-12-18T00:13:30.3906326Z Entering 'third_party/NVTX' 2024-12-18T00:13:30.3947539Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:13:30.3988778Z Entering 'third_party/XNNPACK' 2024-12-18T00:13:30.4046196Z Entering 'third_party/benchmark' 2024-12-18T00:13:30.4087468Z Entering 'third_party/composable_kernel' 2024-12-18T00:13:30.4135066Z Entering 'third_party/cpp-httplib' 2024-12-18T00:13:30.4177342Z Entering 'third_party/cpuinfo' 2024-12-18T00:13:30.4218240Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:13:30.4259011Z Entering 'third_party/cutlass' 2024-12-18T00:13:30.4311111Z Entering 'third_party/eigen' 2024-12-18T00:13:30.4354867Z Entering 'third_party/fbgemm' 2024-12-18T00:13:30.4396864Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:13:30.4436521Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:13:30.4478375Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:13:30.4524800Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:13:30.4566729Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:13:30.4607242Z Entering 'third_party/flatbuffers' 2024-12-18T00:13:30.4651019Z Entering 'third_party/fmt' 2024-12-18T00:13:30.4692751Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:13:30.4733831Z Entering 'third_party/gloo' 2024-12-18T00:13:30.4775949Z Entering 'third_party/googletest' 2024-12-18T00:13:30.4816289Z Entering 'third_party/ideep' 2024-12-18T00:13:30.4855893Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:13:30.4904327Z Entering 'third_party/ittapi' 2024-12-18T00:13:30.4947487Z Entering 'third_party/kineto' 2024-12-18T00:13:30.4989288Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:13:30.5028752Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:13:30.5071651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:13:30.5112608Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:13:30.5153550Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:13:30.5192027Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:13:30.5234282Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:13:30.5273879Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:13:30.5313767Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:13:30.5355393Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:13:30.5397038Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:13:30.5436802Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:13:30.5479389Z Entering 'third_party/mimalloc' 2024-12-18T00:13:30.5521421Z Entering 'third_party/nccl/nccl' 2024-12-18T00:13:30.5564599Z Entering 'third_party/nlohmann' 2024-12-18T00:13:30.5605910Z Entering 'third_party/onnx' 2024-12-18T00:13:30.5662398Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:13:30.5705019Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:13:30.5747686Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:30.5787202Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:30.5826998Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:30.5867024Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:30.5908066Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:30.5947816Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:30.5986882Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:30.6026437Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:30.6068096Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:30.6109423Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:30.6170644Z Entering 'third_party/pocketfft' 2024-12-18T00:13:30.6211139Z Entering 'third_party/protobuf' 2024-12-18T00:13:30.6255134Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:30.6294240Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:30.6335228Z Entering 'third_party/psimd' 2024-12-18T00:13:30.6376314Z Entering 'third_party/pthreadpool' 2024-12-18T00:13:30.6415732Z Entering 'third_party/pybind11' 2024-12-18T00:13:30.6457032Z Entering 'third_party/python-peachpy' 2024-12-18T00:13:30.6497225Z Entering 'third_party/sleef' 2024-12-18T00:13:30.6537475Z Entering 'third_party/tensorpipe' 2024-12-18T00:13:30.6580049Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:30.6619942Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:30.6659027Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:30.6698787Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:30.6736962Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:30.6792096Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-12-18T00:13:30.7070307Z Entering 'android/libs/fbjni' 2024-12-18T00:13:30.7110812Z Entering 'third_party/FP16' 2024-12-18T00:13:30.7151404Z Entering 'third_party/FXdiv' 2024-12-18T00:13:30.7192318Z Entering 'third_party/NNPACK' 2024-12-18T00:13:30.7231883Z Entering 'third_party/NVTX' 2024-12-18T00:13:30.7272550Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T00:13:30.7312780Z Entering 'third_party/XNNPACK' 2024-12-18T00:13:30.7368320Z Entering 'third_party/benchmark' 2024-12-18T00:13:30.7408263Z Entering 'third_party/composable_kernel' 2024-12-18T00:13:30.7454933Z Entering 'third_party/cpp-httplib' 2024-12-18T00:13:30.7495349Z Entering 'third_party/cpuinfo' 2024-12-18T00:13:30.7536336Z Entering 'third_party/cudnn_frontend' 2024-12-18T00:13:30.7576535Z Entering 'third_party/cutlass' 2024-12-18T00:13:30.7625448Z Entering 'third_party/eigen' 2024-12-18T00:13:30.7797054Z Entering 'third_party/fbgemm' 2024-12-18T00:13:30.7797801Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T00:13:30.7798853Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T00:13:30.7799603Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T00:13:30.7838526Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T00:13:30.7879378Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T00:13:30.7921687Z Entering 'third_party/flatbuffers' 2024-12-18T00:13:30.7965752Z Entering 'third_party/fmt' 2024-12-18T00:13:30.8006738Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T00:13:30.8046662Z Entering 'third_party/gloo' 2024-12-18T00:13:30.8087576Z Entering 'third_party/googletest' 2024-12-18T00:13:30.8127129Z Entering 'third_party/ideep' 2024-12-18T00:13:30.8167437Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T00:13:30.8215274Z Entering 'third_party/ittapi' 2024-12-18T00:13:30.8254899Z Entering 'third_party/kineto' 2024-12-18T00:13:30.8295103Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T00:13:30.8334993Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T00:13:30.8377822Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T00:13:30.8417674Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T00:13:30.8457927Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T00:13:30.8497337Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T00:13:30.8538360Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T00:13:30.8578743Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T00:13:30.8619758Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T00:13:30.8662301Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T00:13:30.8704143Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T00:13:30.8745538Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T00:13:30.8787181Z Entering 'third_party/mimalloc' 2024-12-18T00:13:30.8828889Z Entering 'third_party/nccl/nccl' 2024-12-18T00:13:30.8869526Z Entering 'third_party/nlohmann' 2024-12-18T00:13:30.8912180Z Entering 'third_party/onnx' 2024-12-18T00:13:30.8969710Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T00:13:30.9013963Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T00:13:30.9058452Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T00:13:30.9097201Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T00:13:30.9137582Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T00:13:30.9177038Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T00:13:30.9217985Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T00:13:30.9258793Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T00:13:30.9298415Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T00:13:30.9338629Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T00:13:30.9382530Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T00:13:30.9425684Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T00:13:30.9488249Z Entering 'third_party/pocketfft' 2024-12-18T00:13:30.9531068Z Entering 'third_party/protobuf' 2024-12-18T00:13:30.9579093Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T00:13:30.9620937Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T00:13:30.9665344Z Entering 'third_party/psimd' 2024-12-18T00:13:30.9708411Z Entering 'third_party/pthreadpool' 2024-12-18T00:13:30.9749928Z Entering 'third_party/pybind11' 2024-12-18T00:13:30.9791371Z Entering 'third_party/python-peachpy' 2024-12-18T00:13:30.9832332Z Entering 'third_party/sleef' 2024-12-18T00:13:30.9873864Z Entering 'third_party/tensorpipe' 2024-12-18T00:13:30.9915786Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T00:13:30.9957359Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T00:13:30.9999799Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T00:13:31.0038299Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T00:13:31.0077325Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T00:13:31.0130806Z ##[endgroup] 2024-12-18T00:13:31.0161248Z [command]/usr/bin/git log -1 --format='%H' 2024-12-18T00:13:31.0180956Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7' 2024-12-18T00:13:31.0354629Z Prepare all required actions 2024-12-18T00:13:31.0355206Z Getting action download info 2024-12-18T00:13:31.1792049Z ##[group]Run ./.github/actions/setup-linux 2024-12-18T00:13:31.1792398Z env: 2024-12-18T00:13:31.1792617Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:31.1792900Z ##[endgroup] 2024-12-18T00:13:31.1839031Z ##[group]Run set -euo pipefail 2024-12-18T00:13:31.1839436Z set -euo pipefail 2024-12-18T00:13:31.1839749Z function get_ec2_metadata() { 2024-12-18T00:13:31.1840155Z  # Pulled from instance metadata endpoint for EC2 2024-12-18T00:13:31.1840812Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-12-18T00:13:31.1841580Z  category=$1 2024-12-18T00:13:31.1841968Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-12-18T00:13:31.1842430Z  runner_name_str=i-0feeb5a43c4657cc6 2024-12-18T00:13:31.1842848Z  if [[ -f /.inarc ]]; then 2024-12-18T00:13:31.1843203Z  echo "ARC Runner, no info on ec2 metadata" 2024-12-18T00:13:31.1843612Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-12-18T00:13:31.1844101Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-12-18T00:13:31.1844556Z  else 2024-12-18T00:13:31.1845442Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-12-18T00:13:31.1846386Z  fi 2024-12-18T00:13:31.1846608Z } 2024-12-18T00:13:31.1846889Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-12-18T00:13:31.1847334Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-12-18T00:13:31.1847839Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-12-18T00:13:31.1848278Z echo "system info $(uname -a)" 2024-12-18T00:13:31.1857036Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:31.1857426Z env: 2024-12-18T00:13:31.1857667Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:31.1857953Z ##[endgroup] 2024-12-18T00:13:31.2001486Z ami-id: ami-0fff1b9a61dec8a5f 2024-12-18T00:13:31.2101077Z instance-id: i-0feeb5a43c4657cc6 2024-12-18T00:13:31.2199212Z instance-type: c5.2xlarge 2024-12-18T00:13:31.2209824Z system info Linux ip-10-0-37-101.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-12-18T00:13:31.2239243Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:13:31.2240222Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:13:31.2248056Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:31.2248480Z env: 2024-12-18T00:13:31.2248700Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:31.2248982Z ##[endgroup] 2024-12-18T00:13:31.2304880Z ##[group]Run if systemctl is-active --quiet docker; then 2024-12-18T00:13:31.2305361Z if systemctl is-active --quiet docker; then 2024-12-18T00:13:31.2305773Z  echo "Docker daemon is running..."; 2024-12-18T00:13:31.2306231Z else 2024-12-18T00:13:31.2306612Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-12-18T00:13:31.2307062Z fi 2024-12-18T00:13:31.2312650Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:31.2313053Z env: 2024-12-18T00:13:31.2313290Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:31.2313559Z ##[endgroup] 2024-12-18T00:13:31.2385940Z Docker daemon is running... 2024-12-18T00:13:31.2430181Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:13:31.2430519Z with: 2024-12-18T00:13:31.2430741Z shell: bash 2024-12-18T00:13:31.2431131Z timeout_minutes: 5 2024-12-18T00:13:31.2431394Z max_attempts: 3 2024-12-18T00:13:31.2431761Z retry_wait_seconds: 30 2024-12-18T00:13:31.2434119Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2024-12-18T00:13:31.2436494Z polling_interval_seconds: 1 2024-12-18T00:13:31.2436804Z warning_on_retry: true 2024-12-18T00:13:31.2437091Z continue_on_error: false 2024-12-18T00:13:31.2437355Z env: 2024-12-18T00:13:31.2437584Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:31.2437865Z AWS_RETRY_MODE: standard 2024-12-18T00:13:31.2438144Z AWS_MAX_ATTEMPTS: 5 2024-12-18T00:13:31.2438419Z AWS_DEFAULT_REGION: us-east-1 2024-12-18T00:13:31.2438697Z ##[endgroup] 2024-12-18T00:13:32.5230397Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:13:32.5231466Z Configure a credential helper to remove this warning. See 2024-12-18T00:13:32.5232266Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:13:32.5232667Z 2024-12-18T00:13:32.5232797Z Login Succeeded 2024-12-18T00:13:33.3309407Z Command completed after 1 attempt(s). 2024-12-18T00:13:33.3370423Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:13:33.3370990Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:13:33.3371477Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-12-18T00:13:33.3378003Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:33.3378417Z env: 2024-12-18T00:13:33.3378658Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.3378944Z ##[endgroup] 2024-12-18T00:13:33.3462928Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:13:33.3463541Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T00:13:33.3464008Z # shellcheck disable=SC2046 2024-12-18T00:13:33.3464351Z docker stop $(docker ps -q) || true 2024-12-18T00:13:33.3464715Z # Prune all of the docker images 2024-12-18T00:13:33.3465088Z docker system prune -af 2024-12-18T00:13:33.3470727Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:33.3471130Z env: 2024-12-18T00:13:33.3471370Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.3471749Z ##[endgroup] 2024-12-18T00:13:33.3728607Z "docker stop" requires at least 1 argument. 2024-12-18T00:13:33.3729059Z See 'docker stop --help'. 2024-12-18T00:13:33.3729243Z 2024-12-18T00:13:33.3729453Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-12-18T00:13:33.3729737Z 2024-12-18T00:13:33.3729867Z Stop one or more running containers 2024-12-18T00:13:33.3887610Z Total reclaimed space: 0B 2024-12-18T00:13:33.3928279Z ##[group]Run set +e 2024-12-18T00:13:33.3928599Z set +e 2024-12-18T00:13:33.3928853Z set -x 2024-12-18T00:13:33.3929248Z  2024-12-18T00:13:33.3929493Z PT_DOMAIN=download.pytorch.org 2024-12-18T00:13:33.3930100Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-12-18T00:13:33.3930888Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-12-18T00:13:33.3931444Z # one is returned at random 2024-12-18T00:13:33.3931852Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-12-18T00:13:33.3932248Z  2024-12-18T00:13:33.3932606Z if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:13:33.3933060Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-12-18T00:13:33.3933606Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-12-18T00:13:33.3934015Z  2024-12-18T00:13:33.3934265Z  if [ -z "${RESOLVED_IP}" ]; then 2024-12-18T00:13:33.3934669Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-12-18T00:13:33.3935041Z  exit 1 2024-12-18T00:13:33.3935287Z  fi 2024-12-18T00:13:33.3935517Z fi 2024-12-18T00:13:33.3935743Z  2024-12-18T00:13:33.3936014Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-12-18T00:13:33.3936387Z  # Clean up any old records first 2024-12-18T00:13:33.3936768Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-12-18T00:13:33.3937111Z fi 2024-12-18T00:13:33.3937333Z  2024-12-18T00:13:33.3937665Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-12-18T00:13:33.3938068Z cat /etc/hosts 2024-12-18T00:13:33.3944565Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:33.3944966Z env: 2024-12-18T00:13:33.3945201Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.3945482Z ##[endgroup] 2024-12-18T00:13:33.3968703Z + PT_DOMAIN=download.pytorch.org 2024-12-18T00:13:33.3974729Z ++ dig -4 +short download.pytorch.org 2024-12-18T00:13:33.3975398Z ++ tail -n1 2024-12-18T00:13:33.4893412Z + RESOLVED_IP=3.171.85.51 2024-12-18T00:13:33.4893959Z + '[' -z 3.171.85.51 ']' 2024-12-18T00:13:33.4894276Z + grep -r download.pytorch.org /etc/hosts 2024-12-18T00:13:33.4904988Z 3.167.99.125 download.pytorch.org 2024-12-18T00:13:33.4906187Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-12-18T00:13:33.7300458Z + echo '3.171.85.51 download.pytorch.org' 2024-12-18T00:13:33.7300895Z + sudo tee -a /etc/hosts 2024-12-18T00:13:33.7716374Z 3.171.85.51 download.pytorch.org 2024-12-18T00:13:33.7733948Z + cat /etc/hosts 2024-12-18T00:13:33.7743510Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-12-18T00:13:33.7749442Z ::1 localhost6 localhost6.localdomain6 2024-12-18T00:13:33.7749857Z 3.171.85.51 download.pytorch.org 2024-12-18T00:13:33.7956727Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6 2024-12-18T00:13:33.7957254Z with: 2024-12-18T00:13:33.7957933Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.7958702Z docker-build-dir: .ci/docker 2024-12-18T00:13:33.7959001Z working-directory: . 2024-12-18T00:13:33.7959369Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:33.7959784Z force-push: false 2024-12-18T00:13:33.7960026Z env: 2024-12-18T00:13:33.7960241Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.7960519Z ##[endgroup] 2024-12-18T00:13:33.7989820Z ##[group]Run set -ex 2024-12-18T00:13:33.7990180Z set -ex 2024-12-18T00:13:33.7990430Z  2024-12-18T00:13:33.7990850Z # If the docker build directory or the build script doesn't exist, the action will 2024-12-18T00:13:33.7991736Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-12-18T00:13:33.7992345Z # job could then download the pre-built image as usual 2024-12-18T00:13:33.7993026Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-12-18T00:13:33.7993532Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.7994015Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.7994447Z  2024-12-18T00:13:33.7994821Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-12-18T00:13:33.7995285Z  exit 0 2024-12-18T00:13:33.7995521Z else 2024-12-18T00:13:33.7995807Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.7996153Z fi 2024-12-18T00:13:33.7996374Z  2024-12-18T00:13:33.7996734Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-12-18T00:13:33.7997363Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-12-18T00:13:33.7997920Z  # use it as it is, but first let's extract the tag 2024-12-18T00:13:33.7998433Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-12-18T00:13:33.7998968Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.7999479Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.7999912Z else 2024-12-18T00:13:33.8000235Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-12-18T00:13:33.8000723Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.8001394Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.8001977Z fi 2024-12-18T00:13:33.8009020Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:33.8009423Z env: 2024-12-18T00:13:33.8009646Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.8009936Z REPO_NAME: pytorch 2024-12-18T00:13:33.8010655Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8011418Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:13:33.8011811Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:33.8012218Z ##[endgroup] 2024-12-18T00:13:33.8039439Z + [[ ! -d .ci/docker ]] 2024-12-18T00:13:33.8039983Z + [[ ! -f .ci/docker/build.sh ]] 2024-12-18T00:13:33.8040528Z + echo skip=false 2024-12-18T00:13:33.8041822Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-12-18T00:13:33.8047317Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8048155Z ++ awk -F '[:,]' '{print $2}' 2024-12-18T00:13:33.8069215Z + DOCKER_TAG=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8069688Z + echo docker-tag=45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8070518Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8106290Z ##[group]Run set +e 2024-12-18T00:13:33.8106643Z set +e 2024-12-18T00:13:33.8106893Z set -x 2024-12-18T00:13:33.8107131Z  2024-12-18T00:13:33.8107341Z login() { 2024-12-18T00:13:33.8107838Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:13:33.8108378Z } 2024-12-18T00:13:33.8108605Z  2024-12-18T00:13:33.8108830Z retry () { 2024-12-18T00:13:33.8109116Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:13:33.8109453Z } 2024-12-18T00:13:33.8109675Z  2024-12-18T00:13:33.8110064Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:13:33.8110393Z  2024-12-18T00:13:33.8110615Z START_TIME=$(date +%s) 2024-12-18T00:13:33.8110926Z # Wait up to 90 minutes 2024-12-18T00:13:33.8111304Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do 2024-12-18T00:13:33.8111932Z  # Check if image already exists, if it does then skip building it 2024-12-18T00:13:33.8112452Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-12-18T00:13:33.8112839Z  exit 0 2024-12-18T00:13:33.8113079Z  fi 2024-12-18T00:13:33.8113308Z  2024-12-18T00:13:33.8113707Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2024-12-18T00:13:33.8114401Z  # use this to differentiate between the Docker build and regular build jobs. For the 2024-12-18T00:13:33.8115081Z  # latter, it will wait for the Docker images to become available before continuing 2024-12-18T00:13:33.8115625Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2024-12-18T00:13:33.8116034Z  # It's a Docker build job, let's build the image 2024-12-18T00:13:33.8116393Z  break 2024-12-18T00:13:33.8116639Z  else 2024-12-18T00:13:33.8116992Z  # It's a regular build job, wait for the image to become available 2024-12-18T00:13:33.8117423Z  sleep 300 2024-12-18T00:13:33.8117669Z  fi 2024-12-18T00:13:33.8117901Z done 2024-12-18T00:13:33.8118127Z  2024-12-18T00:13:33.8118491Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-12-18T00:13:33.8119079Z # be empty. The default action would be to continue rebuild the image 2024-12-18T00:13:33.8119603Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-12-18T00:13:33.8120073Z  # if we're on the base branch then use the parent commit 2024-12-18T00:13:33.8120497Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-12-18T00:13:33.8120836Z else 2024-12-18T00:13:33.8121180Z  # otherwise we're on a PR, so use the most recent base commit 2024-12-18T00:13:33.8121674Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-12-18T00:13:33.8122046Z fi 2024-12-18T00:13:33.8122278Z  2024-12-18T00:13:33.8122522Z if [[ -z "${MERGE_BASE}" ]]; then 2024-12-18T00:13:33.8122895Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.8123240Z  2024-12-18T00:13:33.8123707Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-12-18T00:13:33.8124276Z  exit 0 2024-12-18T00:13:33.8124513Z fi 2024-12-18T00:13:33.8124857Z  2024-12-18T00:13:33.8125187Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-12-18T00:13:33.8125895Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-12-18T00:13:33.8126501Z  exit 1 2024-12-18T00:13:33.8126746Z fi 2024-12-18T00:13:33.8126973Z  2024-12-18T00:13:33.8127358Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-12-18T00:13:33.8128037Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-12-18T00:13:33.8128634Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-12-18T00:13:33.8129338Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-12-18T00:13:33.8130141Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-12-18T00:13:33.8130622Z fi 2024-12-18T00:13:33.8130845Z  2024-12-18T00:13:33.8131121Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-12-18T00:13:33.8137128Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:33.8137512Z env: 2024-12-18T00:13:33.8137742Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:33.8138038Z DOCKER_BUILD_DIR: .ci/docker 2024-12-18T00:13:33.8138398Z BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:13:33.8139200Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8139985Z DOCKER_TAG: 45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:33.8140423Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:33.8140835Z DOCKER_PUSH: 2024-12-18T00:13:33.8141299Z ##[endgroup] 2024-12-18T00:13:33.8165312Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:33.8165769Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:33.8168218Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:13:33.8169162Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:34.4151387Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:13:34.4152244Z Configure a credential helper to remove this warning. See 2024-12-18T00:13:34.4153029Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:13:34.4153448Z 2024-12-18T00:13:34.4153549Z Login Succeeded 2024-12-18T00:13:34.4166946Z ++ date +%s 2024-12-18T00:13:34.4175737Z + START_TIME=1734480814 2024-12-18T00:13:34.4179142Z ++ date +%s 2024-12-18T00:13:34.4187432Z + [[ 1734475414 -lt 1734480814 ]] 2024-12-18T00:13:34.4188292Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:34.6196117Z { 2024-12-18T00:13:34.6196419Z "schemaVersion": 2, 2024-12-18T00:13:34.6196887Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-12-18T00:13:34.6197545Z "config": { 2024-12-18T00:13:34.6197965Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-12-18T00:13:34.6198599Z "size": 41960, 2024-12-18T00:13:34.6199496Z "digest": "sha256:ba75b8db23c6110013be41fbdb3cc39e97537b627e86e17327cbf783b8db17b3" 2024-12-18T00:13:34.6200000Z }, 2024-12-18T00:13:34.6200219Z "layers": [ 2024-12-18T00:13:34.6200454Z { 2024-12-18T00:13:34.6200785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6201224Z "size": 30439933, 2024-12-18T00:13:34.6201673Z "digest": "sha256:7478e0ac0f23f94b2f27848fbcdf804a670fbf8d4bab26df842d40a10cd33059" 2024-12-18T00:13:34.6202172Z }, 2024-12-18T00:13:34.6202379Z { 2024-12-18T00:13:34.6202702Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6203421Z "size": 1824, 2024-12-18T00:13:34.6203844Z "digest": "sha256:99f9b4c5db9d26af801884278111d8c8fac3822b087561148f19196b7ed4dbeb" 2024-12-18T00:13:34.6204344Z }, 2024-12-18T00:13:34.6204553Z { 2024-12-18T00:13:34.6204881Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6205311Z "size": 313252818, 2024-12-18T00:13:34.6205744Z "digest": "sha256:6b3ed191d8d67595c1a6610af8416ed009f9581ef9f5a4598ac4b9d058d1cf31" 2024-12-18T00:13:34.6206226Z }, 2024-12-18T00:13:34.6206427Z { 2024-12-18T00:13:34.6206750Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6207180Z "size": 864, 2024-12-18T00:13:34.6207595Z "digest": "sha256:134f0bded43c908c026937bc7599a9d963ce7052f31c589799e1236df4105e2b" 2024-12-18T00:13:34.6208292Z }, 2024-12-18T00:13:34.6208513Z { 2024-12-18T00:13:34.6208835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6209279Z "size": 106, 2024-12-18T00:13:34.6209979Z "digest": "sha256:01b225caaa7ca0991422610f9c6627da173118e60ded6d8dd421e25e73e5b273" 2024-12-18T00:13:34.6211060Z }, 2024-12-18T00:13:34.6211268Z { 2024-12-18T00:13:34.6211596Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6212035Z "size": 703, 2024-12-18T00:13:34.6212463Z "digest": "sha256:a18b532d7d58da90b6d3f5af2c0ccc73837570f551e7d394c134bbca6eb56ae5" 2024-12-18T00:13:34.6212957Z }, 2024-12-18T00:13:34.6213166Z { 2024-12-18T00:13:34.6213492Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6213929Z "size": 1219, 2024-12-18T00:13:34.6214355Z "digest": "sha256:97a7f64b3a5e2c59b64126f4e81609e990e4c01e9cc4303854ea6a673d51e1b3" 2024-12-18T00:13:34.6214840Z }, 2024-12-18T00:13:34.6215045Z { 2024-12-18T00:13:34.6215380Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6215816Z "size": 484, 2024-12-18T00:13:34.6216250Z "digest": "sha256:34c0201c19b2476a61a21e315e19d82603d2f577daaa2f1dec75d6733c418f83" 2024-12-18T00:13:34.6216733Z }, 2024-12-18T00:13:34.6216940Z { 2024-12-18T00:13:34.6217275Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6217708Z "size": 110326299, 2024-12-18T00:13:34.6218156Z "digest": "sha256:0839e3e1edb9a84cdd1bde8243c5d65ec6987a01606d8e18fba9e886bca9b4b0" 2024-12-18T00:13:34.6218655Z }, 2024-12-18T00:13:34.6218865Z { 2024-12-18T00:13:34.6219190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6219620Z "size": 4149, 2024-12-18T00:13:34.6220048Z "digest": "sha256:f0173a8cb7e931d44cc4358da30da75f64e82ae2140e8f0dd42fa24e435180dc" 2024-12-18T00:13:34.6220546Z }, 2024-12-18T00:13:34.6220759Z { 2024-12-18T00:13:34.6221090Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6221525Z "size": 1860, 2024-12-18T00:13:34.6221962Z "digest": "sha256:6cae394dd1d995ac33b35e7bda638c4b447821b37655aaf7c615b0248d59015a" 2024-12-18T00:13:34.6222452Z }, 2024-12-18T00:13:34.6222663Z { 2024-12-18T00:13:34.6222998Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6223437Z "size": 700, 2024-12-18T00:13:34.6223854Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6224340Z }, 2024-12-18T00:13:34.6224543Z { 2024-12-18T00:13:34.6224870Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6225301Z "size": 479, 2024-12-18T00:13:34.6225723Z "digest": "sha256:8aa13ceb0248e8192f67bb3d91d029939f839d55712b01585e9eb801d1b0903a" 2024-12-18T00:13:34.6226212Z }, 2024-12-18T00:13:34.6226415Z { 2024-12-18T00:13:34.6226740Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6227178Z "size": 2836740749, 2024-12-18T00:13:34.6227625Z "digest": "sha256:b745a625ea1af10f0dfa59914c98579f2ad1d1c63662b30ba464f7d14558e4ec" 2024-12-18T00:13:34.6228225Z }, 2024-12-18T00:13:34.6228442Z { 2024-12-18T00:13:34.6228773Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6229210Z "size": 32, 2024-12-18T00:13:34.6229638Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6230128Z }, 2024-12-18T00:13:34.6230334Z { 2024-12-18T00:13:34.6230659Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6231094Z "size": 380, 2024-12-18T00:13:34.6231524Z "digest": "sha256:cf09f2e36d07c4acf350967d2d0ff56c40e8a09fac8ff27c6f48e5ae1b652eeb" 2024-12-18T00:13:34.6232165Z }, 2024-12-18T00:13:34.6232379Z { 2024-12-18T00:13:34.6232710Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6233146Z "size": 232173, 2024-12-18T00:13:34.6233583Z "digest": "sha256:221d65fe0e21c759945c5fc02e5e238928f2cccd386d7d9977bff251677ad9d9" 2024-12-18T00:13:34.6234076Z }, 2024-12-18T00:13:34.6234290Z { 2024-12-18T00:13:34.6234613Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6235132Z "size": 232, 2024-12-18T00:13:34.6235544Z "digest": "sha256:90c7367fa6c05203f0204598474fe481101262e85731d73960ad47753f842fa8" 2024-12-18T00:13:34.6236024Z }, 2024-12-18T00:13:34.6236240Z { 2024-12-18T00:13:34.6236566Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6237005Z "size": 3220515, 2024-12-18T00:13:34.6237440Z "digest": "sha256:161e4cd16162fa23ed4e736363b58fbea91355e57457740236d19d1cda4bcacd" 2024-12-18T00:13:34.6237920Z }, 2024-12-18T00:13:34.6238132Z { 2024-12-18T00:13:34.6238464Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6238894Z "size": 2004, 2024-12-18T00:13:34.6239312Z "digest": "sha256:51246848698796dd8824c85afdc432b78c307754e622ed3316d1dce2594c2e98" 2024-12-18T00:13:34.6239788Z }, 2024-12-18T00:13:34.6240001Z { 2024-12-18T00:13:34.6240336Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6240768Z "size": 105, 2024-12-18T00:13:34.6241406Z "digest": "sha256:2975d72db4cca26c101aaaebf551c05b75a71722ddb8c87563dd6ef53b7f7b9f" 2024-12-18T00:13:34.6241910Z }, 2024-12-18T00:13:34.6242114Z { 2024-12-18T00:13:34.6242438Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6242871Z "size": 565, 2024-12-18T00:13:34.6243284Z "digest": "sha256:04400a611323a91dff36d82f7524075e9592f15e2465fb49c902689e02980172" 2024-12-18T00:13:34.6243766Z }, 2024-12-18T00:13:34.6243977Z { 2024-12-18T00:13:34.6244302Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6244741Z "size": 32, 2024-12-18T00:13:34.6245166Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6245655Z }, 2024-12-18T00:13:34.6245866Z { 2024-12-18T00:13:34.6246197Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6246632Z "size": 104, 2024-12-18T00:13:34.6247053Z "digest": "sha256:ba1d531b36056c0edff55441e06153de8a2604365f1221d653a3acc08dabc87f" 2024-12-18T00:13:34.6247538Z }, 2024-12-18T00:13:34.6247732Z { 2024-12-18T00:13:34.6248074Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6248503Z "size": 504, 2024-12-18T00:13:34.6248931Z "digest": "sha256:df682a7f38c40d64b5e9ae1b6f5f2eb49bf21dd7edbc20ed191c87bdacacf8c1" 2024-12-18T00:13:34.6249426Z }, 2024-12-18T00:13:34.6249618Z { 2024-12-18T00:13:34.6249957Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6250391Z "size": 101109899, 2024-12-18T00:13:34.6250835Z "digest": "sha256:7789d1d9a4800a88d04ed1a98f689ca8c52d6afb6c3976ae0195da7abec3b8ed" 2024-12-18T00:13:34.6251322Z }, 2024-12-18T00:13:34.6251524Z { 2024-12-18T00:13:34.6251865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6252460Z "size": 109, 2024-12-18T00:13:34.6252895Z "digest": "sha256:fe86d66e51a7a2e6c90b8f6b5a70cb1b4bcb8640857bf2f1737eaf503139c7ad" 2024-12-18T00:13:34.6253398Z }, 2024-12-18T00:13:34.6253595Z { 2024-12-18T00:13:34.6253939Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6254368Z "size": 491, 2024-12-18T00:13:34.6254791Z "digest": "sha256:d91d0050d566ab780d1bad702108cd853e121595f52879cd07307a5b7f8ea454" 2024-12-18T00:13:34.6255271Z }, 2024-12-18T00:13:34.6255463Z { 2024-12-18T00:13:34.6255803Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6256234Z "size": 338, 2024-12-18T00:13:34.6256665Z "digest": "sha256:e3a5e5066e67d01a7b40d51e7c53c11019dea4ecad985a8d0dc3dc67ca70dcb4" 2024-12-18T00:13:34.6257160Z }, 2024-12-18T00:13:34.6257358Z { 2024-12-18T00:13:34.6257695Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6258129Z "size": 103, 2024-12-18T00:13:34.6258552Z "digest": "sha256:833e1ad1721aac3e95c044a3c4845c0de7b897a3341d2a291b93720bd744ad05" 2024-12-18T00:13:34.6259043Z }, 2024-12-18T00:13:34.6259340Z { 2024-12-18T00:13:34.6259677Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6260112Z "size": 1473, 2024-12-18T00:13:34.6260537Z "digest": "sha256:2e47d4f203a168af2fa38cc02f85c4765e46ea47337b8e469624a915d5c7b759" 2024-12-18T00:13:34.6261021Z }, 2024-12-18T00:13:34.6261221Z { 2024-12-18T00:13:34.6261562Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6261997Z "size": 448881696, 2024-12-18T00:13:34.6262442Z "digest": "sha256:ba61dc3263a45593df0df6197c945d7cebb70780288a64ce44778d6f732ebfc6" 2024-12-18T00:13:34.6262926Z }, 2024-12-18T00:13:34.6263120Z { 2024-12-18T00:13:34.6263465Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6263904Z "size": 164, 2024-12-18T00:13:34.6264341Z "digest": "sha256:aba6c0f8cfc889fc01a9f833e6d0a3b1ac3cd3464e816811d025c100c4b57fd8" 2024-12-18T00:13:34.6264832Z }, 2024-12-18T00:13:34.6265026Z { 2024-12-18T00:13:34.6265371Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6265805Z "size": 423, 2024-12-18T00:13:34.6266228Z "digest": "sha256:8a5b8ffb1a25c04f68c583c957b9001bdd8aa47a090a6d521c6af71bef2cc29a" 2024-12-18T00:13:34.6266720Z }, 2024-12-18T00:13:34.6266912Z { 2024-12-18T00:13:34.6267262Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6267701Z "size": 32, 2024-12-18T00:13:34.6268125Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6268617Z }, 2024-12-18T00:13:34.6268821Z { 2024-12-18T00:13:34.6269167Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6269602Z "size": 111, 2024-12-18T00:13:34.6270044Z "digest": "sha256:0d227ff5c87e792256d768a146ced335e5d5c4d330617ee4e787fd442ac573bc" 2024-12-18T00:13:34.6270530Z }, 2024-12-18T00:13:34.6270726Z { 2024-12-18T00:13:34.6271074Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6271517Z "size": 475, 2024-12-18T00:13:34.6272058Z "digest": "sha256:88ca106a70350461491ef212eb18fddf198fb6eae313d4a6d4e307c641802aed" 2024-12-18T00:13:34.6272558Z }, 2024-12-18T00:13:34.6272757Z { 2024-12-18T00:13:34.6273101Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6273539Z "size": 32, 2024-12-18T00:13:34.6273965Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6274459Z }, 2024-12-18T00:13:34.6274657Z { 2024-12-18T00:13:34.6275000Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6275436Z "size": 112, 2024-12-18T00:13:34.6275856Z "digest": "sha256:1d5f1bb5e2adc31c159f38e661143441213603554fed1353dbe285d1362199b2" 2024-12-18T00:13:34.6276478Z }, 2024-12-18T00:13:34.6276678Z { 2024-12-18T00:13:34.6277025Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6277461Z "size": 565, 2024-12-18T00:13:34.6277877Z "digest": "sha256:54482636fb369edf856429b9858987ef2b1c155ea071b91705e613de6a76e2e4" 2024-12-18T00:13:34.6278348Z }, 2024-12-18T00:13:34.6278540Z { 2024-12-18T00:13:34.6278880Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6279311Z "size": 43164410, 2024-12-18T00:13:34.6279750Z "digest": "sha256:25fd8ec17dbac7311e5642175a6919bb55f277edbd30773f1bd328e2c07ca6dd" 2024-12-18T00:13:34.6280251Z }, 2024-12-18T00:13:34.6280441Z { 2024-12-18T00:13:34.6280789Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6281218Z "size": 106, 2024-12-18T00:13:34.6281637Z "digest": "sha256:d9b7184b25fa5ba66311c7d51719eb15cd58a706a38df2c71f3d800235ffb40e" 2024-12-18T00:13:34.6282122Z }, 2024-12-18T00:13:34.6282314Z { 2024-12-18T00:13:34.6282654Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6283090Z "size": 296, 2024-12-18T00:13:34.6283585Z "digest": "sha256:a3161fc6f7f1b48ed628663f58d452249d7f3b91f9782f10abaf8b3ccc9bef22" 2024-12-18T00:13:34.6284079Z }, 2024-12-18T00:13:34.6284278Z { 2024-12-18T00:13:34.6284627Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6285071Z "size": 32, 2024-12-18T00:13:34.6285503Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6285999Z }, 2024-12-18T00:13:34.6286197Z { 2024-12-18T00:13:34.6286543Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6286974Z "size": 106, 2024-12-18T00:13:34.6287383Z "digest": "sha256:a5c771445223f395aba1c15100bf14954f2308176970fc90106f6f955180e50b" 2024-12-18T00:13:34.6287860Z }, 2024-12-18T00:13:34.6288051Z { 2024-12-18T00:13:34.6288396Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6288821Z "size": 425, 2024-12-18T00:13:34.6289238Z "digest": "sha256:ef13954e836fa6c66410b690b3aceb88514886592c1a86111525dfae1aa0cfef" 2024-12-18T00:13:34.6289725Z }, 2024-12-18T00:13:34.6289918Z { 2024-12-18T00:13:34.6290254Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6290687Z "size": 19308715, 2024-12-18T00:13:34.6291121Z "digest": "sha256:3ad11112ed644d132501d781f2aa3c4c0ad4d7ffa2425853a06bb9f189e131dd" 2024-12-18T00:13:34.6291604Z }, 2024-12-18T00:13:34.6291800Z { 2024-12-18T00:13:34.6292142Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6292569Z "size": 108, 2024-12-18T00:13:34.6292988Z "digest": "sha256:217e79f06cdca7b54285010edd1d1f090041472d4e1f834eb4585c05b9297cd0" 2024-12-18T00:13:34.6293518Z }, 2024-12-18T00:13:34.6293715Z { 2024-12-18T00:13:34.6294058Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6294487Z "size": 644, 2024-12-18T00:13:34.6294918Z "digest": "sha256:016c3af2b5ea4aeb71bde31af26f9a8512470962e48cbaae3a4f06fb69c7344c" 2024-12-18T00:13:34.6295414Z }, 2024-12-18T00:13:34.6295606Z { 2024-12-18T00:13:34.6295944Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6296369Z "size": 700, 2024-12-18T00:13:34.6296783Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6297263Z }, 2024-12-18T00:13:34.6297457Z { 2024-12-18T00:13:34.6297801Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6298237Z "size": 142, 2024-12-18T00:13:34.6298673Z "digest": "sha256:ea3ba6dc5d33eef450b3f02e25fec80615f6c3c510bf5cf91b982a8f48dc7eb2" 2024-12-18T00:13:34.6299158Z }, 2024-12-18T00:13:34.6299365Z { 2024-12-18T00:13:34.6299701Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6300220Z "size": 136, 2024-12-18T00:13:34.6300636Z "digest": "sha256:3e21197363582ab81b92d1a916d365624d44259b15f48abfbdc912b7308758ea" 2024-12-18T00:13:34.6301108Z }, 2024-12-18T00:13:34.6301326Z { 2024-12-18T00:13:34.6301668Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6302109Z "size": 32, 2024-12-18T00:13:34.6302540Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6303019Z }, 2024-12-18T00:13:34.6303227Z { 2024-12-18T00:13:34.6303567Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6304000Z "size": 195, 2024-12-18T00:13:34.6304428Z "digest": "sha256:142b9ab7f81f0301b624f197d12da20bcbf3397dc3aaefaf59cc40a0acf614e0" 2024-12-18T00:13:34.6304908Z }, 2024-12-18T00:13:34.6305116Z { 2024-12-18T00:13:34.6305453Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6305890Z "size": 1402, 2024-12-18T00:13:34.6306327Z "digest": "sha256:8fab0d26d5622c4cc78d754ec3af4a8fbe7e18ac7fa773af67cf092435a32e73" 2024-12-18T00:13:34.6306810Z }, 2024-12-18T00:13:34.6307016Z { 2024-12-18T00:13:34.6307420Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6307855Z "size": 700, 2024-12-18T00:13:34.6308267Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6308735Z }, 2024-12-18T00:13:34.6308952Z { 2024-12-18T00:13:34.6309293Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6309725Z "size": 137, 2024-12-18T00:13:34.6310152Z "digest": "sha256:a7792d7941ff03ef1b4bcc927753df7d85c1fb9b79f78da4e05558bc6e0dfd0b" 2024-12-18T00:13:34.6310629Z }, 2024-12-18T00:13:34.6310834Z { 2024-12-18T00:13:34.6311175Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6311694Z "size": 4134303801, 2024-12-18T00:13:34.6312130Z "digest": "sha256:19f9786e817528f0646113207a687ad908dd7447b67e0ec001a471ab27522ba8" 2024-12-18T00:13:34.6312594Z }, 2024-12-18T00:13:34.6312800Z { 2024-12-18T00:13:34.6313138Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6313577Z "size": 156, 2024-12-18T00:13:34.6314002Z "digest": "sha256:95cf8d950d0a8233cd88d836382f6fd5f1ff98f9e690fa972b998ac794f668d6" 2024-12-18T00:13:34.6314478Z }, 2024-12-18T00:13:34.6314689Z { 2024-12-18T00:13:34.6315025Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6315459Z "size": 1402, 2024-12-18T00:13:34.6315890Z "digest": "sha256:8fab0d26d5622c4cc78d754ec3af4a8fbe7e18ac7fa773af67cf092435a32e73" 2024-12-18T00:13:34.6316366Z }, 2024-12-18T00:13:34.6316578Z { 2024-12-18T00:13:34.6316919Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6317346Z "size": 700, 2024-12-18T00:13:34.6317762Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6318230Z }, 2024-12-18T00:13:34.6318434Z { 2024-12-18T00:13:34.6318776Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6319209Z "size": 140, 2024-12-18T00:13:34.6319628Z "digest": "sha256:da70495326cb983c5851ab3d9e84313164ba09c3e1c15d098f01e919bc31e5e6" 2024-12-18T00:13:34.6320104Z }, 2024-12-18T00:13:34.6320310Z { 2024-12-18T00:13:34.6320653Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6321082Z "size": 32, 2024-12-18T00:13:34.6321502Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6321979Z }, 2024-12-18T00:13:34.6322183Z { 2024-12-18T00:13:34.6322516Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6322949Z "size": 161, 2024-12-18T00:13:34.6323369Z "digest": "sha256:b42f0c5083b29c6456f26a9f6d0dfd6b4904493ac71e5af4c78f897a4a78c413" 2024-12-18T00:13:34.6323840Z }, 2024-12-18T00:13:34.6324138Z { 2024-12-18T00:13:34.6324480Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6324913Z "size": 680, 2024-12-18T00:13:34.6325345Z "digest": "sha256:59555bf5155934a4c5cf29ad2bce3eb3d391d1507e03b9afd03a1034eebafe83" 2024-12-18T00:13:34.6325817Z }, 2024-12-18T00:13:34.6326024Z { 2024-12-18T00:13:34.6326363Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6326794Z "size": 700, 2024-12-18T00:13:34.6327208Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6327676Z }, 2024-12-18T00:13:34.6327881Z { 2024-12-18T00:13:34.6328218Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6328643Z "size": 138, 2024-12-18T00:13:34.6329068Z "digest": "sha256:fd368c9493e625c55fa72f6c84b4a350c99fbfb3b097dce60cceb45fce27af55" 2024-12-18T00:13:34.6329549Z }, 2024-12-18T00:13:34.6329753Z { 2024-12-18T00:13:34.6330091Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6330522Z "size": 32, 2024-12-18T00:13:34.6330941Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6331481Z }, 2024-12-18T00:13:34.6331687Z { 2024-12-18T00:13:34.6332031Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6332469Z "size": 159, 2024-12-18T00:13:34.6332891Z "digest": "sha256:eeba4480f3363505eb3c94692cf63c55b2e92601604e6282fd73cb741ad94135" 2024-12-18T00:13:34.6333363Z }, 2024-12-18T00:13:34.6333568Z { 2024-12-18T00:13:34.6333909Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6334338Z "size": 907, 2024-12-18T00:13:34.6334763Z "digest": "sha256:23872424bbb0e170ebf967174efc23cfa2718fc7801a66aca1aec5a9fab6e1ab" 2024-12-18T00:13:34.6335233Z }, 2024-12-18T00:13:34.6335440Z { 2024-12-18T00:13:34.6335783Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6336271Z "size": 700, 2024-12-18T00:13:34.6336993Z "digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d" 2024-12-18T00:13:34.6337572Z }, 2024-12-18T00:13:34.6339003Z { 2024-12-18T00:13:34.6339411Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6339938Z "size": 135, 2024-12-18T00:13:34.6340465Z "digest": "sha256:aa3c5e8778112bc12e2223c552cb35e062cf580e873e1d240b253f527065997a" 2024-12-18T00:13:34.6341060Z }, 2024-12-18T00:13:34.6341567Z { 2024-12-18T00:13:34.6341989Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6342530Z "size": 32, 2024-12-18T00:13:34.6343065Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6343671Z }, 2024-12-18T00:13:34.6343973Z { 2024-12-18T00:13:34.6344380Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6344979Z "size": 159, 2024-12-18T00:13:34.6345501Z "digest": "sha256:7069d9cf23ac57480d5de3be688d22e94f96e91f08ab25a6515f31e95071b419" 2024-12-18T00:13:34.6346076Z }, 2024-12-18T00:13:34.6346420Z { 2024-12-18T00:13:34.6346860Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6347319Z "size": 1519, 2024-12-18T00:13:34.6347867Z "digest": "sha256:05e4316d907ec40a483078f09c6b60033f92418eb013c63827ae495e2f08052c" 2024-12-18T00:13:34.6348450Z }, 2024-12-18T00:13:34.6348764Z { 2024-12-18T00:13:34.6349211Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6349700Z "size": 32, 2024-12-18T00:13:34.6350268Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6350877Z }, 2024-12-18T00:13:34.6351178Z { 2024-12-18T00:13:34.6351700Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6352197Z "size": 137, 2024-12-18T00:13:34.6352897Z "digest": "sha256:68fad68dd1962fe1b7848933a121dba3e42f24bfce82f33842272bceb005d9f2" 2024-12-18T00:13:34.6353526Z }, 2024-12-18T00:13:34.6353840Z { 2024-12-18T00:13:34.6354268Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6354843Z "size": 379, 2024-12-18T00:13:34.6355320Z "digest": "sha256:aae57a8763e18b8f0b04691e4ee259627424c1e99940df6e2d792fd4bec344d8" 2024-12-18T00:13:34.6355919Z }, 2024-12-18T00:13:34.6356268Z { 2024-12-18T00:13:34.6356704Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6357239Z "size": 32, 2024-12-18T00:13:34.6357729Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6358319Z }, 2024-12-18T00:13:34.6358631Z { 2024-12-18T00:13:34.6359078Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6359600Z "size": 104, 2024-12-18T00:13:34.6360093Z "digest": "sha256:d0b74f061e3ae344d82d99f2768a7302e69f57372b5d7e7a78affe0ab26516e5" 2024-12-18T00:13:34.6360688Z }, 2024-12-18T00:13:34.6361033Z { 2024-12-18T00:13:34.6361494Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6362119Z "size": 1931, 2024-12-18T00:13:34.6362622Z "digest": "sha256:e90b13a95dd7bacbff95b02eac0b70842234bda3b03a472f3eefd1417a3882e7" 2024-12-18T00:13:34.6363246Z }, 2024-12-18T00:13:34.6363563Z { 2024-12-18T00:13:34.6363974Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6364544Z "size": 197395631, 2024-12-18T00:13:34.6365053Z "digest": "sha256:ba692f76a3d83a54eb95a66772bbcafa7400dfe6a9d1aed65ee8dc8b949a9f27" 2024-12-18T00:13:34.6365621Z }, 2024-12-18T00:13:34.6365972Z { 2024-12-18T00:13:34.6366463Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6366999Z "size": 106, 2024-12-18T00:13:34.6367546Z "digest": "sha256:b22d4aaf13863f9a27cbe6b91fea8f3ae725f1728031fb861d64da51b5ae00f6" 2024-12-18T00:13:34.6368098Z }, 2024-12-18T00:13:34.6368407Z { 2024-12-18T00:13:34.6368861Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6369388Z "size": 164, 2024-12-18T00:13:34.6369923Z "digest": "sha256:212816d8ea816ba1365cb681004827f875c957e670fd91b83a79a92bd832dd16" 2024-12-18T00:13:34.6370456Z }, 2024-12-18T00:13:34.6370756Z { 2024-12-18T00:13:34.6371229Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6371797Z "size": 7943, 2024-12-18T00:13:34.6372299Z "digest": "sha256:1d707d05231062a13fe7180fc5825619eff56d4e732b4be1a4bf9f26075ffe00" 2024-12-18T00:13:34.6372878Z }, 2024-12-18T00:13:34.6373182Z { 2024-12-18T00:13:34.6373597Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6374182Z "size": 8066, 2024-12-18T00:13:34.6374711Z "digest": "sha256:7bde8a5319084e224c6afbdc3b05ea1fb10d0e67b0c96bc4d2f935f5afd5f568" 2024-12-18T00:13:34.6375304Z }, 2024-12-18T00:13:34.6375584Z { 2024-12-18T00:13:34.6376018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6376556Z "size": 303, 2024-12-18T00:13:34.6377133Z "digest": "sha256:fa2e62eb409d03eeb4c0399450bbfe0c08d47cd8a3eb069b680b6afa4fb4d4f7" 2024-12-18T00:13:34.6377719Z }, 2024-12-18T00:13:34.6377987Z { 2024-12-18T00:13:34.6378436Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6378970Z "size": 32, 2024-12-18T00:13:34.6391508Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6392126Z }, 2024-12-18T00:13:34.6392343Z { 2024-12-18T00:13:34.6392690Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6393118Z "size": 108, 2024-12-18T00:13:34.6393540Z "digest": "sha256:c321a0735855403c37c79f3a5ce24e0304381510a1222c76e083bc50ed5e4e23" 2024-12-18T00:13:34.6394021Z }, 2024-12-18T00:13:34.6394231Z { 2024-12-18T00:13:34.6394748Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6395166Z "size": 54145661, 2024-12-18T00:13:34.6395620Z "digest": "sha256:a2109a0ad5a98d339a44fb7a90829c2ff7b29ccfb98a05562351ea8eb542f50f" 2024-12-18T00:13:34.6396106Z }, 2024-12-18T00:13:34.6396311Z { 2024-12-18T00:13:34.6396653Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-12-18T00:13:34.6397074Z "size": 32, 2024-12-18T00:13:34.6397497Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-12-18T00:13:34.6397993Z } 2024-12-18T00:13:34.6398197Z ] 2024-12-18T00:13:34.6398400Z } 2024-12-18T00:13:34.6398615Z + exit 0 2024-12-18T00:13:34.6437128Z ##[group]Run set -eux 2024-12-18T00:13:34.6437453Z set -eux 2024-12-18T00:13:34.6438375Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin 2024-12-18T00:13:34.6445353Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:34.6445763Z env: 2024-12-18T00:13:34.6446100Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:34.6446381Z ##[endgroup] 2024-12-18T00:13:34.6475713Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2024-12-18T00:13:34.6476572Z + jq --raw-output .SecretString 2024-12-18T00:13:34.6477200Z + jq -r .docker_hub_readonly_token 2024-12-18T00:13:34.6478932Z + docker login --username pytorchbot --password-stdin 2024-12-18T00:13:35.2968109Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:13:35.2968762Z Configure a credential helper to remove this warning. See 2024-12-18T00:13:35.2969361Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:13:35.2969810Z 2024-12-18T00:13:35.2970336Z Login Succeeded 2024-12-18T00:13:35.3056956Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:13:35.3057353Z tag=${ECR_DOCKER_IMAGE##*/} 2024-12-18T00:13:35.3057777Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-12-18T00:13:35.3063642Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:35.3064037Z env: 2024-12-18T00:13:35.3064268Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:35.3064991Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.3065723Z ##[endgroup] 2024-12-18T00:13:35.3091211Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.9-gcc11-45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.3143750Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6 2024-12-18T00:13:35.3144240Z with: 2024-12-18T00:13:35.3144897Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.3145722Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:35.3146123Z env: 2024-12-18T00:13:35.3146352Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:35.3146649Z ##[endgroup] 2024-12-18T00:13:35.3171392Z ##[group]Run set -x 2024-12-18T00:13:35.3171691Z set -x 2024-12-18T00:13:35.3171948Z set +e 2024-12-18T00:13:35.3172178Z  2024-12-18T00:13:35.3172405Z login() { 2024-12-18T00:13:35.3172902Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-12-18T00:13:35.3173445Z } 2024-12-18T00:13:35.3173671Z  2024-12-18T00:13:35.3173939Z retry () { 2024-12-18T00:13:35.3174227Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-12-18T00:13:35.3174549Z } 2024-12-18T00:13:35.3174772Z  2024-12-18T00:13:35.3175021Z retry login "${DOCKER_REGISTRY}" 2024-12-18T00:13:35.3175343Z  2024-12-18T00:13:35.3175569Z set -e 2024-12-18T00:13:35.3175923Z # ignore output since only exit code is used for conditional 2024-12-18T00:13:35.3176441Z # only pull docker image if it's not available locally 2024-12-18T00:13:35.3177030Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-12-18T00:13:35.3177554Z  retry docker pull "${DOCKER_IMAGE}" 2024-12-18T00:13:35.3177895Z fi 2024-12-18T00:13:35.3183434Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:13:35.3183818Z env: 2024-12-18T00:13:35.3184058Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:13:35.3184768Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.3185602Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:35.3186007Z ##[endgroup] 2024-12-18T00:13:35.3208558Z + set +e 2024-12-18T00:13:35.3209221Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:35.3209704Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:35.3212247Z + aws ecr get-login-password --region us-east-1 2024-12-18T00:13:35.3213207Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-12-18T00:13:35.8892936Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-12-18T00:13:35.8893608Z Configure a credential helper to remove this warning. See 2024-12-18T00:13:35.8894459Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-12-18T00:13:35.8895064Z 2024-12-18T00:13:35.8895211Z Login Succeeded 2024-12-18T00:13:35.8907357Z + set -e 2024-12-18T00:13:35.9036060Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.9037326Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:35.9038480Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:13:36.1263236Z 45e1356b47a284893081276eff3000b7b534f3b1: Pulling from pytorch/pytorch-linux-jammy-py3.9-gcc11 2024-12-18T00:13:36.1268954Z 7478e0ac0f23: Pulling fs layer 2024-12-18T00:13:36.1270081Z 99f9b4c5db9d: Pulling fs layer 2024-12-18T00:13:36.1271442Z 6b3ed191d8d6: Pulling fs layer 2024-12-18T00:13:36.1272248Z 134f0bded43c: Pulling fs layer 2024-12-18T00:13:36.1273000Z 01b225caaa7c: Pulling fs layer 2024-12-18T00:13:36.1274086Z a18b532d7d58: Pulling fs layer 2024-12-18T00:13:36.1274730Z 97a7f64b3a5e: Pulling fs layer 2024-12-18T00:13:36.1275239Z 34c0201c19b2: Pulling fs layer 2024-12-18T00:13:36.1275767Z 0839e3e1edb9: Pulling fs layer 2024-12-18T00:13:36.1276281Z f0173a8cb7e9: Pulling fs layer 2024-12-18T00:13:36.1276799Z 6cae394dd1d9: Pulling fs layer 2024-12-18T00:13:36.1277264Z 02463c0b1de0: Pulling fs layer 2024-12-18T00:13:36.1277745Z 8aa13ceb0248: Pulling fs layer 2024-12-18T00:13:36.1278232Z b745a625ea1a: Pulling fs layer 2024-12-18T00:13:36.1278785Z 97a7f64b3a5e: Waiting 2024-12-18T00:13:36.1279181Z a18b532d7d58: Waiting 2024-12-18T00:13:36.1279666Z 4f4fb700ef54: Pulling fs layer 2024-12-18T00:13:36.1280183Z 134f0bded43c: Waiting 2024-12-18T00:13:36.1280651Z cf09f2e36d07: Pulling fs layer 2024-12-18T00:13:36.1280984Z 34c0201c19b2: Waiting 2024-12-18T00:13:36.1281236Z 221d65fe0e21: Pulling fs layer 2024-12-18T00:13:36.1281526Z 0839e3e1edb9: Waiting 2024-12-18T00:13:36.1281780Z f0173a8cb7e9: Waiting 2024-12-18T00:13:36.1282052Z 90c7367fa6c0: Pulling fs layer 2024-12-18T00:13:36.1282344Z 161e4cd16162: Pulling fs layer 2024-12-18T00:13:36.1282679Z 512468486987: Pulling fs layer 2024-12-18T00:13:36.1283075Z 02463c0b1de0: Waiting 2024-12-18T00:13:36.1283347Z b745a625ea1a: Waiting 2024-12-18T00:13:36.1283612Z 2975d72db4cc: Pulling fs layer 2024-12-18T00:13:36.1283900Z 8aa13ceb0248: Waiting 2024-12-18T00:13:36.1284141Z 4f4fb700ef54: Waiting 2024-12-18T00:13:36.1284399Z cf09f2e36d07: Waiting 2024-12-18T00:13:36.1284667Z 04400a611323: Pulling fs layer 2024-12-18T00:13:36.1284949Z 221d65fe0e21: Waiting 2024-12-18T00:13:36.1285260Z ba1d531b3605: Pulling fs layer 2024-12-18T00:13:36.1285556Z 90c7367fa6c0: Waiting 2024-12-18T00:13:36.1285831Z df682a7f38c4: Pulling fs layer 2024-12-18T00:13:36.1286122Z 161e4cd16162: Waiting 2024-12-18T00:13:36.1286374Z 512468486987: Waiting 2024-12-18T00:13:36.1286620Z 7789d1d9a480: Pulling fs layer 2024-12-18T00:13:36.1286907Z 2975d72db4cc: Waiting 2024-12-18T00:13:36.1287171Z fe86d66e51a7: Pulling fs layer 2024-12-18T00:13:36.1287462Z 04400a611323: Waiting 2024-12-18T00:13:36.1287774Z d91d0050d566: Pulling fs layer 2024-12-18T00:13:36.1288110Z e3a5e5066e67: Pulling fs layer 2024-12-18T00:13:36.1288394Z 833e1ad1721a: Pulling fs layer 2024-12-18T00:13:36.1288785Z 2e47d4f203a1: Pulling fs layer 2024-12-18T00:13:36.1289085Z ba61dc3263a4: Pulling fs layer 2024-12-18T00:13:36.1289372Z ba1d531b3605: Waiting 2024-12-18T00:13:36.1289678Z aba6c0f8cfc8: Pulling fs layer 2024-12-18T00:13:36.1289972Z 8a5b8ffb1a25: Pulling fs layer 2024-12-18T00:13:36.1290557Z df682a7f38c4: Waiting 2024-12-18T00:13:36.1290831Z 0d227ff5c87e: Pulling fs layer 2024-12-18T00:13:36.1291168Z 7789d1d9a480: Waiting 2024-12-18T00:13:36.1291432Z 88ca106a7035: Pulling fs layer 2024-12-18T00:13:36.1291717Z fe86d66e51a7: Waiting 2024-12-18T00:13:36.1292022Z d91d0050d566: Waiting 2024-12-18T00:13:36.1292278Z e3a5e5066e67: Waiting 2024-12-18T00:13:36.1292589Z 1d5f1bb5e2ad: Pulling fs layer 2024-12-18T00:13:36.1292925Z 833e1ad1721a: Waiting 2024-12-18T00:13:36.1293183Z 54482636fb36: Pulling fs layer 2024-12-18T00:13:36.1293486Z 25fd8ec17dba: Pulling fs layer 2024-12-18T00:13:36.1293785Z d9b7184b25fa: Pulling fs layer 2024-12-18T00:13:36.1294073Z 0d227ff5c87e: Waiting 2024-12-18T00:13:36.1294329Z 2e47d4f203a1: Waiting 2024-12-18T00:13:36.1294614Z 88ca106a7035: Waiting 2024-12-18T00:13:36.1294873Z aba6c0f8cfc8: Waiting 2024-12-18T00:13:36.1295127Z ba61dc3263a4: Waiting 2024-12-18T00:13:36.1295388Z a3161fc6f7f1: Pulling fs layer 2024-12-18T00:13:36.1295672Z 1d5f1bb5e2ad: Waiting 2024-12-18T00:13:36.1295917Z 54482636fb36: Waiting 2024-12-18T00:13:36.1296205Z a5c771445223: Pulling fs layer 2024-12-18T00:13:36.1296580Z ef13954e836f: Pulling fs layer 2024-12-18T00:13:36.1296959Z 3ad11112ed64: Pulling fs layer 2024-12-18T00:13:36.1297235Z a3161fc6f7f1: Waiting 2024-12-18T00:13:36.1297539Z 217e79f06cdc: Pulling fs layer 2024-12-18T00:13:36.1297841Z 016c3af2b5ea: Pulling fs layer 2024-12-18T00:13:36.1298126Z a5c771445223: Waiting 2024-12-18T00:13:36.1298560Z ea3ba6dc5d33: Pulling fs layer 2024-12-18T00:13:36.1298885Z 3e2119736358: Pulling fs layer 2024-12-18T00:13:36.1299176Z 142b9ab7f81f: Pulling fs layer 2024-12-18T00:13:36.1299462Z ef13954e836f: Waiting 2024-12-18T00:13:36.1299747Z d9b7184b25fa: Waiting 2024-12-18T00:13:36.1300014Z 8fab0d26d562: Pulling fs layer 2024-12-18T00:13:36.1300288Z 6cae394dd1d9: Waiting 2024-12-18T00:13:36.1300544Z ea3ba6dc5d33: Waiting 2024-12-18T00:13:36.1300838Z 3e2119736358: Waiting 2024-12-18T00:13:36.1301098Z a7792d7941ff: Pulling fs layer 2024-12-18T00:13:36.1301391Z 8fab0d26d562: Waiting 2024-12-18T00:13:36.1301677Z 016c3af2b5ea: Waiting 2024-12-18T00:13:36.1301933Z 217e79f06cdc: Waiting 2024-12-18T00:13:36.1302185Z 142b9ab7f81f: Waiting 2024-12-18T00:13:36.1302444Z 19f9786e8175: Pulling fs layer 2024-12-18T00:13:36.1302765Z a7792d7941ff: Waiting 2024-12-18T00:13:36.1303032Z 95cf8d950d0a: Pulling fs layer 2024-12-18T00:13:36.1303340Z 19f9786e8175: Waiting 2024-12-18T00:13:36.1303614Z 95cf8d950d0a: Waiting 2024-12-18T00:13:36.1303884Z da70495326cb: Pulling fs layer 2024-12-18T00:13:36.1304206Z b42f0c5083b2: Pulling fs layer 2024-12-18T00:13:36.1304538Z 59555bf51559: Pulling fs layer 2024-12-18T00:13:36.1304819Z 01b225caaa7c: Waiting 2024-12-18T00:13:36.1305071Z 3ad11112ed64: Waiting 2024-12-18T00:13:36.1305323Z b42f0c5083b2: Waiting 2024-12-18T00:13:36.1305560Z 59555bf51559: Waiting 2024-12-18T00:13:36.1305817Z fd368c9493e6: Pulling fs layer 2024-12-18T00:13:36.1306115Z eeba4480f336: Pulling fs layer 2024-12-18T00:13:36.1306418Z 23872424bbb0: Pulling fs layer 2024-12-18T00:13:36.1306702Z eeba4480f336: Waiting 2024-12-18T00:13:36.1306953Z aa3c5e877811: Pulling fs layer 2024-12-18T00:13:36.1307237Z fd368c9493e6: Waiting 2024-12-18T00:13:36.1307504Z 7069d9cf23ac: Pulling fs layer 2024-12-18T00:13:36.1307798Z 05e4316d907e: Pulling fs layer 2024-12-18T00:13:36.1308079Z 23872424bbb0: Waiting 2024-12-18T00:13:36.1308333Z 68fad68dd196: Pulling fs layer 2024-12-18T00:13:36.1308621Z 05e4316d907e: Waiting 2024-12-18T00:13:36.1308896Z aae57a8763e1: Pulling fs layer 2024-12-18T00:13:36.1309221Z 7069d9cf23ac: Waiting 2024-12-18T00:13:36.1309508Z d0b74f061e3a: Pulling fs layer 2024-12-18T00:13:36.1309794Z aae57a8763e1: Waiting 2024-12-18T00:13:36.1310062Z e90b13a95dd7: Pulling fs layer 2024-12-18T00:13:36.1310402Z 68fad68dd196: Waiting 2024-12-18T00:13:36.1310677Z d0b74f061e3a: Waiting 2024-12-18T00:13:36.1310934Z ba692f76a3d8: Pulling fs layer 2024-12-18T00:13:36.1311289Z aa3c5e877811: Waiting 2024-12-18T00:13:36.1311555Z b22d4aaf1386: Pulling fs layer 2024-12-18T00:13:36.1312084Z 212816d8ea81: Pulling fs layer 2024-12-18T00:13:36.1312371Z ba692f76a3d8: Waiting 2024-12-18T00:13:36.1312623Z 1d707d052310: Pulling fs layer 2024-12-18T00:13:36.1312913Z e90b13a95dd7: Waiting 2024-12-18T00:13:36.1313166Z 212816d8ea81: Waiting 2024-12-18T00:13:36.1313427Z 7bde8a531908: Pulling fs layer 2024-12-18T00:13:36.1313721Z fa2e62eb409d: Pulling fs layer 2024-12-18T00:13:36.1313993Z b22d4aaf1386: Waiting 2024-12-18T00:13:36.1314248Z 1d707d052310: Waiting 2024-12-18T00:13:36.1314516Z c321a0735855: Pulling fs layer 2024-12-18T00:13:36.1314798Z fa2e62eb409d: Waiting 2024-12-18T00:13:36.1315061Z a2109a0ad5a9: Pulling fs layer 2024-12-18T00:13:36.1315330Z c321a0735855: Waiting 2024-12-18T00:13:36.1315579Z a2109a0ad5a9: Waiting 2024-12-18T00:13:36.2048207Z 99f9b4c5db9d: Verifying Checksum 2024-12-18T00:13:36.2048640Z 99f9b4c5db9d: Download complete 2024-12-18T00:13:36.2818511Z 134f0bded43c: Verifying Checksum 2024-12-18T00:13:36.2819105Z 134f0bded43c: Download complete 2024-12-18T00:13:36.3494881Z 01b225caaa7c: Verifying Checksum 2024-12-18T00:13:36.3495350Z 01b225caaa7c: Download complete 2024-12-18T00:13:36.4487959Z a18b532d7d58: Verifying Checksum 2024-12-18T00:13:36.4488403Z a18b532d7d58: Download complete 2024-12-18T00:13:36.4832008Z 7478e0ac0f23: Verifying Checksum 2024-12-18T00:13:36.4832487Z 7478e0ac0f23: Download complete 2024-12-18T00:13:36.5317808Z 97a7f64b3a5e: Verifying Checksum 2024-12-18T00:13:36.5318418Z 97a7f64b3a5e: Download complete 2024-12-18T00:13:36.5659309Z 34c0201c19b2: Verifying Checksum 2024-12-18T00:13:36.5659966Z 34c0201c19b2: Download complete 2024-12-18T00:13:36.6599122Z f0173a8cb7e9: Verifying Checksum 2024-12-18T00:13:36.6599673Z f0173a8cb7e9: Download complete 2024-12-18T00:13:36.7515319Z 6cae394dd1d9: Verifying Checksum 2024-12-18T00:13:36.7515851Z 6cae394dd1d9: Download complete 2024-12-18T00:13:36.8430740Z 02463c0b1de0: Download complete 2024-12-18T00:13:36.9185378Z 8aa13ceb0248: Verifying Checksum 2024-12-18T00:13:36.9186003Z 8aa13ceb0248: Download complete 2024-12-18T00:13:37.4393275Z 7478e0ac0f23: Pull complete 2024-12-18T00:13:37.4611620Z 99f9b4c5db9d: Pull complete 2024-12-18T00:13:37.6902219Z 0839e3e1edb9: Verifying Checksum 2024-12-18T00:13:37.6902725Z 0839e3e1edb9: Download complete 2024-12-18T00:13:37.6973834Z 4f4fb700ef54: Download complete 2024-12-18T00:13:37.7668905Z cf09f2e36d07: Verifying Checksum 2024-12-18T00:13:37.7669310Z cf09f2e36d07: Download complete 2024-12-18T00:13:37.8637326Z 221d65fe0e21: Verifying Checksum 2024-12-18T00:13:37.8637937Z 221d65fe0e21: Download complete 2024-12-18T00:13:37.9466955Z 90c7367fa6c0: Verifying Checksum 2024-12-18T00:13:37.9467500Z 90c7367fa6c0: Download complete 2024-12-18T00:13:38.0589525Z 161e4cd16162: Verifying Checksum 2024-12-18T00:13:38.0590088Z 161e4cd16162: Download complete 2024-12-18T00:13:38.1706660Z 512468486987: Verifying Checksum 2024-12-18T00:13:38.1707198Z 512468486987: Download complete 2024-12-18T00:13:38.2454074Z 2975d72db4cc: Verifying Checksum 2024-12-18T00:13:38.2454554Z 2975d72db4cc: Download complete 2024-12-18T00:13:38.3146866Z 04400a611323: Verifying Checksum 2024-12-18T00:13:38.3147284Z 04400a611323: Download complete 2024-12-18T00:13:38.3892131Z ba1d531b3605: Verifying Checksum 2024-12-18T00:13:38.3892535Z ba1d531b3605: Download complete 2024-12-18T00:13:38.4657396Z df682a7f38c4: Verifying Checksum 2024-12-18T00:13:38.4657812Z df682a7f38c4: Download complete 2024-12-18T00:13:39.3041253Z 6b3ed191d8d6: Verifying Checksum 2024-12-18T00:13:39.3041873Z 6b3ed191d8d6: Download complete 2024-12-18T00:13:39.4051583Z fe86d66e51a7: Download complete 2024-12-18T00:13:39.4735004Z d91d0050d566: Download complete 2024-12-18T00:13:39.5280274Z 7789d1d9a480: Verifying Checksum 2024-12-18T00:13:39.5281141Z 7789d1d9a480: Download complete 2024-12-18T00:13:39.5791291Z e3a5e5066e67: Verifying Checksum 2024-12-18T00:13:39.5791904Z e3a5e5066e67: Download complete 2024-12-18T00:13:39.6205713Z 833e1ad1721a: Verifying Checksum 2024-12-18T00:13:39.6206339Z 833e1ad1721a: Download complete 2024-12-18T00:13:39.6446331Z 2e47d4f203a1: Verifying Checksum 2024-12-18T00:13:39.7296946Z 2e47d4f203a1: Download complete 2024-12-18T00:13:39.7297580Z aba6c0f8cfc8: Verifying Checksum 2024-12-18T00:13:39.7298166Z aba6c0f8cfc8: Download complete 2024-12-18T00:13:39.8058718Z 8a5b8ffb1a25: Verifying Checksum 2024-12-18T00:13:39.8059669Z 8a5b8ffb1a25: Download complete 2024-12-18T00:13:39.8790244Z 0d227ff5c87e: Verifying Checksum 2024-12-18T00:13:39.8790639Z 0d227ff5c87e: Download complete 2024-12-18T00:13:39.9522779Z 88ca106a7035: Download complete 2024-12-18T00:13:40.0479960Z 1d5f1bb5e2ad: Download complete 2024-12-18T00:13:40.1398155Z 54482636fb36: Download complete 2024-12-18T00:13:40.6424704Z 25fd8ec17dba: Verifying Checksum 2024-12-18T00:13:40.7189870Z 25fd8ec17dba: Download complete 2024-12-18T00:13:40.7190254Z d9b7184b25fa: Verifying Checksum 2024-12-18T00:13:40.7190573Z d9b7184b25fa: Download complete 2024-12-18T00:13:40.8339528Z a3161fc6f7f1: Verifying Checksum 2024-12-18T00:13:40.8340135Z a3161fc6f7f1: Download complete 2024-12-18T00:13:40.9222493Z a5c771445223: Download complete 2024-12-18T00:13:41.0279019Z ef13954e836f: Download complete 2024-12-18T00:13:41.2818519Z 3ad11112ed64: Verifying Checksum 2024-12-18T00:13:41.2818992Z 3ad11112ed64: Download complete 2024-12-18T00:13:41.3611789Z 217e79f06cdc: Verifying Checksum 2024-12-18T00:13:41.3612336Z 217e79f06cdc: Download complete 2024-12-18T00:13:41.4590108Z 016c3af2b5ea: Download complete 2024-12-18T00:13:41.5374550Z ea3ba6dc5d33: Download complete 2024-12-18T00:13:41.6229863Z 3e2119736358: Download complete 2024-12-18T00:13:41.7034428Z 142b9ab7f81f: Verifying Checksum 2024-12-18T00:13:41.7035016Z 142b9ab7f81f: Download complete 2024-12-18T00:13:41.9380637Z 8fab0d26d562: Verifying Checksum 2024-12-18T00:13:41.9381264Z 8fab0d26d562: Download complete 2024-12-18T00:13:42.0331779Z a7792d7941ff: Verifying Checksum 2024-12-18T00:13:42.0332394Z a7792d7941ff: Download complete 2024-12-18T00:13:44.1574579Z ba61dc3263a4: Verifying Checksum 2024-12-18T00:13:44.1575195Z ba61dc3263a4: Download complete 2024-12-18T00:13:44.2369351Z 95cf8d950d0a: Verifying Checksum 2024-12-18T00:13:44.2369985Z 95cf8d950d0a: Download complete 2024-12-18T00:13:44.3434292Z da70495326cb: Verifying Checksum 2024-12-18T00:13:44.3434900Z da70495326cb: Download complete 2024-12-18T00:13:44.4185490Z b42f0c5083b2: Verifying Checksum 2024-12-18T00:13:44.4186169Z b42f0c5083b2: Download complete 2024-12-18T00:13:44.5001772Z 59555bf51559: Verifying Checksum 2024-12-18T00:13:44.5002327Z 59555bf51559: Download complete 2024-12-18T00:13:44.5909496Z fd368c9493e6: Download complete 2024-12-18T00:13:44.6808321Z eeba4480f336: Verifying Checksum 2024-12-18T00:13:44.6808719Z eeba4480f336: Download complete 2024-12-18T00:13:44.7765746Z 23872424bbb0: Verifying Checksum 2024-12-18T00:13:44.7767381Z 23872424bbb0: Download complete 2024-12-18T00:13:44.8588748Z aa3c5e877811: Download complete 2024-12-18T00:13:44.9306352Z 7069d9cf23ac: Download complete 2024-12-18T00:13:45.0210878Z 05e4316d907e: Download complete 2024-12-18T00:13:45.1001970Z 68fad68dd196: Download complete 2024-12-18T00:13:45.1601429Z aae57a8763e1: Download complete 2024-12-18T00:13:45.2399805Z d0b74f061e3a: Verifying Checksum 2024-12-18T00:13:45.2402718Z d0b74f061e3a: Download complete 2024-12-18T00:13:45.3138961Z e90b13a95dd7: Verifying Checksum 2024-12-18T00:13:45.3139466Z e90b13a95dd7: Download complete 2024-12-18T00:13:47.9405203Z ba692f76a3d8: Verifying Checksum 2024-12-18T00:13:47.9405732Z ba692f76a3d8: Download complete 2024-12-18T00:13:48.0315868Z b22d4aaf1386: Verifying Checksum 2024-12-18T00:13:48.0316391Z b22d4aaf1386: Download complete 2024-12-18T00:13:48.1157479Z 212816d8ea81: Verifying Checksum 2024-12-18T00:13:48.1157861Z 212816d8ea81: Download complete 2024-12-18T00:13:48.2182322Z 1d707d052310: Verifying Checksum 2024-12-18T00:13:48.2182955Z 1d707d052310: Download complete 2024-12-18T00:13:48.2974644Z 7bde8a531908: Download complete 2024-12-18T00:13:48.3830384Z fa2e62eb409d: Verifying Checksum 2024-12-18T00:13:48.3830798Z fa2e62eb409d: Download complete 2024-12-18T00:13:48.4669873Z c321a0735855: Download complete 2024-12-18T00:13:50.1044228Z a2109a0ad5a9: Verifying Checksum 2024-12-18T00:13:50.1044907Z a2109a0ad5a9: Download complete 2024-12-18T00:13:52.0945974Z 6b3ed191d8d6: Pull complete 2024-12-18T00:13:52.2740197Z 134f0bded43c: Pull complete 2024-12-18T00:13:52.4993950Z 01b225caaa7c: Pull complete 2024-12-18T00:13:52.6903030Z a18b532d7d58: Pull complete 2024-12-18T00:13:52.9028266Z 97a7f64b3a5e: Pull complete 2024-12-18T00:13:53.0233344Z 34c0201c19b2: Pull complete 2024-12-18T00:14:14.1553190Z 0839e3e1edb9: Pull complete 2024-12-18T00:14:14.3345137Z f0173a8cb7e9: Pull complete 2024-12-18T00:14:14.4674178Z 6cae394dd1d9: Pull complete 2024-12-18T00:14:14.5560585Z 02463c0b1de0: Pull complete 2024-12-18T00:14:14.6082251Z 8aa13ceb0248: Pull complete 2024-12-18T00:14:21.4175891Z b745a625ea1a: Verifying Checksum 2024-12-18T00:14:21.4177881Z b745a625ea1a: Download complete 2024-12-18T00:14:37.2623061Z 19f9786e8175: Verifying Checksum 2024-12-18T00:14:37.2623512Z 19f9786e8175: Download complete 2024-12-18T00:15:44.2976968Z b745a625ea1a: Pull complete 2024-12-18T00:15:44.5837891Z 4f4fb700ef54: Pull complete 2024-12-18T00:15:44.8210003Z cf09f2e36d07: Pull complete 2024-12-18T00:15:44.9913911Z 221d65fe0e21: Pull complete 2024-12-18T00:15:45.0962622Z 90c7367fa6c0: Pull complete 2024-12-18T00:15:45.4127358Z 161e4cd16162: Pull complete 2024-12-18T00:15:45.5131315Z 512468486987: Pull complete 2024-12-18T00:15:45.6899899Z 2975d72db4cc: Pull complete 2024-12-18T00:15:45.8738226Z 04400a611323: Pull complete 2024-12-18T00:15:46.0132928Z ba1d531b3605: Pull complete 2024-12-18T00:15:46.1594702Z df682a7f38c4: Pull complete 2024-12-18T00:15:48.6489844Z 7789d1d9a480: Pull complete 2024-12-18T00:15:48.6620515Z fe86d66e51a7: Pull complete 2024-12-18T00:15:48.6747348Z d91d0050d566: Pull complete 2024-12-18T00:15:48.6889251Z e3a5e5066e67: Pull complete 2024-12-18T00:15:48.7021777Z 833e1ad1721a: Pull complete 2024-12-18T00:15:48.7160897Z 2e47d4f203a1: Pull complete 2024-12-18T00:15:57.1015194Z ba61dc3263a4: Pull complete 2024-12-18T00:15:57.1242923Z aba6c0f8cfc8: Pull complete 2024-12-18T00:15:57.1462781Z 8a5b8ffb1a25: Pull complete 2024-12-18T00:15:57.1922848Z 0d227ff5c87e: Pull complete 2024-12-18T00:15:57.2152538Z 88ca106a7035: Pull complete 2024-12-18T00:15:57.2568652Z 1d5f1bb5e2ad: Pull complete 2024-12-18T00:15:57.2783925Z 54482636fb36: Pull complete 2024-12-18T00:15:59.5609365Z 25fd8ec17dba: Pull complete 2024-12-18T00:15:59.7160173Z d9b7184b25fa: Pull complete 2024-12-18T00:15:59.9049053Z a3161fc6f7f1: Pull complete 2024-12-18T00:16:00.1365216Z a5c771445223: Pull complete 2024-12-18T00:16:00.3443109Z ef13954e836f: Pull complete 2024-12-18T00:16:01.3053518Z 3ad11112ed64: Pull complete 2024-12-18T00:16:01.3913047Z 217e79f06cdc: Pull complete 2024-12-18T00:16:01.5155165Z 016c3af2b5ea: Pull complete 2024-12-18T00:16:01.8867107Z ea3ba6dc5d33: Pull complete 2024-12-18T00:16:02.0574845Z 3e2119736358: Pull complete 2024-12-18T00:16:02.3873994Z 142b9ab7f81f: Pull complete 2024-12-18T00:16:02.4707092Z 8fab0d26d562: Pull complete 2024-12-18T00:16:02.7649718Z a7792d7941ff: Pull complete 2024-12-18T00:18:08.1641558Z 19f9786e8175: Pull complete 2024-12-18T00:18:08.3838846Z 95cf8d950d0a: Pull complete 2024-12-18T00:18:08.8438645Z da70495326cb: Pull complete 2024-12-18T00:18:08.8712144Z b42f0c5083b2: Pull complete 2024-12-18T00:18:08.8851946Z 59555bf51559: Pull complete 2024-12-18T00:18:08.9088871Z fd368c9493e6: Pull complete 2024-12-18T00:18:08.9347163Z eeba4480f336: Pull complete 2024-12-18T00:18:08.9466896Z 23872424bbb0: Pull complete 2024-12-18T00:18:08.9705562Z aa3c5e877811: Pull complete 2024-12-18T00:18:08.9937486Z 7069d9cf23ac: Pull complete 2024-12-18T00:18:09.0079690Z 05e4316d907e: Pull complete 2024-12-18T00:18:09.0299832Z 68fad68dd196: Pull complete 2024-12-18T00:18:09.0419394Z aae57a8763e1: Pull complete 2024-12-18T00:18:09.0648089Z d0b74f061e3a: Pull complete 2024-12-18T00:18:09.0778363Z e90b13a95dd7: Pull complete 2024-12-18T00:18:14.4447961Z ba692f76a3d8: Pull complete 2024-12-18T00:18:14.4582952Z b22d4aaf1386: Pull complete 2024-12-18T00:18:14.4706887Z 212816d8ea81: Pull complete 2024-12-18T00:18:14.4845051Z 1d707d052310: Pull complete 2024-12-18T00:18:14.4985942Z 7bde8a531908: Pull complete 2024-12-18T00:18:14.5116371Z fa2e62eb409d: Pull complete 2024-12-18T00:18:14.5418054Z c321a0735855: Pull complete 2024-12-18T00:18:16.5066895Z a2109a0ad5a9: Pull complete 2024-12-18T00:18:16.5895587Z Digest: sha256:8ce44960e47173a8d6260b111dd55523c2bac3a784dcddfb2273090443b4b985 2024-12-18T00:18:16.5962042Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:18:16.6002768Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:18:16.6049403Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:18:16.6050419Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2024-12-18T00:18:16.6059702Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:16.6060095Z env: 2024-12-18T00:18:16.6060332Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:16.6060611Z ##[endgroup] 2024-12-18T00:18:16.6230029Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:18:16.6230645Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-12-18T00:18:16.6231172Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-12-18T00:18:16.6231801Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-12-18T00:18:16.6237638Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:16.6238038Z env: 2024-12-18T00:18:16.6238275Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:16.6238555Z ##[endgroup] 2024-12-18T00:18:17.4082135Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:18:17.8249922Z Collecting psutil==5.9.1 2024-12-18T00:18:17.8640400Z Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB) 2024-12-18T00:18:17.9149412Z Collecting nvidia-ml-py==11.525.84 2024-12-18T00:18:17.9184846Z Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB) 2024-12-18T00:18:18.0199035Z Installing collected packages: psutil, nvidia-ml-py 2024-12-18T00:18:18.1856956Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1 2024-12-18T00:18:18.2670370Z Prepare all required actions 2024-12-18T00:18:18.2672013Z Getting action download info 2024-12-18T00:18:18.4274281Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-12-18T00:18:18.6108822Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16) 2024-12-18T00:18:18.9209174Z ##[group]Run ./.github/actions/download-build-artifacts 2024-12-18T00:18:18.9209565Z with: 2024-12-18T00:18:18.9209813Z name: linux-jammy-py3.9-gcc11 2024-12-18T00:18:18.9210120Z s3-bucket: gha-artifacts 2024-12-18T00:18:18.9210380Z env: 2024-12-18T00:18:18.9210604Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:18.9210880Z ##[endgroup] 2024-12-18T00:18:18.9246719Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:18:18.9247092Z with: 2024-12-18T00:18:18.9247327Z name: linux-jammy-py3.9-gcc11 2024-12-18T00:18:18.9247635Z s3-bucket: gha-artifacts 2024-12-18T00:18:18.9248004Z region: us-east-1 2024-12-18T00:18:18.9248264Z env: 2024-12-18T00:18:18.9248476Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:18.9248753Z ##[endgroup] 2024-12-18T00:18:19.5309234Z (node:185991) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:18:19.5310148Z 2024-12-18T00:18:19.5310507Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:18:19.5311979Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:18:19.5312960Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:18:19.7807408Z Found 1 objects with prefix pytorch/pytorch/12383255652/linux-jammy-py3.9-gcc11/ 2024-12-18T00:18:19.7808170Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:18:23.7076126Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-12-18T00:18:23.7081763Z Artifact download has finished successfully 2024-12-18T00:18:23.7414294Z ##[group]Run unzip -o artifacts.zip 2024-12-18T00:18:23.7414694Z unzip -o artifacts.zip 2024-12-18T00:18:23.7420506Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:23.7420896Z env: 2024-12-18T00:18:23.7421129Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:23.7421609Z ##[endgroup] 2024-12-18T00:18:23.7880596Z Archive: artifacts.zip 2024-12-18T00:18:23.7881420Z creating: dist/ 2024-12-18T00:18:24.7674933Z inflating: dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl 2024-12-18T00:18:24.7675475Z creating: build/custom_test_artifacts/ 2024-12-18T00:18:24.7675887Z creating: build/custom_test_artifacts/custom-op-build/ 2024-12-18T00:18:24.7676409Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-12-18T00:18:24.7677038Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:18:24.7679224Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:18:24.7679933Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-12-18T00:18:24.7680639Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:18:24.7681386Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:18:24.7682088Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:18:24.7683531Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:18:24.7684836Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:18:24.7685583Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:18:24.7686320Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:18:24.7688208Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:18:24.7689553Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:18:24.7690512Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:18:24.7691425Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:18:24.7692658Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:18:24.7693662Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:18:24.7694423Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:18:24.7695114Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-12-18T00:18:24.7695833Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-12-18T00:18:24.7696625Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-12-18T00:18:24.7697520Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-12-18T00:18:24.7698385Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-12-18T00:18:24.7699413Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-12-18T00:18:24.7700243Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-12-18T00:18:24.7701051Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-12-18T00:18:24.7701881Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-12-18T00:18:24.7702711Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-12-18T00:18:24.7703517Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-12-18T00:18:24.7719337Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-12-18T00:18:24.7850126Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-12-18T00:18:24.7850918Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-12-18T00:18:24.7851725Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-12-18T00:18:24.7852653Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-12-18T00:18:24.7853533Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-12-18T00:18:24.7854359Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-12-18T00:18:24.7855211Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-12-18T00:18:24.7856067Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-12-18T00:18:24.7856921Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-12-18T00:18:24.7857775Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-12-18T00:18:24.7858623Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-12-18T00:18:24.7874095Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-12-18T00:18:24.7950000Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-12-18T00:18:24.7950916Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:18:24.7951790Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:18:24.7952528Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-12-18T00:18:24.7953215Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-12-18T00:18:24.7953877Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-12-18T00:18:24.7954803Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-12-18T00:18:24.7955637Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-12-18T00:18:24.7956667Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-12-18T00:18:24.8069450Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-12-18T00:18:24.8129547Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-12-18T00:18:24.8130199Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-12-18T00:18:24.8130740Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-12-18T00:18:24.8131339Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:18:24.8133586Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:18:24.8134392Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-12-18T00:18:24.8135148Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:18:24.8135879Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:18:24.8136580Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:18:24.8137526Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:18:24.8138599Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:18:24.8139404Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:18:24.8140125Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:18:24.8141633Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:18:24.8142968Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:18:24.8144383Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:18:24.8145325Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:18:24.8146383Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:18:24.8147459Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:18:24.8148325Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:18:24.8149075Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-12-18T00:18:24.8149948Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-12-18T00:18:24.8150870Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-12-18T00:18:24.8151952Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-12-18T00:18:24.8152911Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-12-18T00:18:24.8154079Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-12-18T00:18:24.8154986Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-12-18T00:18:24.8155820Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-12-18T00:18:24.8156641Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-12-18T00:18:24.8157498Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-12-18T00:18:24.8158320Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-12-18T00:18:24.8173349Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-12-18T00:18:24.8232903Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-12-18T00:18:24.8233834Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:18:24.8234812Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:18:24.8235638Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-12-18T00:18:24.8236385Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-12-18T00:18:24.8237273Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-12-18T00:18:24.8238007Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-12-18T00:18:24.8238803Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-12-18T00:18:24.8239479Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-12-18T00:18:24.8287245Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-12-18T00:18:24.8287878Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-12-18T00:18:24.8288456Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-12-18T00:18:24.8289104Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-12-18T00:18:24.8291238Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-12-18T00:18:24.8292118Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-12-18T00:18:24.8292920Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-12-18T00:18:24.8293707Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-12-18T00:18:24.8294539Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-12-18T00:18:24.8295465Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-12-18T00:18:24.8296498Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-12-18T00:18:24.8297358Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-12-18T00:18:24.8298147Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-12-18T00:18:24.8299231Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-12-18T00:18:24.8300502Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-12-18T00:18:24.8301942Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-12-18T00:18:24.8302990Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-12-18T00:18:24.8304230Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-12-18T00:18:24.8305666Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-12-18T00:18:24.8306506Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-12-18T00:18:24.8307407Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-12-18T00:18:24.8308288Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-12-18T00:18:24.8309274Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-12-18T00:18:24.8310342Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-12-18T00:18:24.8311493Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-12-18T00:18:24.8312533Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-12-18T00:18:24.8313462Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-12-18T00:18:24.8314369Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-12-18T00:18:24.8315277Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-12-18T00:18:24.8316436Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-12-18T00:18:24.8317356Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-12-18T00:18:24.8318300Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-12-18T00:18:24.8430736Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-12-18T00:18:24.8431884Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-12-18T00:18:24.8432918Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-12-18T00:18:24.8434045Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-12-18T00:18:24.8435193Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-12-18T00:18:24.8436237Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-12-18T00:18:24.8437174Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-12-18T00:18:24.8438117Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-12-18T00:18:24.8439078Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-12-18T00:18:24.8440032Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-12-18T00:18:24.8440972Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-12-18T00:18:24.8455379Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-12-18T00:18:24.8506311Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-12-18T00:18:24.8507563Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:18:24.8508514Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-12-18T00:18:24.8509614Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-12-18T00:18:24.8510404Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-12-18T00:18:24.8511265Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-12-18T00:18:24.8512113Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-12-18T00:18:24.8512828Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-12-18T00:18:24.8513474Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-12-18T00:18:24.8609872Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-12-18T00:18:24.8650884Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-12-18T00:18:24.8651398Z creating: build/lib/ 2024-12-18T00:18:24.8651751Z inflating: build/lib/libclog.a 2024-12-18T00:18:24.8661161Z inflating: build/lib/libpthreadpool.a 2024-12-18T00:18:24.8668948Z inflating: build/lib/libcpuinfo.a 2024-12-18T00:18:24.8676601Z inflating: build/lib/libcpuinfo_internals.a 2024-12-18T00:18:24.8744138Z inflating: build/lib/libgtest.a 2024-12-18T00:18:24.8823263Z inflating: build/lib/libprotobuf-lite.a 2024-12-18T00:18:24.8830432Z inflating: build/lib/libittnotify.a 2024-12-18T00:18:24.8900455Z inflating: build/lib/libbenchmark.a 2024-12-18T00:18:24.8927396Z inflating: build/lib/libtensorpipe_uv.a 2024-12-18T00:18:24.8988537Z inflating: build/lib/libasmjit.a 2024-12-18T00:18:24.9096684Z inflating: build/lib/libgloo.a 2024-12-18T00:18:24.9519347Z inflating: build/lib/libprotobuf.a 2024-12-18T00:18:24.9538761Z inflating: build/lib/libfmt.a 2024-12-18T00:18:24.9539994Z inflating: build/lib/libtorch_global_deps.so 2024-12-18T00:18:24.9635960Z inflating: build/lib/libc10.so 2024-12-18T00:18:24.9638197Z inflating: build/lib/libnnpack_reference_layers.a 2024-12-18T00:18:24.9656612Z inflating: build/lib/libpytorch_qnnpack.a 2024-12-18T00:18:25.0130505Z inflating: build/lib/libprotoc.a 2024-12-18T00:18:25.0147309Z inflating: build/lib/libgmock.a 2024-12-18T00:18:25.0147966Z inflating: build/lib/libgtest_main.a 2024-12-18T00:18:25.0148691Z inflating: build/lib/libbenchmark_main.a 2024-12-18T00:18:25.0166327Z inflating: build/lib/libnnpack.a 2024-12-18T00:18:25.9582217Z inflating: build/lib/libdnnl.a 2024-12-18T00:18:26.0104530Z inflating: build/lib/libtensorpipe.a 2024-12-18T00:18:26.0105810Z inflating: build/lib/libgmock_main.a 2024-12-18T00:18:26.1090900Z inflating: build/lib/libfbgemm.a 2024-12-18T00:18:26.1366167Z inflating: build/lib/libkineto.a 2024-12-18T00:18:26.1405062Z inflating: build/lib/libonnx_proto.a 2024-12-18T00:18:26.2097310Z inflating: build/lib/libonnx.a 2024-12-18T00:18:26.2278400Z inflating: build/lib/libmicrokernels-prod.a 2024-12-18T00:18:26.2362547Z inflating: build/lib/libXNNPACK.a 2024-12-18T00:18:26.3271317Z inflating: build/lib/libmicrokernels-all.a 2024-12-18T00:18:28.6317862Z inflating: build/lib/libtorch_cpu.so 2024-12-18T00:18:28.6318494Z inflating: build/lib/libtorch.so 2024-12-18T00:18:28.6322990Z inflating: build/lib/libunbox_lib.a 2024-12-18T00:18:28.6326600Z inflating: build/lib/libshm.so 2024-12-18T00:18:28.6344523Z inflating: build/lib/libjitbackend_test.so 2024-12-18T00:18:28.6367829Z inflating: build/lib/libbackend_with_compiler.so 2024-12-18T00:18:28.6390795Z inflating: build/lib/libaoti_custom_ops.so 2024-12-18T00:18:28.6457226Z inflating: build/lib/libtorchbind_test.so 2024-12-18T00:18:28.8292004Z inflating: build/lib/libtorch_python.so 2024-12-18T00:18:28.8324250Z inflating: build/lib/libnnapi_backend.so 2024-12-18T00:18:28.8324743Z creating: build/bin/ 2024-12-18T00:18:28.8325032Z creating: build/bin/CMakeFiles/ 2024-12-18T00:18:28.8326221Z inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake 2024-12-18T00:18:28.8326808Z extracting: build/bin/CMakeFiles/progress.marks 2024-12-18T00:18:28.8327200Z inflating: build/bin/Makefile 2024-12-18T00:18:28.8327566Z inflating: build/bin/cmake_install.cmake 2024-12-18T00:18:28.8327943Z inflating: build/bin/CTestTestfile.cmake 2024-12-18T00:18:28.8381115Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-12-18T00:18:28.8435526Z inflating: build/bin/c10_DeviceGuard_test 2024-12-18T00:18:28.8490562Z inflating: build/bin/c10_Device_test 2024-12-18T00:18:28.8553133Z inflating: build/bin/c10_DispatchKeySet_test 2024-12-18T00:18:28.8605187Z inflating: build/bin/c10_StreamGuard_test 2024-12-18T00:18:28.8662602Z inflating: build/bin/c10_Scalar_test 2024-12-18T00:18:28.8716392Z inflating: build/bin/c10_SymInt_test 2024-12-18T00:18:28.8773962Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-12-18T00:18:28.8832590Z inflating: build/bin/c10_InlineStreamGuard_test 2024-12-18T00:18:28.8892207Z inflating: build/bin/c10_SizesAndStrides_test 2024-12-18T00:18:28.8945062Z inflating: build/bin/c10_ArrayRef_test 2024-12-18T00:18:28.9000877Z inflating: build/bin/c10_Bitset_test 2024-12-18T00:18:28.9074405Z inflating: build/bin/c10_cow_test 2024-12-18T00:18:28.9126781Z inflating: build/bin/c10_ConstexprCrc_test 2024-12-18T00:18:28.9179608Z inflating: build/bin/c10_DeadlockDetection_test 2024-12-18T00:18:28.9233368Z inflating: build/bin/c10_Half_test 2024-12-18T00:18:28.9292709Z inflating: build/bin/c10_LeftRight_test 2024-12-18T00:18:28.9348738Z inflating: build/bin/c10_NetworkFlow_test 2024-12-18T00:18:28.9407543Z inflating: build/bin/c10_Metaprogramming_test 2024-12-18T00:18:28.9466312Z inflating: build/bin/c10_ThreadLocal_test 2024-12-18T00:18:28.9519338Z inflating: build/bin/c10_Synchronized_test 2024-12-18T00:18:28.9573975Z inflating: build/bin/c10_TypeIndex_test 2024-12-18T00:18:28.9625725Z inflating: build/bin/c10_TypeTraits_test 2024-12-18T00:18:28.9680497Z inflating: build/bin/c10_accumulate_test 2024-12-18T00:18:28.9734359Z inflating: build/bin/c10_TypeList_test 2024-12-18T00:18:28.9793358Z inflating: build/bin/c10_bfloat16_test 2024-12-18T00:18:28.9846820Z inflating: build/bin/c10_bit_cast_test 2024-12-18T00:18:28.9906432Z inflating: build/bin/c10_complex_math_test 2024-12-18T00:18:28.9964731Z inflating: build/bin/c10_complex_test 2024-12-18T00:18:29.0017251Z inflating: build/bin/c10_error_test 2024-12-18T00:18:29.0073161Z inflating: build/bin/c10_exception_test 2024-12-18T00:18:29.0126551Z inflating: build/bin/c10_flags_test 2024-12-18T00:18:29.0180169Z inflating: build/bin/c10_generic_math_test 2024-12-18T00:18:29.0344783Z inflating: build/bin/c10_intrusive_ptr_test 2024-12-18T00:18:29.0399281Z inflating: build/bin/c10_irange_test 2024-12-18T00:18:29.0456092Z inflating: build/bin/c10_lazy_test 2024-12-18T00:18:29.0517030Z inflating: build/bin/c10_logging_test 2024-12-18T00:18:29.0595343Z inflating: build/bin/c10_optional_test 2024-12-18T00:18:29.0660509Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-12-18T00:18:29.0717590Z inflating: build/bin/c10_registry_test 2024-12-18T00:18:29.0873578Z inflating: build/bin/c10_small_vector_test 2024-12-18T00:18:29.0928950Z inflating: build/bin/c10_string_util_test 2024-12-18T00:18:29.0984441Z inflating: build/bin/c10_ssize_test 2024-12-18T00:18:29.1047123Z inflating: build/bin/c10_string_view_test 2024-12-18T00:18:29.1100722Z inflating: build/bin/c10_tempfile_test 2024-12-18T00:18:29.1148563Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-12-18T00:18:29.1208824Z inflating: build/bin/c10_typeid_test 2024-12-18T00:18:29.1649849Z inflating: build/bin/protoc-3.13.0.0 2024-12-18T00:18:29.2089967Z inflating: build/bin/protoc 2024-12-18T00:18:29.2472751Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-12-18T00:18:29.2870029Z inflating: build/bin/vec_test_all_types_AVX512 2024-12-18T00:18:29.3281270Z inflating: build/bin/vec_test_all_types_AVX2 2024-12-18T00:18:29.3338045Z inflating: build/bin/FileStoreTest 2024-12-18T00:18:29.3395327Z inflating: build/bin/HashStoreTest 2024-12-18T00:18:29.3455662Z inflating: build/bin/TCPStoreTest 2024-12-18T00:18:29.3511798Z inflating: build/bin/BackoffTest 2024-12-18T00:18:29.3581373Z inflating: build/bin/ProcessGroupGlooTest 2024-12-18T00:18:29.3584459Z inflating: build/bin/example_allreduce 2024-12-18T00:18:29.3587389Z inflating: build/bin/parallel_benchmark 2024-12-18T00:18:29.3646507Z inflating: build/bin/test_dist_autograd 2024-12-18T00:18:29.3717416Z inflating: build/bin/test_cpp_rpc 2024-12-18T00:18:29.3787406Z inflating: build/bin/test_mobile_nnc 2024-12-18T00:18:29.3864536Z inflating: build/bin/Dict_test 2024-12-18T00:18:29.3920503Z inflating: build/bin/Dimname_test 2024-12-18T00:18:29.3989435Z inflating: build/bin/MaybeOwned_test 2024-12-18T00:18:29.3998668Z inflating: build/bin/aot_model_compiler_test 2024-12-18T00:18:29.4059397Z inflating: build/bin/NamedTensor_test 2024-12-18T00:18:29.4121983Z inflating: build/bin/apply_utils_test 2024-12-18T00:18:29.4179839Z inflating: build/bin/static_runtime_bench 2024-12-18T00:18:29.4429686Z inflating: build/bin/static_runtime_test 2024-12-18T00:18:29.4492513Z inflating: build/bin/atest 2024-12-18T00:18:29.4559938Z inflating: build/bin/basic 2024-12-18T00:18:29.4619172Z inflating: build/bin/broadcast_test 2024-12-18T00:18:29.4673969Z inflating: build/bin/cpu_allocator_test 2024-12-18T00:18:29.5012630Z inflating: build/bin/test_lazy 2024-12-18T00:18:29.5074655Z inflating: build/bin/cpu_generator_test 2024-12-18T00:18:29.5131548Z inflating: build/bin/cpu_profiling_allocator_test 2024-12-18T00:18:29.5185759Z inflating: build/bin/dispatch_key_set_test 2024-12-18T00:18:29.5239903Z inflating: build/bin/dlconvertor_test 2024-12-18T00:18:29.5301061Z inflating: build/bin/extension_backend_test 2024-12-18T00:18:29.5360668Z inflating: build/bin/half_test 2024-12-18T00:18:29.5454987Z inflating: build/bin/cpu_rng_test 2024-12-18T00:18:29.5508576Z inflating: build/bin/lazy_tensor_test 2024-12-18T00:18:29.5606504Z inflating: build/bin/ivalue_test 2024-12-18T00:18:29.5664005Z inflating: build/bin/math_kernel_test 2024-12-18T00:18:29.5721281Z inflating: build/bin/memory_format_test 2024-12-18T00:18:29.5778450Z inflating: build/bin/memory_overlapping_test 2024-12-18T00:18:29.5838691Z inflating: build/bin/native_test 2024-12-18T00:18:29.5892956Z inflating: build/bin/operator_name_test 2024-12-18T00:18:29.5947389Z inflating: build/bin/operators_test 2024-12-18T00:18:29.6003502Z inflating: build/bin/packedtensoraccessor_test 2024-12-18T00:18:29.6064785Z inflating: build/bin/quantized_test 2024-12-18T00:18:29.6119809Z inflating: build/bin/reportMemoryUsage_test 2024-12-18T00:18:29.6175965Z inflating: build/bin/mobile_memory_cleanup 2024-12-18T00:18:29.6236209Z inflating: build/bin/scalar_tensor_test 2024-12-18T00:18:29.6297413Z inflating: build/bin/scalar_test 2024-12-18T00:18:29.6352327Z inflating: build/bin/StorageUtils_test 2024-12-18T00:18:29.6405260Z inflating: build/bin/reduce_ops_test 2024-12-18T00:18:29.6475436Z inflating: build/bin/pow_test 2024-12-18T00:18:29.6530595Z inflating: build/bin/stride_properties_test 2024-12-18T00:18:29.6612078Z inflating: build/bin/tensor_iterator_test 2024-12-18T00:18:29.6670015Z inflating: build/bin/test_parallel 2024-12-18T00:18:29.6672851Z inflating: build/bin/thread_init_test 2024-12-18T00:18:29.6731185Z inflating: build/bin/type_ptr_test 2024-12-18T00:18:29.6787046Z inflating: build/bin/undefined_tensor_test 2024-12-18T00:18:29.6788778Z inflating: build/bin/verify_api_visibility 2024-12-18T00:18:29.6861807Z inflating: build/bin/legacy_vmap_test 2024-12-18T00:18:29.6916041Z inflating: build/bin/weakref_test 2024-12-18T00:18:29.6971189Z inflating: build/bin/wrapdim_test 2024-12-18T00:18:29.7025483Z inflating: build/bin/xla_tensor_test 2024-12-18T00:18:29.7088560Z inflating: build/bin/IListRef_test 2024-12-18T00:18:29.7196985Z inflating: build/bin/List_test 2024-12-18T00:18:29.7266368Z inflating: build/bin/KernelFunction_test 2024-12-18T00:18:29.7388305Z inflating: build/bin/kernel_function_legacy_test 2024-12-18T00:18:29.7485959Z inflating: build/bin/kernel_function_test 2024-12-18T00:18:29.7612833Z inflating: build/bin/kernel_lambda_legacy_test 2024-12-18T00:18:29.7716467Z inflating: build/bin/kernel_lambda_test 2024-12-18T00:18:29.7780326Z inflating: build/bin/kernel_stackbased_test 2024-12-18T00:18:29.7877958Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-12-18T00:18:29.7931943Z inflating: build/bin/CppSignature_test 2024-12-18T00:18:29.7984512Z inflating: build/bin/op_allowlist_test 2024-12-18T00:18:29.8051789Z inflating: build/bin/inline_container_test 2024-12-18T00:18:29.8110637Z inflating: build/bin/backend_fallback_test 2024-12-18T00:18:29.8414990Z inflating: build/bin/op_registration_test 2024-12-18T00:18:29.8477624Z inflating: build/bin/type_test 2024-12-18T00:18:29.9573298Z inflating: build/bin/test_api 2024-12-18T00:18:29.9629539Z inflating: build/bin/test_edge_op_registration 2024-12-18T00:18:29.9642463Z inflating: build/bin/tutorial_tensorexpr 2024-12-18T00:18:29.9646824Z inflating: build/bin/torch_shm_manager 2024-12-18T00:18:30.0419076Z inflating: build/bin/test_tensorexpr 2024-12-18T00:18:30.0978315Z inflating: build/bin/test_jit 2024-12-18T00:18:30.0978689Z creating: .additional_ci_files/ 2024-12-18T00:18:30.1064588Z inflating: .additional_ci_files/test-times.json 2024-12-18T00:18:30.1406816Z inflating: .additional_ci_files/test-class-times.json 2024-12-18T00:18:30.1434844Z ##[group]Run rm artifacts.zip 2024-12-18T00:18:30.1435183Z rm artifacts.zip 2024-12-18T00:18:30.1441699Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:30.1442094Z env: 2024-12-18T00:18:30.1442335Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:30.1442617Z ##[endgroup] 2024-12-18T00:18:30.1866398Z ##[group]Run df -H 2024-12-18T00:18:30.1866684Z df -H 2024-12-18T00:18:30.1873598Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:30.1874030Z env: 2024-12-18T00:18:30.1874262Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:30.1874542Z ##[endgroup] 2024-12-18T00:18:30.2092044Z Filesystem Size Used Avail Use% Mounted on 2024-12-18T00:18:30.2092495Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-12-18T00:18:30.2092872Z tmpfs 8.2G 0 8.2G 0% /dev/shm 2024-12-18T00:18:30.2093227Z tmpfs 3.3G 488k 3.3G 1% /run 2024-12-18T00:18:30.2093569Z /dev/nvme0n1p1 161G 37G 124G 23% / 2024-12-18T00:18:30.2093919Z tmpfs 8.2G 21k 8.2G 1% /tmp 2024-12-18T00:18:30.2094467Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-12-18T00:18:30.2263363Z Prepare all required actions 2024-12-18T00:18:30.2263935Z Getting action download info 2024-12-18T00:18:30.3885460Z ##[group]Run ./.github/actions/download-td-artifacts 2024-12-18T00:18:30.3885851Z with: 2024-12-18T00:18:30.3886073Z env: 2024-12-18T00:18:30.3886305Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:30.3886571Z ##[endgroup] 2024-12-18T00:18:30.4086868Z ##[group]Run seemethere/download-artifact-s3@v4 2024-12-18T00:18:30.4087240Z with: 2024-12-18T00:18:30.4087464Z name: td_results 2024-12-18T00:18:30.4087726Z s3-bucket: gha-artifacts 2024-12-18T00:18:30.4087999Z region: us-east-1 2024-12-18T00:18:30.4088247Z env: 2024-12-18T00:18:30.4088471Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:30.4088745Z ##[endgroup] 2024-12-18T00:18:30.8916032Z (node:186011) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-12-18T00:18:30.8916935Z 2024-12-18T00:18:30.8917393Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-12-18T00:18:30.8918330Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-12-18T00:18:30.8919316Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-12-18T00:18:30.9975033Z Found 1 objects with prefix pytorch/pytorch/12383255652/td_results/ 2024-12-18T00:18:30.9975736Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-18T00:18:31.0732307Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-12-18T00:18:31.0737731Z Artifact download has finished successfully 2024-12-18T00:18:31.0898806Z ##[group]Run mkdir -p .additional_ci_files 2024-12-18T00:18:31.0899212Z mkdir -p .additional_ci_files 2024-12-18T00:18:31.0899697Z mv td_results.json .additional_ci_files/td_results.json || true 2024-12-18T00:18:31.0906277Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:31.0906682Z env: 2024-12-18T00:18:31.0906937Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:31.0907215Z ##[endgroup] 2024-12-18T00:18:31.1034653Z ##[group]Run .github/scripts/parse_ref.py 2024-12-18T00:18:31.1035059Z .github/scripts/parse_ref.py 2024-12-18T00:18:31.1040665Z shell: /usr/bin/bash -e {0} 2024-12-18T00:18:31.1040962Z env: 2024-12-18T00:18:31.1041425Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:31.1041711Z ##[endgroup] 2024-12-18T00:18:31.1345051Z Prepare all required actions 2024-12-18T00:18:31.1386536Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-12-18T00:18:31.1386915Z with: 2024-12-18T00:18:31.1387338Z github-token: *** 2024-12-18T00:18:31.1387590Z env: 2024-12-18T00:18:31.1387822Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:31.1388091Z ##[endgroup] 2024-12-18T00:18:31.1409949Z ##[group]Run set -eux 2024-12-18T00:18:31.1410258Z set -eux 2024-12-18T00:18:31.1410710Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T00:18:31.1417797Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:31.1418411Z env: 2024-12-18T00:18:31.1418755Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:31.1419452Z GITHUB_TOKEN: *** 2024-12-18T00:18:31.1419821Z ##[endgroup] 2024-12-18T00:18:31.1444462Z + python3 .github/scripts/get_workflow_job_id.py 12383255652 i-0feeb5a43c4657cc6 2024-12-18T00:18:33.9481787Z setting job-id=34566861155 2024-12-18T00:18:33.9482439Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:33.9687687Z Prepare all required actions 2024-12-18T00:18:33.9688136Z Getting action download info 2024-12-18T00:18:34.1022694Z ##[group]Run ./.github/actions/filter-test-configs 2024-12-18T00:18:34.1023071Z with: 2024-12-18T00:18:34.1023507Z github-token: *** 2024-12-18T00:18:34.1026393Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]} 2024-12-18T00:18:34.1029482Z job-name: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:34.1029945Z env: 2024-12-18T00:18:34.1030163Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:34.1030443Z ##[endgroup] 2024-12-18T00:18:34.1071470Z ##[group]Run nick-fields/retry@v3.0.0 2024-12-18T00:18:34.1071929Z with: 2024-12-18T00:18:34.1072162Z shell: bash 2024-12-18T00:18:34.1072412Z timeout_minutes: 10 2024-12-18T00:18:34.1072683Z max_attempts: 5 2024-12-18T00:18:34.1072937Z retry_wait_seconds: 30 2024-12-18T00:18:34.1073760Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:18:34.1074658Z polling_interval_seconds: 1 2024-12-18T00:18:34.1074965Z warning_on_retry: true 2024-12-18T00:18:34.1075248Z continue_on_error: false 2024-12-18T00:18:34.1075526Z env: 2024-12-18T00:18:34.1075746Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:34.1076210Z GITHUB_TOKEN: *** 2024-12-18T00:18:34.1076466Z ##[endgroup] 2024-12-18T00:18:34.2221322Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-12-18T00:18:34.4727692Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T00:18:34.4896848Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-12-18T00:18:34.4899784Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-12-18T00:18:34.5024340Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-12-18T00:18:34.5028357Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-12-18T00:18:34.5037486Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-12-18T00:18:34.5043962Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.12.14) 2024-12-18T00:18:35.1925182Z Command completed after 1 attempt(s). 2024-12-18T00:18:35.1979759Z ##[group]Run set -x 2024-12-18T00:18:35.1980061Z set -x 2024-12-18T00:18:35.1980314Z  2024-12-18T00:18:35.1980714Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:18:35.1981228Z # in runner workspace 2024-12-18T00:18:35.1981638Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-12-18T00:18:35.1988098Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:35.1988528Z env: 2024-12-18T00:18:35.1988969Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:35.1989261Z ##[endgroup] 2024-12-18T00:18:35.2014523Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-12-18T00:18:35.2265481Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:18:35.2265941Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-12-18T00:18:35.2266307Z echo "Job name: ${JOB_NAME}" 2024-12-18T00:18:35.2266623Z  2024-12-18T00:18:35.2267016Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-12-18T00:18:35.2267529Z # in runner workspace 2024-12-18T00:18:35.2267981Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-12-18T00:18:35.2268487Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-12-18T00:18:35.2268847Z  --job-name "${JOB_NAME}" \ 2024-12-18T00:18:35.2271944Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}" \ 2024-12-18T00:18:35.2274884Z  --selected-test-configs "" \ 2024-12-18T00:18:35.2275246Z  --pr-number "${PR_NUMBER}" \ 2024-12-18T00:18:35.2275577Z  --tag "${TAG}" \ 2024-12-18T00:18:35.2275885Z  --event-name "${EVENT_NAME}" \ 2024-12-18T00:18:35.2276214Z  --schedule "${SCHEDULE}" \ 2024-12-18T00:18:35.2276543Z  --branch "${HEAD_BRANCH}" 2024-12-18T00:18:35.2282538Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:35.2282938Z env: 2024-12-18T00:18:35.2283177Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:35.2283684Z GITHUB_TOKEN: *** 2024-12-18T00:18:35.2284088Z JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:35.2284544Z PR_NUMBER: 2024-12-18T00:18:35.2284776Z TAG: 2024-12-18T00:18:35.2285004Z EVENT_NAME: push 2024-12-18T00:18:35.2285252Z SCHEDULE: 2024-12-18T00:18:35.2285472Z HEAD_BRANCH: 2024-12-18T00:18:35.2285712Z ##[endgroup] 2024-12-18T00:18:35.2309366Z Workflow: pull 2024-12-18T00:18:35.2309793Z Job name: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:35.6343252Z ##[group]Run echo "Filtered matrix:" 2024-12-18T00:18:35.6343903Z echo "Filtered matrix:" 2024-12-18T00:18:35.6347050Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}" 2024-12-18T00:18:35.6350044Z  2024-12-18T00:18:35.6350429Z echo 2024-12-18T00:18:35.6350808Z echo "Is the current job unstable? False" 2024-12-18T00:18:35.6351267Z  2024-12-18T00:18:35.6351632Z echo 2024-12-18T00:18:35.6352013Z echo "Is keep-going label set? False" 2024-12-18T00:18:35.6352473Z  2024-12-18T00:18:35.6352847Z echo 2024-12-18T00:18:35.6353194Z echo "Renabled issues? " 2024-12-18T00:18:35.6374070Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:35.6374485Z env: 2024-12-18T00:18:35.6374725Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:35.6375010Z ##[endgroup] 2024-12-18T00:18:35.6398846Z Filtered matrix: 2024-12-18T00:18:35.6403136Z {include: [{config: default, shard: 1, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 2, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 3, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 4, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 5, num_shards: 5, runner: linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: linux.2xlarge}, {config: numpy_2_x, shard: 1, num_shards: 1, runner: linux.2xlarge}]} 2024-12-18T00:18:35.6405876Z 2024-12-18T00:18:35.6406021Z Is the current job unstable? False 2024-12-18T00:18:35.6406235Z 2024-12-18T00:18:35.6406351Z Is keep-going label set? False 2024-12-18T00:18:35.6406559Z 2024-12-18T00:18:35.6406656Z Renabled issues? 2024-12-18T00:18:35.6451086Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:18:35.6451671Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-12-18T00:18:35.6457503Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T00:18:35.6457890Z env: 2024-12-18T00:18:35.6458123Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:35.6458410Z JOB_TIMEOUT: 240 2024-12-18T00:18:35.6458664Z ##[endgroup] 2024-12-18T00:18:35.6531135Z ##[group]Run set -x 2024-12-18T00:18:35.6531486Z set -x 2024-12-18T00:18:35.6531728Z  2024-12-18T00:18:35.6532001Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-12-18T00:18:35.6532416Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-12-18T00:18:35.6532824Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-12-18T00:18:35.6533204Z  TEST_COMMAND=.ci/onnx/test.sh 2024-12-18T00:18:35.6533522Z else 2024-12-18T00:18:35.6533793Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:18:35.6534123Z fi 2024-12-18T00:18:35.6534334Z  2024-12-18T00:18:35.6534826Z # detached container should get cleaned up by teardown_ec2_linux 2024-12-18T00:18:35.6535393Z # TODO: Stop building test binaries as part of the build phase 2024-12-18T00:18:35.6535894Z # Used for GPU_FLAG since that doesn't play nice 2024-12-18T00:18:35.6536342Z # shellcheck disable=SC2086,SC2090 2024-12-18T00:18:35.6536700Z container_name=$(docker run \ 2024-12-18T00:18:35.6537027Z  ${GPU_FLAG:-} \ 2024-12-18T00:18:35.6537457Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2024-12-18T00:18:35.6537826Z  -e BUILD_ENVIRONMENT \ 2024-12-18T00:18:35.6538133Z  -e PR_NUMBER \ 2024-12-18T00:18:35.6538426Z  -e GITHUB_ACTIONS \ 2024-12-18T00:18:35.6538734Z  -e GITHUB_REPOSITORY \ 2024-12-18T00:18:35.6539052Z  -e GITHUB_WORKFLOW \ 2024-12-18T00:18:35.6539360Z  -e GITHUB_JOB \ 2024-12-18T00:18:35.6539635Z  -e GITHUB_RUN_ID \ 2024-12-18T00:18:35.6539958Z  -e GITHUB_RUN_NUMBER \ 2024-12-18T00:18:35.6540275Z  -e GITHUB_RUN_ATTEMPT \ 2024-12-18T00:18:35.6540584Z  -e JOB_ID \ 2024-12-18T00:18:35.6540842Z  -e JOB_NAME \ 2024-12-18T00:18:35.6541355Z  -e BASE_SHA \ 2024-12-18T00:18:35.6541636Z  -e BRANCH \ 2024-12-18T00:18:35.6541914Z  -e SHA1 \ 2024-12-18T00:18:35.6542188Z  -e AWS_DEFAULT_REGION \ 2024-12-18T00:18:35.6542487Z  -e IN_WHEEL_TEST \ 2024-12-18T00:18:35.6542785Z  -e SHARD_NUMBER \ 2024-12-18T00:18:35.6543083Z  -e TEST_CONFIG \ 2024-12-18T00:18:35.6543383Z  -e NUM_TEST_SHARDS \ 2024-12-18T00:18:35.6543695Z  -e REENABLED_ISSUES \ 2024-12-18T00:18:35.6544009Z  -e CONTINUE_THROUGH_ERROR \ 2024-12-18T00:18:35.6544343Z  -e VERBOSE_TEST_LOGS \ 2024-12-18T00:18:35.6544662Z  -e TEST_SHOWLOCALS \ 2024-12-18T00:18:35.6544973Z  -e NO_TEST_TIMEOUT \ 2024-12-18T00:18:35.6545280Z  -e NO_TD \ 2024-12-18T00:18:35.6545542Z  -e TD_DISTRIBUTED \ 2024-12-18T00:18:35.6545845Z  -e PR_LABELS \ 2024-12-18T00:18:35.6546162Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-12-18T00:18:35.6546520Z  -e SCCACHE_BUCKET \ 2024-12-18T00:18:35.6546827Z  -e SCCACHE_REGION \ 2024-12-18T00:18:35.6547120Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-12-18T00:18:35.6547437Z  -e XLA_CUDA \ 2024-12-18T00:18:35.6547747Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-12-18T00:18:35.6548126Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-12-18T00:18:35.6548514Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-12-18T00:18:35.6548904Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-12-18T00:18:35.6549250Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-12-18T00:18:35.6549601Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2024-12-18T00:18:35.6549944Z  -e DASHBOARD_TAG \ 2024-12-18T00:18:35.6550250Z  -e IS_A100_RUNNER \ 2024-12-18T00:18:35.6550556Z  -e ARTIFACTS_FILE_SUFFIX \ 2024-12-18T00:18:35.6550928Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-12-18T00:18:35.6551354Z  --security-opt seccomp=unconfined \ 2024-12-18T00:18:35.6552057Z  --cap-add=SYS_PTRACE \ 2024-12-18T00:18:35.6552376Z  --ipc=host \ 2024-12-18T00:18:35.6552662Z  --shm-size="${SHM_SIZE}" \ 2024-12-18T00:18:35.6552961Z  --tty \ 2024-12-18T00:18:35.6553217Z  --detach \ 2024-12-18T00:18:35.6553500Z  --name="${container_name}" \ 2024-12-18T00:18:35.6553833Z  --user jenkins \ 2024-12-18T00:18:35.6554201Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-12-18T00:18:35.6554623Z  -w /var/lib/jenkins/workspace \ 2024-12-18T00:18:35.6554945Z  "${DOCKER_IMAGE}" 2024-12-18T00:18:35.6555224Z ) 2024-12-18T00:18:35.6555533Z # Propagate download.pytorch.org IP to container 2024-12-18T00:18:35.6556322Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-12-18T00:18:35.6557069Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-12-18T00:18:35.6557806Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-12-18T00:18:35.6563790Z shell: /usr/bin/bash -e {0} 2024-12-18T00:18:35.6564083Z env: 2024-12-18T00:18:35.6564318Z GIT_DEFAULT_BRANCH: main 2024-12-18T00:18:35.6564640Z BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11 2024-12-18T00:18:35.6564981Z PR_NUMBER: 2024-12-18T00:18:35.6565225Z GITHUB_REPOSITORY: pytorch/pytorch 2024-12-18T00:18:35.6565553Z GITHUB_WORKFLOW: pull 2024-12-18T00:18:35.6565825Z GITHUB_JOB: test 2024-12-18T00:18:35.6566079Z GITHUB_RUN_ID: 12383255652 2024-12-18T00:18:35.6566366Z GITHUB_RUN_NUMBER: 276594 2024-12-18T00:18:35.6566644Z GITHUB_RUN_ATTEMPT: 1 2024-12-18T00:18:35.6566907Z JOB_ID: 34566861155 2024-12-18T00:18:35.6567312Z JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:35.6567779Z BRANCH: release/2.6 2024-12-18T00:18:35.6568078Z SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:35.6568472Z BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:35.6568833Z TEST_CONFIG: distributed 2024-12-18T00:18:35.6569113Z SHARD_NUMBER: 1 2024-12-18T00:18:35.6569359Z NUM_TEST_SHARDS: 2 2024-12-18T00:18:35.6569613Z REENABLED_ISSUES: 2024-12-18T00:18:35.6569869Z CONTINUE_THROUGH_ERROR: False 2024-12-18T00:18:35.6570169Z VERBOSE_TEST_LOGS: False 2024-12-18T00:18:35.6570451Z TEST_SHOWLOCALS: False 2024-12-18T00:18:35.6570726Z NO_TEST_TIMEOUT: False 2024-12-18T00:18:35.6570990Z NO_TD: False 2024-12-18T00:18:35.6571220Z TD_DISTRIBUTED: False 2024-12-18T00:18:35.6571547Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-12-18T00:18:35.6571930Z SCCACHE_REGION: us-east-1 2024-12-18T00:18:35.6572225Z SCCACHE_S3_KEY_PREFIX: pull 2024-12-18T00:18:35.6572512Z SHM_SIZE: 1g 2024-12-18T00:18:35.6573159Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:18:35.6573893Z XLA_CUDA: 2024-12-18T00:18:35.6574263Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:18:35.6574736Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-12-18T00:18:35.6575078Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-12-18T00:18:35.6575395Z DASHBOARD_TAG: 2024-12-18T00:18:35.6575861Z HUGGING_FACE_HUB_TOKEN: *** 2024-12-18T00:18:35.6576293Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2024-12-18T00:18:35.6576611Z IS_A100_RUNNER: 0 2024-12-18T00:18:35.6577001Z ARTIFACTS_FILE_SUFFIX: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T00:18:35.6577455Z ##[endgroup] 2024-12-18T00:18:35.6601575Z + [[ distributed == \m\u\l\t\i\g\p\u ]] 2024-12-18T00:18:35.6602211Z + [[ linux-jammy-py3.9-gcc11 == *onnx* ]] 2024-12-18T00:18:35.6602556Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-12-18T00:18:35.6610229Z +++ nproc --ignore=2 2024-12-18T00:18:35.6638037Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255652 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T00:18:43.8943962Z + container_name=9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T00:18:43.8945977Z + grep download.pytorch.org /etc/hosts 2024-12-18T00:18:43.8947419Z + docker exec -i 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 sudo bash -c '/bin/cat >> /etc/hosts' 2024-12-18T00:18:44.0776369Z + echo DOCKER_CONTAINER_ID=9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T00:18:44.0779954Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl 2024-12-18T00:18:44.0782127Z + docker exec -t 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-12-18T00:18:45.0599680Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1) 2024-12-18T00:18:45.5263232Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.16.1) 2024-12-18T00:18:45.5267864Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.12.2) 2024-12-18T00:18:45.5272460Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2.8.8) 2024-12-18T00:18:45.5277327Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.1.4) 2024-12-18T00:18:45.5281810Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2024.10.0) 2024-12-18T00:18:45.5287698Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.13.1) 2024-12-18T00:18:45.5312345Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0) 2024-12-18T00:18:45.5326797Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.3.0) 2024-12-18T00:18:45.5351155Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.22.4) 2024-12-18T00:18:45.5749584Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.0.2) 2024-12-18T00:18:46.1703246Z Installing collected packages: torch 2024-12-18T00:18:54.5835897Z Successfully installed torch-2.6.0a0+git0cdf8b1 2024-12-18T00:18:54.6818226Z + export TERM=vt100 2024-12-18T00:18:54.6818530Z + TERM=vt100 2024-12-18T00:18:54.6820372Z ++ dirname .ci/pytorch/test.sh 2024-12-18T00:18:54.6839634Z + source .ci/pytorch/common.sh 2024-12-18T00:18:54.6848275Z +++ dirname .ci/pytorch/common.sh 2024-12-18T00:18:54.6854249Z ++ source .ci/pytorch/common_utils.sh 2024-12-18T00:18:54.6860437Z +++ declare -f -t trap_add 2024-12-18T00:18:54.6864248Z ++ set -ex 2024-12-18T00:18:54.6864652Z ++ [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-12-18T00:18:54.6865126Z ++ BUILD_TEST_LIBTORCH=0 2024-12-18T00:18:54.6865509Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]] 2024-12-18T00:18:54.6866174Z + [[ -d /var/lib/jenkins/workspace ]] 2024-12-18T00:18:54.6868359Z ++ stat -c %u /var/lib/jenkins/workspace 2024-12-18T00:18:54.6896090Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-12-18T00:18:54.6896445Z + trap_add cleanup_workspace EXIT 2024-12-18T00:18:54.6896775Z + trap_add_cmd=cleanup_workspace 2024-12-18T00:18:54.6897096Z + shift 2024-12-18T00:18:54.6897329Z + for trap_add_name in "$@" 2024-12-18T00:18:54.6903221Z +++ trap -p EXIT 2024-12-18T00:18:54.6905452Z ++ eval 'extract_trap_cmd ' 2024-12-18T00:18:54.6905845Z +++ extract_trap_cmd 2024-12-18T00:18:54.6906111Z +++ printf '%s\n' '' 2024-12-18T00:18:54.6906386Z ++ printf '%s\n' cleanup_workspace 2024-12-18T00:18:54.6907958Z + trap -- ' 2024-12-18T00:18:54.6908699Z cleanup_workspace' EXIT 2024-12-18T00:18:54.6909458Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-12-18T00:18:55.2757551Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-12-18T00:18:55.2973200Z + echo 'Environment variables:' 2024-12-18T00:18:55.2973675Z Environment variables: 2024-12-18T00:18:55.2973948Z + env 2024-12-18T00:18:55.2992787Z INSTALLED_DB=yes 2024-12-18T00:18:55.2993438Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:18:55.2994060Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:18:55.2994475Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11 2024-12-18T00:18:55.2994984Z HOSTNAME=9632dd430339 2024-12-18T00:18:55.2995865Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.2997097Z GITHUB_ACTION=__self 2024-12-18T00:18:55.2997502Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:18:55.2997915Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:18:55.2998223Z TEST_CONFIG=distributed 2024-12-18T00:18:55.2998561Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:18:55.2998916Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:18:55.2999298Z IS_A100_RUNNER=0 2024-12-18T00:18:55.2999820Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:18:55.3000194Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:18:55.3000498Z GITHUB_REF_TYPE=branch 2024-12-18T00:18:55.3000820Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:18:55.3001153Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3001553Z XLA_CUDA= 2024-12-18T00:18:55.3001884Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:18:55.3003666Z *** 2024-12-18T00:18:55.3003963Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:18:55.3004266Z GITHUB_ACTIONS=true 2024-12-18T00:18:55.3004602Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3004998Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3005590Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:18:55.3006154Z UCC_HOME=/usr 2024-12-18T00:18:55.3006400Z VERBOSE_TEST_LOGS=False 2024-12-18T00:18:55.3006681Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:18:55.3007041Z SHARD_NUMBER=1 2024-12-18T00:18:55.3007278Z GITHUB_REF_PROTECTED=true 2024-12-18T00:18:55.3007614Z HOME=/var/lib/jenkins 2024-12-18T00:18:55.3007916Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:18:55.3008264Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:18:55.3008623Z UCX_COMMIT= 2024-12-18T00:18:55.3008864Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:18:55.3009145Z NUM_TEST_SHARDS=2 2024-12-18T00:18:55.3009443Z UCX_HOME=/usr 2024-12-18T00:18:55.3010264Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3011140Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:55.3011927Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3012763Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:18:55.3013344Z GITHUB_EVENT_NAME=push 2024-12-18T00:18:55.3013614Z DASHBOARD_TAG= 2024-12-18T00:18:55.3013863Z GITHUB_RUN_ID=12383255652 2024-12-18T00:18:55.3014608Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3015316Z GITHUB_ACTOR=malfet 2024-12-18T00:18:55.3015570Z PR_NUMBER= 2024-12-18T00:18:55.3015799Z DESIRED_CUDA= 2024-12-18T00:18:55.3016043Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:18:55.3016318Z ANACONDA_PYTHON_VERSION=3.9 2024-12-18T00:18:55.3016729Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:18:55.3017102Z TERM=vt100 2024-12-18T00:18:55.3017335Z INSTALLED_VISION=yes 2024-12-18T00:18:55.3017598Z BRANCH=release/2.6 2024-12-18T00:18:55.3017848Z SCCACHE_REGION=us-east-1 2024-12-18T00:18:55.3018134Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:18:55.3018436Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:18:55.3018979Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:18:55.3019587Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:18:55.3019890Z UCC_COMMIT= 2024-12-18T00:18:55.3020123Z REENABLED_ISSUES= 2024-12-18T00:18:55.3020362Z DOCS=yes 2024-12-18T00:18:55.3020574Z SHLVL=1 2024-12-18T00:18:55.3020776Z MAX_JOBS=6 2024-12-18T00:18:55.3021007Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:18:55.3021367Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3021783Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:18:55.3022201Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:18:55.3022640Z GITHUB_JOB=test 2024-12-18T00:18:55.3022891Z NO_TEST_TIMEOUT=False 2024-12-18T00:18:55.3023156Z TD_DISTRIBUTED=False 2024-12-18T00:18:55.3023441Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:18:55.3023818Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:18:55.3024088Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:18:55.3024368Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:18:55.3025173Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:18:55.3026002Z GITHUB_BASE_REF= 2024-12-18T00:18:55.3026253Z INSTALLED_ACL= 2024-12-18T00:18:55.3026623Z ARTIFACTS_FILE_SUFFIX=test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T00:18:55.3027060Z CI=true 2024-12-18T00:18:55.3027298Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:18:55.3027592Z JOB_ID=34566861155 2024-12-18T00:18:55.3027852Z INSTALLED_PROTOBUF=yes 2024-12-18T00:18:55.3028104Z GITHUB_HEAD_REF= 2024-12-18T00:18:55.3028355Z GITHUB_ACTION_REF= 2024-12-18T00:18:55.3028664Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:18:55.3029034Z TEST_SHOWLOCALS=False 2024-12-18T00:18:55.3029303Z GITHUB_WORKFLOW=pull 2024-12-18T00:18:55.3029565Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:18:55.3030215Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3030883Z NO_TD=False 2024-12-18T00:18:55.3031131Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:18:55.3031429Z _=/usr/bin/env 2024-12-18T00:18:55.3031869Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-12-18T00:18:55.3256092Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch 2024-12-18T00:18:55.3256988Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2024-12-18T00:18:55.3257853Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib 2024-12-18T00:18:55.3258449Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test 2024-12-18T00:18:55.3258917Z + BUILD_DIR=build 2024-12-18T00:18:55.3259184Z + BUILD_RENAMED_DIR=build_renamed 2024-12-18T00:18:55.3259499Z + BUILD_BIN_DIR=build/bin 2024-12-18T00:18:55.3259774Z + SHARD_NUMBER=1 2024-12-18T00:18:55.3260007Z + NUM_TEST_SHARDS=2 2024-12-18T00:18:55.3260296Z + export VALGRIND=ON 2024-12-18T00:18:55.3260638Z + VALGRIND=ON 2024-12-18T00:18:55.3260932Z + [[ linux-jammy-py3.9-gcc11 == *clang9* ]] 2024-12-18T00:18:55.3261294Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]] 2024-12-18T00:18:55.3261768Z + [[ 0 == \1 ]] 2024-12-18T00:18:55.3262006Z + [[ False == \1 ]] 2024-12-18T00:18:55.3262278Z + [[ linux-jammy-py3.9-gcc11 != *bazel* ]] 2024-12-18T00:18:55.3262626Z ++ realpath build/custom_test_artifacts 2024-12-18T00:18:55.3281512Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-12-18T00:18:55.3282047Z + [[ -n '' ]] 2024-12-18T00:18:55.3282284Z + echo 'Environment variables' 2024-12-18T00:18:55.3282584Z Environment variables 2024-12-18T00:18:55.3282842Z + env 2024-12-18T00:18:55.3290034Z INSTALLED_DB=yes 2024-12-18T00:18:55.3290801Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T00:18:55.3291334Z CONTINUE_THROUGH_ERROR=False 2024-12-18T00:18:55.3291653Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11 2024-12-18T00:18:55.3292027Z HOSTNAME=9632dd430339 2024-12-18T00:18:55.3292705Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3293472Z GITHUB_ACTION=__self 2024-12-18T00:18:55.3293770Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-12-18T00:18:55.3294079Z GITHUB_RUN_NUMBER=276594 2024-12-18T00:18:55.3294369Z TEST_CONFIG=distributed 2024-12-18T00:18:55.3294659Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-12-18T00:18:55.3295013Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-12-18T00:18:55.3295354Z IS_A100_RUNNER=0 2024-12-18T00:18:55.3295854Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2024-12-18T00:18:55.3296178Z GITHUB_TRIGGERING_ACTOR=malfet 2024-12-18T00:18:55.3296488Z GITHUB_REF_TYPE=branch 2024-12-18T00:18:55.3296768Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-12-18T00:18:55.3297107Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3297449Z XLA_CUDA= 2024-12-18T00:18:55.3297794Z HUGGING_FACE_HUB_TOKEN=*** 2024-12-18T00:18:55.3298401Z *** 2024-12-18T00:18:55.3298635Z GITHUB_REPOSITORY_ID=65600975 2024-12-18T00:18:55.3298936Z GITHUB_ACTIONS=true 2024-12-18T00:18:55.3299230Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3299616Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3300203Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6 2024-12-18T00:18:55.3300726Z UCC_HOME=/usr 2024-12-18T00:18:55.3300964Z VERBOSE_TEST_LOGS=False 2024-12-18T00:18:55.3301248Z GITHUB_REF=refs/heads/release/2.6 2024-12-18T00:18:55.3301548Z SHARD_NUMBER=1 2024-12-18T00:18:55.3301795Z GITHUB_REF_PROTECTED=true 2024-12-18T00:18:55.3302075Z HOME=/var/lib/jenkins 2024-12-18T00:18:55.3302366Z GITHUB_API_URL=https://api.github.com 2024-12-18T00:18:55.3302708Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-12-18T00:18:55.3303002Z UCX_COMMIT= 2024-12-18T00:18:55.3303238Z SCCACHE_S3_KEY_PREFIX=pull 2024-12-18T00:18:55.3303519Z NUM_TEST_SHARDS=2 2024-12-18T00:18:55.3303760Z UCX_HOME=/usr 2024-12-18T00:18:55.3304349Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3305145Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T00:18:55.3305932Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3306771Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-12-18T00:18:55.3307296Z GITHUB_EVENT_NAME=push 2024-12-18T00:18:55.3308269Z DASHBOARD_TAG= 2024-12-18T00:18:55.3308515Z GITHUB_RUN_ID=12383255652 2024-12-18T00:18:55.3309179Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3309886Z GITHUB_ACTOR=malfet 2024-12-18T00:18:55.3310139Z PR_NUMBER= 2024-12-18T00:18:55.3310375Z DESIRED_CUDA= 2024-12-18T00:18:55.3310608Z GITHUB_RUN_ATTEMPT=1 2024-12-18T00:18:55.3310864Z VALGRIND=ON 2024-12-18T00:18:55.3311106Z ANACONDA_PYTHON_VERSION=3.9 2024-12-18T00:18:55.3311457Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-12-18T00:18:55.3311943Z TERM=vt100 2024-12-18T00:18:55.3312253Z INSTALLED_VISION=yes 2024-12-18T00:18:55.3312522Z BRANCH=release/2.6 2024-12-18T00:18:55.3312788Z SCCACHE_REGION=us-east-1 2024-12-18T00:18:55.3313080Z OPENSSL_ROOT_DIR=/opt/openssl 2024-12-18T00:18:55.3313383Z CUDA_PATH=/usr/local/cuda 2024-12-18T00:18:55.3313912Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-12-18T00:18:55.3314514Z GITHUB_SERVER_URL=https://github.com 2024-12-18T00:18:55.3314828Z UCC_COMMIT= 2024-12-18T00:18:55.3315053Z REENABLED_ISSUES= 2024-12-18T00:18:55.3315295Z DOCS=yes 2024-12-18T00:18:55.3315501Z SHLVL=1 2024-12-18T00:18:55.3315715Z MAX_JOBS=6 2024-12-18T00:18:55.3315946Z GITHUB_ACTOR_ID=2453524 2024-12-18T00:18:55.3316302Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T00:18:55.3316709Z GITHUB_REF_NAME=release/2.6 2024-12-18T00:18:55.3317116Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-12-18T00:18:55.3317563Z GITHUB_JOB=test 2024-12-18T00:18:55.3317809Z NO_TEST_TIMEOUT=False 2024-12-18T00:18:55.3318077Z TD_DISTRIBUTED=False 2024-12-18T00:18:55.3318345Z GITHUB_REPOSITORY=pytorch/pytorch 2024-12-18T00:18:55.3318660Z GITHUB_RETENTION_DAYS=90 2024-12-18T00:18:55.3318937Z OPENSSL_DIR=/opt/openssl 2024-12-18T00:18:55.3319219Z GITHUB_ACTION_REPOSITORY= 2024-12-18T00:18:55.3320031Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:18:55.3320882Z GITHUB_BASE_REF= 2024-12-18T00:18:55.3321112Z INSTALLED_ACL= 2024-12-18T00:18:55.3321483Z ARTIFACTS_FILE_SUFFIX=test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T00:18:55.3321918Z CI=true 2024-12-18T00:18:55.3322158Z GITHUB_REPOSITORY_OWNER=pytorch 2024-12-18T00:18:55.3322450Z JOB_ID=34566861155 2024-12-18T00:18:55.3322691Z INSTALLED_PROTOBUF=yes 2024-12-18T00:18:55.3322959Z GITHUB_HEAD_REF= 2024-12-18T00:18:55.3323204Z GITHUB_ACTION_REF= 2024-12-18T00:18:55.3323517Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-12-18T00:18:55.3323897Z TEST_SHOWLOCALS=False 2024-12-18T00:18:55.3324151Z GITHUB_WORKFLOW=pull 2024-12-18T00:18:55.3324426Z DEBIAN_FRONTEND=noninteractive 2024-12-18T00:18:55.3325078Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_0ec39548-dc4d-4ac0-b045-f40518e60346 2024-12-18T00:18:55.3325738Z NO_TD=False 2024-12-18T00:18:55.3325983Z SKIP_SCCACHE_INITIALIZATION=1 2024-12-18T00:18:55.3326262Z _=/usr/bin/env 2024-12-18T00:18:55.3326504Z + echo 'Testing pytorch' 2024-12-18T00:18:55.3326775Z Testing pytorch 2024-12-18T00:18:55.3327041Z + export LANG=C.UTF-8 2024-12-18T00:18:55.3327300Z + LANG=C.UTF-8 2024-12-18T00:18:55.3352529Z + PR_NUMBER= 2024-12-18T00:18:55.3352983Z + [[ distributed == \d\e\f\a\u\l\t ]] 2024-12-18T00:18:55.3353618Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-12-18T00:18:55.3354247Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-12-18T00:18:55.3354854Z + [[ distributed == \s\l\o\w ]] 2024-12-18T00:18:55.3355312Z + [[ linux-jammy-py3.9-gcc11 == *slow-gradcheck* ]] 2024-12-18T00:18:55.3355730Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]] 2024-12-18T00:18:55.3356082Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-12-18T00:18:55.3356432Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]] 2024-12-18T00:18:55.3356776Z + [[ distributed == *crossref* ]] 2024-12-18T00:18:55.3357300Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-12-18T00:18:55.3357652Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]] 2024-12-18T00:18:55.3358023Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]] 2024-12-18T00:18:55.3358383Z + pip_install --user ninja==1.10.2 2024-12-18T00:18:55.3358797Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:18:55.3359294Z + python3 -m pip install --progress-bar off --user ninja==1.10.2 2024-12-18T00:18:55.8218912Z Collecting ninja==1.10.2 2024-12-18T00:18:55.8407636Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-12-18T00:18:55.8972158Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-12-18T00:18:56.4043693Z Installing collected packages: ninja 2024-12-18T00:18:56.4135439Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-12-18T00:18:56.4136604Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-12-18T00:18:56.4767314Z Successfully installed ninja-1.10.2 2024-12-18T00:18:56.5692357Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:18:56.5693988Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:18:56.5695106Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]] 2024-12-18T00:18:56.5695466Z + install_tlparse 2024-12-18T00:18:56.5695747Z + pip_install --user tlparse==0.3.25 2024-12-18T00:18:56.5696163Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2024-12-18T00:18:56.5696686Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25 2024-12-18T00:18:57.0295459Z Collecting tlparse==0.3.25 2024-12-18T00:18:57.0428847Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB) 2024-12-18T00:18:57.0841646Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-12-18T00:18:57.6451990Z Installing collected packages: tlparse 2024-12-18T00:18:57.7293354Z Successfully installed tlparse-0.3.25 2024-12-18T00:18:57.8284275Z ++ python -m site --user-base 2024-12-18T00:18:57.8578962Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-12-18T00:18:57.8580218Z + [[ linux-jammy-py3.9-gcc11 == *asan* ]] 2024-12-18T00:18:57.8580586Z + [[ linux-jammy-py3.9-gcc11 == *-debug* ]] 2024-12-18T00:18:57.8580947Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]] 2024-12-18T00:18:57.8581603Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass' 2024-12-18T00:18:57.8582589Z We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass 2024-12-18T00:18:57.8583046Z + cd test 2024-12-18T00:18:57.8583413Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-12-18T00:19:00.2521746Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-12-18T00:19:00.2522179Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-12-18T00:19:00.2524595Z + DYNAMO_BENCHMARK_FLAGS=() 2024-12-18T00:19:00.2525285Z + [[ distributed == *pr_time_benchmarks* ]] 2024-12-18T00:19:00.2525774Z + [[ distributed == *dynamo_eager* ]] 2024-12-18T00:19:00.2526173Z + [[ distributed == *aot_eager* ]] 2024-12-18T00:19:00.2526532Z + [[ distributed == *aot_inductor* ]] 2024-12-18T00:19:00.2526846Z + [[ distributed == *inductor* ]] 2024-12-18T00:19:00.2527162Z + [[ distributed == *dynamic* ]] 2024-12-18T00:19:00.2527472Z + [[ distributed == *cpu* ]] 2024-12-18T00:19:00.2527805Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-12-18T00:19:00.2546413Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]] 2024-12-18T00:19:00.2546837Z + [[ linux-jammy-py3.9-gcc11 == *-bazel-* ]] 2024-12-18T00:19:00.2549092Z + cd test 2024-12-18T00:19:00.2549457Z + python -c 'import torch; print(torch.__config__.show())' 2024-12-18T00:19:01.5154628Z PyTorch built with: 2024-12-18T00:19:01.5154967Z - GCC 11.4 2024-12-18T00:19:01.5155213Z - C++ Version: 201703 2024-12-18T00:19:01.5155813Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-12-18T00:19:01.5156557Z - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:19:01.5157351Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-12-18T00:19:01.5157715Z - LAPACK is enabled (usually provided by MKL) 2024-12-18T00:19:01.5158067Z - NNPACK is enabled 2024-12-18T00:19:01.5158350Z - CPU capability usage: AVX512 2024-12-18T00:19:01.5163662Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-12-18T00:19:01.5169068Z 2024-12-18T00:19:01.7967482Z + cd test 2024-12-18T00:19:01.7968083Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-12-18T00:19:03.0744427Z ATen/Parallel: 2024-12-18T00:19:03.0744931Z at::get_num_threads() : 4 2024-12-18T00:19:03.0745260Z at::get_num_interop_threads() : 4 2024-12-18T00:19:03.0745586Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-12-18T00:19:03.0745907Z omp_get_max_threads() : 4 2024-12-18T00:19:03.0746492Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-12-18T00:19:03.0747138Z mkl_get_max_threads() : 4 2024-12-18T00:19:03.0747529Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af) 2024-12-18T00:19:03.0747996Z std::thread::hardware_concurrency() : 8 2024-12-18T00:19:03.0748351Z Environment variables: 2024-12-18T00:19:03.0748630Z OMP_NUM_THREADS : [not set] 2024-12-18T00:19:03.0748927Z MKL_NUM_THREADS : [not set] 2024-12-18T00:19:03.0749211Z ATen parallel backend: OpenMP 2024-12-18T00:19:03.0749424Z 2024-12-18T00:19:03.3758423Z + [[ distributed == *numpy_2* ]] 2024-12-18T00:19:03.3758937Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]] 2024-12-18T00:19:03.3759286Z + [[ distributed == *backward* ]] 2024-12-18T00:19:03.3759604Z + [[ distributed == *xla* ]] 2024-12-18T00:19:03.3759906Z + [[ distributed == *executorch* ]] 2024-12-18T00:19:03.3760235Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]] 2024-12-18T00:19:03.3760594Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]] 2024-12-18T00:19:03.3760975Z + [[ distributed == distributed ]] 2024-12-18T00:19:03.3761285Z + test_distributed 2024-12-18T00:19:03.3761564Z + echo 'Testing distributed python tests' 2024-12-18T00:19:03.3761916Z Testing distributed python tests 2024-12-18T00:19:03.3762611Z + python test/run_test.py --distributed-tests --shard 1 2 --verbose 2024-12-18T00:19:03.4994925Z /var/lib/jenkins/workspace/test/run_test.py:22: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-12-18T00:19:03.4995831Z import pkg_resources 2024-12-18T00:19:08.5376874Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json?versionId=PhiMB7EP3187qvpKvnORewoK3InOIvX5 to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-12-18T00:19:08.6029451Z Ignoring disabled issues: [''] 2024-12-18T00:19:08.6187917Z Found test times from artifacts 2024-12-18T00:19:08.6790911Z Found test times from artifacts 2024-12-18T00:19:08.6818269Z Running all tests 2024-12-18T00:19:08.6939942Z Running parallel tests on 3 processes 2024-12-18T00:19:08.6944225Z Name: tests to run (est. time: 67.55min) 2024-12-18T00:19:08.6944578Z Serial tests (73): 2024-12-18T00:19:08.6944971Z distributed/test_dynamo_distributed 1/1 2024-12-18T00:19:08.6945425Z distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 2024-12-18T00:19:08.6945870Z distributed/_tensor/test_common_rules 1/1 2024-12-18T00:19:08.6946239Z distributed/_tensor/test_dtensor_ops 1/1 2024-12-18T00:19:08.6946595Z distributed/_tensor/test_init 1/1 2024-12-18T00:19:08.6946963Z distributed/_tensor/test_experimental_ops 1/1 2024-12-18T00:19:08.6947333Z distributed/_tensor/test_tensor_ops 1/1 2024-12-18T00:19:08.6947684Z distributed/_tensor/test_math_ops 1/1 2024-12-18T00:19:08.6948075Z distributed/_shard/sharded_tensor/ops/test_init 1/1 2024-12-18T00:19:08.6948472Z distributed/_tensor/test_matrix_ops 1/1 2024-12-18T00:19:08.6948855Z distributed/rpc/cuda/test_tensorpipe_agent 1/1 2024-12-18T00:19:08.6949236Z distributed/test_c10d_ops_nccl 1/1 2024-12-18T00:19:08.6949604Z distributed/checkpoint/test_save_load_api 1/1 2024-12-18T00:19:08.6950003Z distributed/checkpoint/test_dedup_tensors 1/1 2024-12-18T00:19:08.6950393Z distributed/_composable/test_contract 1/1 2024-12-18T00:19:08.6950778Z distributed/pipelining/test_microbatch 1/1 2024-12-18T00:19:08.6951146Z distributed/optim/test_named_optimizer 1/1 2024-12-18T00:19:08.6951523Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 2024-12-18T00:19:08.6952050Z distributed/_tensor/experimental/test_register_sharding 1/1 2024-12-18T00:19:08.6952492Z distributed/_tools/test_mem_tracker 1/1 2024-12-18T00:19:08.6952850Z distributed/fsdp/test_fsdp_fx 1/1 2024-12-18T00:19:08.6953181Z distributed/_tensor/test_attention 1/1 2024-12-18T00:19:08.6953529Z distributed/_tensor/test_api 1/1 2024-12-18T00:19:08.6953868Z distributed/pipelining/test_stage 1/1 2024-12-18T00:19:08.6954244Z distributed/_composable/test_checkpoint 1/1 2024-12-18T00:19:08.6954659Z distributed/checkpoint/test_dtensor_resharding 1/1 2024-12-18T00:19:08.6955058Z distributed/_tensor/test_redistribute 1/1 2024-12-18T00:19:08.6955426Z distributed/checkpoint/test_fsspec 1/1 2024-12-18T00:19:08.6955813Z distributed/tensor/parallel/test_tp_style 1/1 2024-12-18T00:19:08.6956214Z distributed/_tools/test_fsdp2_mem_tracker 1/1 2024-12-18T00:19:08.6956660Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 2024-12-18T00:19:08.6957080Z distributed/elastic/test_control_plane 1/1 2024-12-18T00:19:08.6957478Z distributed/tensor/parallel/test_tp_examples 1/1 2024-12-18T00:19:08.6957861Z distributed/test_nccl 1/1 2024-12-18T00:19:08.6958169Z distributed/test_c10d_logger 1/1 2024-12-18T00:19:08.6958518Z distributed/fsdp/test_fsdp_state_dict 1/1 2024-12-18T00:19:08.6958884Z distributed/_tensor/test_optimizers 1/1 2024-12-18T00:19:08.6959220Z distributed/test_c10d_nccl 1/1 2024-12-18T00:19:08.6959563Z distributed/fsdp/test_fsdp_overlap 1/1 2024-12-18T00:19:08.6959928Z distributed/fsdp/test_fsdp_optim_state 1/1 2024-12-18T00:19:08.6960318Z distributed/fsdp/test_fsdp_freezing_weights 1/1 2024-12-18T00:19:08.6960770Z distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 2024-12-18T00:19:08.6961484Z distributed/fsdp/test_fsdp_exec_order 1/1 2024-12-18T00:19:08.6961844Z distributed/test_multi_threaded_pg 1/1 2024-12-18T00:19:08.6962203Z distributed/fsdp/test_fsdp_uneven 1/1 2024-12-18T00:19:08.6962561Z distributed/fsdp/test_fsdp_input 1/1 2024-12-18T00:19:08.6962920Z distributed/fsdp/test_fsdp_grad_acc 1/1 2024-12-18T00:19:08.6963301Z distributed/fsdp/test_fsdp_ignored_modules 1/1 2024-12-18T00:19:08.6963729Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 2024-12-18T00:19:08.6964174Z distributed/fsdp/test_checkpoint_wrapper 1/1 2024-12-18T00:19:08.6964544Z distributed/fsdp/test_utils 1/1 2024-12-18T00:19:08.6974385Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 2024-12-18T00:19:08.6974850Z distributed/fsdp/test_fsdp_tp_integration 1/1 2024-12-18T00:19:08.6975314Z distributed/fsdp/test_fsdp_checkpoint 1/1 2024-12-18T00:19:08.6975726Z distributed/algorithms/test_join 1/1 2024-12-18T00:19:08.6976127Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 2024-12-18T00:19:08.6976572Z distributed/_composable/fsdp/test_fully_shard_training 1/1 2024-12-18T00:19:08.6977127Z distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 2024-12-18T00:19:08.6977563Z distributed/rpc/test_faulty_agent 1/1 2024-12-18T00:19:08.6977931Z distributed/rpc/test_tensorpipe_agent 2/4 2024-12-18T00:19:08.6978374Z distributed/rpc/test_tensorpipe_agent 4/4 2024-12-18T00:19:08.6978746Z distributed/fsdp/test_fsdp_fine_tune 1/1 2024-12-18T00:19:08.6979105Z distributed/_shard/test_sharder 1/1 2024-12-18T00:19:08.6979497Z distributed/_shard/sharded_optim/test_sharded_optim 1/1 2024-12-18T00:19:08.6979969Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 2024-12-18T00:19:08.6980458Z distributed/fsdp/test_fsdp_comm 1/1 2024-12-18T00:19:08.6980905Z distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 2024-12-18T00:19:08.6981357Z distributed/test_launcher 1/1 2024-12-18T00:19:08.6981744Z distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 2024-12-18T00:19:08.6982203Z distributed/fsdp/test_distributed_checkpoint 1/1 2024-12-18T00:19:08.6982625Z distributed/fsdp/test_fsdp_use_orig_params 1/1 2024-12-18T00:19:08.6982997Z distributed/test_c10d_gloo 1/1 2024-12-18T00:19:08.6983335Z distributed/elastic/timer/api_test 1/1 2024-12-18T00:19:08.6983666Z Parallel tests (0): 2024-12-18T00:19:08.6983985Z Name: excluded (est. time: 0.0min) 2024-12-18T00:19:08.6984306Z Serial tests (0): 2024-12-18T00:19:08.6984563Z Parallel tests (0): 2024-12-18T00:19:08.7251137Z Running distributed/test_dynamo_distributed 1/1 ... [2024-12-18 00:19:08.724583] 2024-12-18T00:19:08.7252132Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:19:08.7263161Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_dynamo_distributed.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:08.725837] 2024-12-18T00:19:52.5280377Z 2024-12-18T00:19:52.5281594Z distributed/test_dynamo_distributed 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_dynamo_distributed_1.1_dc43c3b523037a19_.log 2024-12-18T00:19:52.5308110Z Running 58 items in this shard: test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_call_method_forward, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_ddp_optimizer_inductor_strides_dont_specialize, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_issue90375, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_symbol_splitting, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_direct, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_indirect, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_no_binding, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_torture_multi, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_asymmetric_compilation, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_asymmetric_compilation_with_fx_cache, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_scalar, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_speculation_divergence, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_tensor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_dim_mismatch, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_graph_break_empty_graph_still_collective, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_missing_source, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_scalar_missing_source, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_type_mismatch, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_baseline_aot_eager_multiprocess, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_setattr, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_unspecialized_forced_getattr_inline, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_unspecialized_forced_getattr_no_inline, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_get_pg_attr, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_aot_autograd, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_async_subclass_no_specialize, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_compiled_flex_attention_full_model_ddp, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_compiled_flex_attention_local_ddp, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_custom_layer, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_aot_eager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_empty_graph_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_diff_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_same_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_orig_params_assert, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_guards, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_register_attr_or_module, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_staticmethod, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_ctx_manager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_inference, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_training, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_transpose, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_higher_order_op, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ignored_parameters, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_no_split 2024-12-18T00:19:52.5332821Z 2024-12-18T00:19:52.5333194Z Running distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 ... [2024-12-18 00:19:52.528846] 2024-12-18T00:19:52.5333776Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:19:52.5334985Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_binary_cmp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:52.529374] 2024-12-18T00:19:56.6084275Z 2024-12-18T00:19:56.6085523Z distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_6f7acdae3fe38b87_.log 2024-12-18T00:19:56.6088616Z Running 4 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose_tensor_specs, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal_tensor_specs 2024-12-18T00:19:56.6091447Z 2024-12-18T00:19:56.6091833Z Running distributed/_tensor/test_common_rules 1/1 ... [2024-12-18 00:19:56.608874] 2024-12-18T00:19:56.6092410Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:19:56.6095897Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_common_rules.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:56.609360] 2024-12-18T00:20:43.9957405Z 2024-12-18T00:20:43.9958556Z distributed/_tensor/test_common_rules 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_common_rules_1.1_e09d77423b19fc25_.log 2024-12-18T00:20:43.9963920Z Running 10 items in this shard: test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_basic_propagation, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_errors, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_linearity, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_merge_sharding, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_pointwise_propagation, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_enforce_sharding_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_rules_broadcasting, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_rules_suggestion 2024-12-18T00:20:43.9969114Z 2024-12-18T00:20:43.9969408Z Running distributed/_tensor/test_dtensor_ops 1/1 ... [2024-12-18 00:20:43.996354] 2024-12-18T00:20:43.9969981Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:20:43.9973141Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:20:43.997052] 2024-12-18T00:22:28.4853164Z 2024-12-18T00:22:28.4856926Z distributed/_tensor/test_dtensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_ops_1.1_9be8e2385ef15897_.log 2024-12-18T00:22:28.5461180Z Running 670 items in this shard: test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_H_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_T_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___getitem___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___radd___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rdiv___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmatmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmod___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rpow___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rsub___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__batch_norm_with_update_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__chunk_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__native_batch_norm_legit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_lengths_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_offsets_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__softmax_backward_data_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_put_accumulate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__upsample_bilinear2d_aa_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_abs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcdiv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_decomposed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_alias_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_all_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_allclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_aminmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_angle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_any_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_arange_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argsort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argwhere_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_partial_views_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_baddbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bernoulli_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bfloat16_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_block_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bool_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_shapes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bucketize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_byte_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cartesian_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cauchy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdouble_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ceil_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cfloat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chalf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_char_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_inverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_max_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_min_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clone_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_column_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_combinations_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_physical_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_constant_pad_nd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_contiguous_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_copysign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_corrcoef_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_count_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cov_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumulative_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_deg2rad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_embed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagflat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diff_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_digamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_floor_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_no_rounding_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_trunc_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_double_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_einsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_permuted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_equal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expm1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eye_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flip_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fliplr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flipud_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gather_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ge_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geometric_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geqrf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gradient_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_grid_sampler_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_half_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_heaviside_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogram_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogramdd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hypot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igammac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_inner_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_int_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isfinite_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isnan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isneginf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isposinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isreal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_item_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_2inputs_2outputs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_4inputs_with_extra_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_return_by_ref_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_unary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kron_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kthvalue_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ldexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_le_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lerp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lgamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cond_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eig_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvalsh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_householder_product_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_grad_oriented_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_multi_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_subgradients_at_zero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_slogdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_triangular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svdvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorsolve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vander_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vecdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vector_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log10_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log1p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logcumsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_and_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_not_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_or_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_xor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_long_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_unpack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mH_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mT_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matrix_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_pool2d_with_indices_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_maximum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_list_of_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_variadic_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_minimum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_movedim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_msort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_multinomial_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_5_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nan_to_num_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmedian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanquantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nansum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_dropout_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ne_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nextafter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_alpha_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_with_logits_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_celu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_channel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_similarity_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_ctc_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_elu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_bag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_with_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_without_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gaussian_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_glu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_grid_sample_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_group_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardswish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardtanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hinge_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_huber_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_instance_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_area_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bicubic_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest-exact_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_trilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_kl_div_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_leaky_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_local_response_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_logsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_margin_ranking_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mse_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_head_attention_forward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_circular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_constant_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_reflect_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_negative_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pairwise_distance_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_unshuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_poisson_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_prelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu6_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rms_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rrelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_scaled_dot_product_attention_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_selu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_silu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_smooth_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softplus_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softsign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_tanhshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_threshold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_with_distance_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_static_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_fro_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_inf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_nuc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_in_place_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_number_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ormqr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_outer_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pca_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_permute_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_permute_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pinverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polar_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_4_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_positive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_quantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rad2deg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rand_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ravel_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_real_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reciprocal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_remainder_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_renorm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_interleave_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize_as__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_roll_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rot90_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_neg_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scalar_tensor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_searchsorted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sgn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_short_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_bartlett_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_blackman_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_gaussian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hann_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_kaiser_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_nuttall_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signbit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_mm_reduce_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_sampled_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_airy_ai_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_entr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_erfcx_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_h_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_he_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i0e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_laguerre_polynomial_l_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_legendre_polynomial_p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_log_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtri_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_polygamma_special_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_spherical_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_xlog1py_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_zeta_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_list_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_square_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_multiple_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_to_size_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_along_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensor_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensordot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_sparse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_topk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_torch_ops_aten__safe_softmax_default_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_transpose_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_transpose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapz_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triangular_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tril_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_true_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trunc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unbind_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unflatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_uniform_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_consecutive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_where_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_xlogy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zero__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_like_cpu_float32 2024-12-18T00:22:28.5806428Z 2024-12-18T00:22:28.5826663Z Running distributed/_tensor/test_init 1/1 ... [2024-12-18 00:22:28.582428] 2024-12-18T00:22:28.5827303Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:22:28.5831907Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:22:28.582938] 2024-12-18T00:23:02.5782958Z 2024-12-18T00:23:02.5784256Z distributed/_tensor/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_init_1.1_bc9407217b9b4590_.log 2024-12-18T00:23:02.5787685Z Running 7 items in this shard: test/distributed/_tensor/test_init.py::DTensorInitOpsTest::test_init_ops, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_empty, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_full, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_ones, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_full_mesh, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_submesh 2024-12-18T00:23:02.5790433Z 2024-12-18T00:23:02.5790756Z Running distributed/_tensor/test_experimental_ops 1/1 ... [2024-12-18 00:23:02.578777] 2024-12-18T00:23:02.5791338Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:23:02.5795469Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_experimental_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:02.579292] 2024-12-18T00:23:19.3789382Z 2024-12-18T00:23:19.3790835Z distributed/_tensor/test_experimental_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_experimental_ops_1.1_ef99caa3c1f99845_.log 2024-12-18T00:23:19.3792897Z Running 3 items in this shard: test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_bernoulli, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_nll, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_slice 2024-12-18T00:23:19.3794101Z 2024-12-18T00:23:19.3796311Z Running distributed/_tensor/test_tensor_ops 1/1 ... [2024-12-18 00:23:19.379394] 2024-12-18T00:23:19.3796857Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:23:19.3801441Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:19.379891] 2024-12-18T00:25:16.2078472Z 2024-12-18T00:25:16.2079900Z distributed/_tensor/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_tensor_ops_1.1_685e7cc7b47983e4_.log 2024-12-18T00:25:16.2090321Z Running 25 items in this shard: test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_aten_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_clone, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_detach, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_dtensor_dtype_conversion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_empty_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_equal, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_full_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_gather, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_index, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_inplace_op, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_empty_strided, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_full, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_op_out_variant, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_scatter, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_slice, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_stack, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_where_type_promotion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zero_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like_partial_sum 2024-12-18T00:25:16.2099940Z 2024-12-18T00:25:16.2100245Z Running distributed/_tensor/test_math_ops 1/1 ... [2024-12-18 00:25:16.208868] 2024-12-18T00:25:16.2100771Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:25:16.2101939Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_math_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:16.209346] 2024-12-18T00:26:23.4394745Z 2024-12-18T00:26:23.4395882Z distributed/_tensor/test_math_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_math_ops_1.1_df3cf4895e28fac6_.log 2024-12-18T00:26:23.4402679Z Running 14 items in this shard: test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_foreach_norm, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd_req_grad, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linalg_eigh, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linear_op_reductions, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_mean, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_nll_loss_and_cross_entropy, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard0_svd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard_math_ops, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_with_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_topk, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_upsampling 2024-12-18T00:26:23.4408390Z 2024-12-18T00:26:23.4408714Z Running distributed/_shard/sharded_tensor/ops/test_init 1/1 ... [2024-12-18 00:26:23.439986] 2024-12-18T00:26:23.4409270Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:26:23.4410451Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:23.440611] 2024-12-18T00:26:27.4698016Z 2024-12-18T00:26:27.4699243Z distributed/_shard/sharded_tensor/ops/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_62849d643d077e70_.log 2024-12-18T00:26:27.4701868Z Running 3 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_kaiming_uniform, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_normal, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_uniform 2024-12-18T00:26:27.4703772Z 2024-12-18T00:26:27.4704956Z Running distributed/_tensor/test_matrix_ops 1/1 ... [2024-12-18 00:26:27.470246] 2024-12-18T00:26:27.4705520Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:26:27.4709595Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_matrix_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:27.470726] 2024-12-18T00:27:18.9548423Z 2024-12-18T00:27:18.9550155Z distributed/_tensor/test_matrix_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_matrix_ops_1.1_83ec18a2a117d567_.log 2024-12-18T00:27:18.9558738Z Running 11 items in this shard: test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_auto_redistribute, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_empty_operand, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_baddbmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_bmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_dtensor_mm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_matmul, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_mm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_scaled_dot_product_attention, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t_partial 2024-12-18T00:27:18.9565276Z 2024-12-18T00:27:18.9566272Z Running distributed/rpc/cuda/test_tensorpipe_agent 1/1 ... [2024-12-18 00:27:18.955659] 2024-12-18T00:27:18.9567134Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:27:18.9568787Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/cuda/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:18.956335] 2024-12-18T00:42:36.6195466Z 2024-12-18T00:42:36.6197069Z distributed/rpc/cuda/test_tensorpipe_agent 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_e9a72336a01d4052_.log 2024-12-18T00:42:36.6292624Z Running 99 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations 2024-12-18T00:42:36.6356439Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda 2024-12-18T00:42:36.6357553Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple 2024-12-18T00:42:36.6358718Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation 2024-12-18T00:42:36.6359984Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root 2024-12-18T00:42:36.6361264Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device 2024-12-18T00:42:36.6362550Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script 2024-12-18T00:42:36.6363768Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices 2024-12-18T00:42:36.6364889Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device 2024-12-18T00:42:36.6366102Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu 2024-12-18T00:42:36.6367500Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future 2024-12-18T00:42:36.6368895Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future 2024-12-18T00:42:36.6370279Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices 2024-12-18T00:42:36.6371706Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor 2024-12-18T00:42:36.6373124Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor 2024-12-18T00:42:36.6374607Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor 2024-12-18T00:42:36.6377763Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor 2024-12-18T00:42:36.6379319Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor 2024-12-18T00:42:36.6381000Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor 2024-12-18T00:42:36.6382415Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device 2024-12-18T00:42:36.6383741Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int 2024-12-18T00:42:36.6385046Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str 2024-12-18T00:42:36.6386454Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda 2024-12-18T00:42:36.6387802Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace 2024-12-18T00:42:36.6389152Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor 2024-12-18T00:42:36.6390486Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device 2024-12-18T00:42:36.6391832Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream 2024-12-18T00:42:36.6393045Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi 2024-12-18T00:42:36.6394309Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested 2024-12-18T00:42:36.6395593Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi 2024-12-18T00:42:36.6396843Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu 2024-12-18T00:42:36.6398117Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default 2024-12-18T00:42:36.6399475Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default 2024-12-18T00:42:36.6400800Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default 2024-12-18T00:42:36.6402145Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default 2024-12-18T00:42:36.6403488Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1 2024-12-18T00:42:36.6404744Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2 2024-12-18T00:42:36.6406019Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3 2024-12-18T00:42:36.6407291Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4 2024-12-18T00:42:36.6408587Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5 2024-12-18T00:42:36.6409929Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6 2024-12-18T00:42:36.6411211Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7 2024-12-18T00:42:36.6412494Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8 2024-12-18T00:42:36.6413798Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1 2024-12-18T00:42:36.6415124Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2 2024-12-18T00:42:36.6416490Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3 2024-12-18T00:42:36.6417818Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4 2024-12-18T00:42:36.6419143Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5 2024-12-18T00:42:36.6420561Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6 2024-12-18T00:42:36.6422023Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7 2024-12-18T00:42:36.6424840Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8 2024-12-18T00:42:36.6427206Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default 2024-12-18T00:42:36.6429799Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default 2024-12-18T00:42:36.6432512Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default 2024-12-18T00:42:36.6434980Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default 2024-12-18T00:42:36.6436953Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu 2024-12-18T00:42:36.6438229Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options 2024-12-18T00:42:36.6439577Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device 2024-12-18T00:42:36.6440978Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device 2024-12-18T00:42:36.6442575Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device 2024-12-18T00:42:36.6443911Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one 2024-12-18T00:42:36.6446150Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config 2024-12-18T00:42:36.6448436Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop 2024-12-18T00:42:36.6452704Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout 2024-12-18T00:42:36.6455434Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote 2024-12-18T00:42:36.6457998Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response 2024-12-18T00:42:36.6460327Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response 2024-12-18T00:42:36.6461943Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop 2024-12-18T00:42:36.6463298Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu 2024-12-18T00:42:36.6464585Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self 2024-12-18T00:42:36.6465875Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many 2024-12-18T00:42:36.6467119Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote 2024-12-18T00:42:36.6468385Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu 2024-12-18T00:42:36.6469712Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self 2024-12-18T00:42:36.6471052Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name 2024-12-18T00:42:36.6472460Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch 2024-12-18T00:42:36.6473699Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch 2024-12-18T00:42:36.6475026Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse 2024-12-18T00:42:36.6476405Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1 2024-12-18T00:42:36.6477786Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2 2024-12-18T00:42:36.6479174Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3 2024-12-18T00:42:36.6480560Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4 2024-12-18T00:42:36.6481918Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1 2024-12-18T00:42:36.6483239Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2 2024-12-18T00:42:36.6484568Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3 2024-12-18T00:42:36.6485986Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4 2024-12-18T00:42:36.6487314Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5 2024-12-18T00:42:36.6488649Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1 2024-12-18T00:42:36.6489983Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2 2024-12-18T00:42:36.6491402Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3 2024-12-18T00:42:36.6492745Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4 2024-12-18T00:42:36.6494084Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1 2024-12-18T00:42:36.6495425Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2 2024-12-18T00:42:36.6496756Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3 2024-12-18T00:42:36.6498087Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4 2024-12-18T00:42:36.6499435Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes 2024-12-18T00:42:36.6500780Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value 2024-12-18T00:42:36.6502099Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass 2024-12-18T00:42:36.6503447Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams 2024-12-18T00:42:36.6504800Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations 2024-12-18T00:42:36.6505554Z 2024-12-18T00:42:36.6505794Z Running distributed/test_c10d_ops_nccl 1/1 ... [2024-12-18 00:42:36.623754] 2024-12-18T00:42:36.6506268Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:36.6507369Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_ops_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:36.624386] 2024-12-18T00:42:38.1972907Z 2024-12-18T00:42:38.1974572Z distributed/test_c10d_ops_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ops_nccl_1.1_3509e881cc314672_.log 2024-12-18T00:42:38.1975981Z 2024-12-18T00:42:38.1981406Z Running distributed/checkpoint/test_save_load_api 1/1 ... [2024-12-18 00:42:38.197893] 2024-12-18T00:42:38.1982263Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:38.1988219Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_save_load_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:38.198456] 2024-12-18T00:42:46.6348201Z 2024-12-18T00:42:46.6349998Z distributed/checkpoint/test_save_load_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_save_load_api_1.1_fc06309b83e8f9d5_.log 2024-12-18T00:42:46.6351349Z Running 1 items in this shard: test/distributed/checkpoint/test_save_load_api.py::TestSaveAndLoadAPI::test_auto_detect 2024-12-18T00:42:46.6351970Z 2024-12-18T00:42:46.6354641Z Running distributed/checkpoint/test_dedup_tensors 1/1 ... [2024-12-18 00:42:46.635259] 2024-12-18T00:42:46.6355188Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:46.6359564Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dedup_tensors.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:46.635740] 2024-12-18T00:42:50.9655799Z 2024-12-18T00:42:50.9657014Z distributed/checkpoint/test_dedup_tensors 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_d321d7414566aa6f_.log 2024-12-18T00:42:50.9658359Z Running 1 items in this shard: test/distributed/checkpoint/test_dedup_tensors.py::TestDedupTensor::test_dedup_shards 2024-12-18T00:42:50.9658916Z 2024-12-18T00:42:50.9662628Z Running distributed/_composable/test_contract 1/1 ... [2024-12-18 00:42:50.966077] 2024-12-18T00:42:50.9663210Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:50.9668471Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_contract.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:50.966577] 2024-12-18T00:42:55.2463272Z 2024-12-18T00:42:55.2464673Z distributed/_composable/test_contract 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_contract_1.1_b3a5a3d603973aae_.log 2024-12-18T00:42:55.2467228Z Running 5 items in this shard: test/distributed/_composable/test_contract.py::TestContract::test_add_hooks, test/distributed/_composable/test_contract.py::TestContract::test_modify_fqn, test/distributed/_composable/test_contract.py::TestContract::test_multi_module_api, test/distributed/_composable/test_contract.py::TestContract::test_registry, test/distributed/_composable/test_contract.py::TestContract::test_state 2024-12-18T00:42:55.2469119Z 2024-12-18T00:42:55.2469862Z Running distributed/pipelining/test_microbatch 1/1 ... [2024-12-18 00:42:55.246795] 2024-12-18T00:42:55.2470395Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:55.2474988Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_microbatch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:55.247282] 2024-12-18T00:42:59.8277885Z 2024-12-18T00:42:59.8279150Z distributed/pipelining/test_microbatch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_microbatch_1.1_535f6e467c8e1750_.log 2024-12-18T00:42:59.8280970Z Running 2 items in this shard: test/distributed/pipelining/test_microbatch.py::MicrobatchTests::test_chunk_spec, test/distributed/pipelining/test_microbatch.py::MicrobatchTests::test_split_and_merge 2024-12-18T00:42:59.8281938Z 2024-12-18T00:42:59.8284318Z Running distributed/optim/test_named_optimizer 1/1 ... [2024-12-18 00:42:59.828231] 2024-12-18T00:42:59.8284890Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:42:59.8289580Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/optim/test_named_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:42:59.828733] 2024-12-18T00:43:02.8633488Z 2024-12-18T00:43:02.8635605Z distributed/optim/test_named_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_named_optimizer_1.1_a78a70951bfd937b_.log 2024-12-18T00:43:02.8637217Z 2024-12-18T00:43:02.8642532Z Running distributed/checkpoint/e2e/test_fsdp_ep 1/1 ... [2024-12-18 00:43:02.863971] 2024-12-18T00:43:02.8643403Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:02.8649021Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fsdp_ep.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:02.864559] 2024-12-18T00:43:07.2949321Z 2024-12-18T00:43:07.2950474Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_15a5221d28fb0e48_.log 2024-12-18T00:43:07.2951855Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fsdp_ep.py::TestFSDPWithEP::test_e2e 2024-12-18T00:43:07.2952365Z 2024-12-18T00:43:07.2955476Z Running distributed/_tensor/experimental/test_register_sharding 1/1 ... [2024-12-18 00:43:07.295340] 2024-12-18T00:43:07.2956076Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:07.2960502Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_register_sharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:07.295798] 2024-12-18T00:43:20.3956355Z 2024-12-18T00:43:20.3958489Z distributed/_tensor/experimental/test_register_sharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_8dbb88e45c9fb03d_.log 2024-12-18T00:43:20.3962275Z Running 2 items in this shard: test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_argmax, test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_softmax_fwd 2024-12-18T00:43:20.3964249Z 2024-12-18T00:43:20.3967225Z Running distributed/_tools/test_mem_tracker 1/1 ... [2024-12-18 00:43:20.396449] 2024-12-18T00:43:20.3968006Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:20.3973891Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:20.397041] 2024-12-18T00:43:24.8272210Z 2024-12-18T00:43:24.8273346Z distributed/_tools/test_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mem_tracker_1.1_5cef7eb4598f12b2_.log 2024-12-18T00:43:24.8275408Z Running 3 items in this shard: test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_cuda_tracker_equivalence, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_attribution, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_with_activation_checkpointing 2024-12-18T00:43:24.8276755Z 2024-12-18T00:43:24.8278745Z Running distributed/fsdp/test_fsdp_fx 1/1 ... [2024-12-18 00:43:24.827680] 2024-12-18T00:43:24.8279216Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:24.8283637Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fx.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:24.828150] 2024-12-18T00:43:29.2082018Z 2024-12-18T00:43:29.2082864Z distributed/fsdp/test_fsdp_fx 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_8905a40f724141c9_.log 2024-12-18T00:43:29.2085222Z Running 0 items in this shard: 2024-12-18T00:43:29.2085733Z 2024-12-18T00:43:29.2088758Z Running distributed/_tensor/test_attention 1/1 ... [2024-12-18 00:43:29.208654] 2024-12-18T00:43:29.2089279Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:29.2093988Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_attention.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:29.209153] 2024-12-18T00:43:33.6391780Z 2024-12-18T00:43:33.6393242Z distributed/_tensor/test_attention 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_attention_1.1_4458f73ea7776327_.log 2024-12-18T00:43:33.6396062Z Running 4 items in this shard: test/distributed/_tensor/test_attention.py::RingAttentionTest::test_is_causal_behavior, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_custom_transformer, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_native_transformer, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_sdpa 2024-12-18T00:43:33.6398154Z 2024-12-18T00:43:33.6398619Z Running distributed/_tensor/test_api 1/1 ... [2024-12-18 00:43:33.639630] 2024-12-18T00:43:33.6399252Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:43:33.6403625Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:43:33.640111] 2024-12-18T00:44:12.1624528Z 2024-12-18T00:44:12.1626119Z distributed/_tensor/test_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_api_1.1_cbaad98787efbaf6_.log 2024-12-18T00:44:12.1633173Z Running 8 items in this shard: test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_casting, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn_warning, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_meta, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_errors, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_uneven_sharding 2024-12-18T00:44:12.1638636Z 2024-12-18T00:44:12.1639145Z Running distributed/pipelining/test_stage 1/1 ... [2024-12-18 00:44:12.163272] 2024-12-18T00:44:12.1639941Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:44:12.1642214Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_stage.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:44:12.163875] 2024-12-18T00:44:16.2401238Z 2024-12-18T00:44:16.2402964Z distributed/pipelining/test_stage 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_stage_1.1_4bf6746f0621c19b_.log 2024-12-18T00:44:16.2404504Z 2024-12-18T00:44:16.2409584Z Running distributed/_composable/test_checkpoint 1/1 ... [2024-12-18 00:44:16.240710] 2024-12-18T00:44:16.2410430Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:44:16.2416053Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:44:16.241275] 2024-12-18T00:44:20.4702819Z 2024-12-18T00:44:20.4704278Z distributed/_composable/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_checkpoint_1.1_d90ff5820260c364_.log 2024-12-18T00:44:20.4707418Z Running 6 items in this shard: test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_checkpoint_kwargs, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_clears_state_on_error_in_forward, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_multi_args, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_random_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_gpu 2024-12-18T00:44:20.4710370Z 2024-12-18T00:44:20.4710705Z Running distributed/checkpoint/test_dtensor_resharding 1/1 ... [2024-12-18 00:44:20.470752] 2024-12-18T00:44:20.4711278Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:44:20.4715274Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_resharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:44:20.471281] 2024-12-18T00:44:46.1979795Z 2024-12-18T00:44:46.1981332Z distributed/checkpoint/test_dtensor_resharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_ffcb747aaa05349a_.log 2024-12-18T00:44:46.1986047Z Running 5 items in this shard: test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_1d_to_1d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_2d_to_2d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_1d_to_2d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_2d_to_1d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_dtensor_checkpoint_resharding_with_empty_shard 2024-12-18T00:44:46.1989957Z 2024-12-18T00:44:46.1990476Z Running distributed/_tensor/test_redistribute 1/1 ... [2024-12-18 00:44:46.198385] 2024-12-18T00:44:46.1991168Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:44:46.1992406Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_redistribute.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:44:46.198840] 2024-12-18T00:45:52.6171548Z 2024-12-18T00:45:52.6172911Z distributed/_tensor/test_redistribute 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_redistribute_1.1_273b345e98fd314a_.log 2024-12-18T00:45:52.6181555Z Running 13 items in this shard: test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_shard, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_negative_shard_dim, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_shard_dim_change, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_uneven_sharding, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_local_partial_grad, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_partial, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_shard_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_dim_alltoall, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_multi_dim_mesh, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_redistribute_shard_dim_multi_dim_mesh 2024-12-18T00:45:52.6188008Z 2024-12-18T00:45:52.6188528Z Running distributed/checkpoint/test_fsspec 1/1 ... [2024-12-18 00:45:52.618664] 2024-12-18T00:45:52.6189124Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:45:52.6194223Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsspec.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:45:52.619143] 2024-12-18T00:45:56.6987608Z 2024-12-18T00:45:56.6989127Z distributed/checkpoint/test_fsspec 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsspec_1.1_f27efb7492e6d9d7_.log 2024-12-18T00:45:56.6990642Z Running 2 items in this shard: test/distributed/checkpoint/test_fsspec.py::TestFSSpec::test_fsspec, test/distributed/checkpoint/test_fsspec.py::TestFSSpec::test_overwrite 2024-12-18T00:45:56.6991417Z 2024-12-18T00:45:56.6994511Z Running distributed/tensor/parallel/test_tp_style 1/1 ... [2024-12-18 00:45:56.699231] 2024-12-18T00:45:56.6995149Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:45:56.6999768Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_style.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:45:56.699700] 2024-12-18T00:46:40.8237018Z 2024-12-18T00:46:40.8238239Z distributed/tensor/parallel/test_tp_style 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_c132f2a8548fe7a8_.log 2024-12-18T00:46:40.8244125Z Running 9 items in this shard: test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input_multiple_inputs, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_kwargs_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_output, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_sequence_parallel_style 2024-12-18T00:46:40.8249126Z 2024-12-18T00:46:40.8249488Z Running distributed/_tools/test_fsdp2_mem_tracker 1/1 ... [2024-12-18 00:46:40.824092] 2024-12-18T00:46:40.8250000Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:46:40.8251262Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_fsdp2_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:46:40.824580] 2024-12-18T00:46:45.2546367Z 2024-12-18T00:46:45.2548138Z distributed/_tools/test_fsdp2_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_cda22b0101bbcda0_.log 2024-12-18T00:46:45.2553480Z Running 3 items in this shard: test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_multi_group_eager, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_non_root_forward_backward, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCompose::test_tracker_with_activation_checkpointing 2024-12-18T00:46:45.2556761Z 2024-12-18T00:46:45.2557320Z Running distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 ... [2024-12-18 00:46:45.255404] 2024-12-18T00:46:45.2558236Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:46:45.2563816Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_e2e_save_and_load.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:46:45.256031] 2024-12-18T00:47:52.8276491Z 2024-12-18T00:47:52.8278384Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_f0dc69f9a07d9d36_.log 2024-12-18T00:47:52.8293057Z Running 15 items in this shard: test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_different_ordered_state_dict_keys, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_async_cached_cache_staged_state_dict_False, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_async_cached_cache_staged_state_dict_True, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type0, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type1, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type2, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type0, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type1, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type2, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_no_dist, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_overwrite, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_partial_load, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_stateful_and_non_stateful_loads, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestNoCPU::test_no_cpu, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestInitStateDict::test_init_state_dict 2024-12-18T00:47:52.8304480Z 2024-12-18T00:47:52.8304947Z Running distributed/elastic/test_control_plane 1/1 ... [2024-12-18 00:47:52.828703] 2024-12-18T00:47:52.8305761Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:47:52.8307418Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/test_control_plane.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:47:52.829330] 2024-12-18T00:48:00.2644318Z 2024-12-18T00:48:00.2645600Z distributed/elastic/test_control_plane 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.test_control_plane_1.1_d0df3a100b683767_.log 2024-12-18T00:48:00.2651198Z Running 9 items in this shard: test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_dump_nccl_trace_pickle, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_dump_nccl_trace_pickle_with_json, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_dump_nccl_trace_pickle_with_params, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_dump_traceback, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_get_handler_names, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_get_handler_nonexistant, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_run_handler, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_tcp, test/distributed/elastic/test_control_plane.py::WorkerServerTest::test_worker_server 2024-12-18T00:48:00.2655371Z 2024-12-18T00:48:00.2655715Z Running distributed/tensor/parallel/test_tp_examples 1/1 ... [2024-12-18 00:48:00.264833] 2024-12-18T00:48:00.2656272Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:48:00.2657458Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_examples.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:48:00.265287] 2024-12-18T00:49:14.3103352Z 2024-12-18T00:49:14.3104627Z distributed/tensor/parallel/test_tp_examples 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_45d7a0283e6687c1_.log 2024-12-18T00:49:14.3117557Z Running 16 items in this shard: test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_loss_parallel, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_inference, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_False_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_True_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_float64_thaw_all, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_all, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_layers_0_attention_wv__layers_0_feed_forward_w1__layers_1_feed_forward_w2__layers_1_ffn_norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_layers_1_ffn_norm__norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_norm__output, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_False_float32, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_False_float64, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_True_float32, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_True_float64, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_weight_tying 2024-12-18T00:49:14.3128362Z 2024-12-18T00:49:14.3128610Z Running distributed/test_nccl 1/1 ... [2024-12-18 00:49:14.310777] 2024-12-18T00:49:14.3129057Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:49:14.3130133Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:49:14.311230] 2024-12-18T00:49:18.6809607Z 2024-12-18T00:49:18.6811121Z distributed/test_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_nccl_1.1_af51a1faf905fb4b_.log 2024-12-18T00:49:18.6811978Z Running 0 items in this shard: 2024-12-18T00:49:18.6812178Z 2024-12-18T00:49:18.6815053Z Running distributed/test_c10d_logger 1/1 ... [2024-12-18 00:49:18.681322] 2024-12-18T00:49:18.6815542Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:49:18.6819510Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_logger.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:49:18.681750] 2024-12-18T00:49:31.1745609Z 2024-12-18T00:49:31.1746891Z distributed/test_c10d_logger 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_logger_1.1_c521d2374697bb03_.log 2024-12-18T00:49:31.1748450Z Running 2 items in this shard: test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_exception_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_get_or_create_logger 2024-12-18T00:49:31.1749312Z 2024-12-18T00:49:31.1752378Z Running distributed/fsdp/test_fsdp_state_dict 1/1 ... [2024-12-18 00:49:31.174996] 2024-12-18T00:49:31.1753009Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:49:31.1757216Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:49:31.175465] 2024-12-18T00:49:36.1565923Z 2024-12-18T00:49:36.1567504Z distributed/fsdp/test_fsdp_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_state_dict_1.1_98f71012a6228f1a_.log 2024-12-18T00:49:36.1711950Z Running 179 items in this shard: test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_full_state_dict_missing_unexpected_keys_cleaned, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_local_state_dict_with_empty_ranks, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_sharded_load_multi_backend_pg, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_shared_module_and_shared_parameter, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_False_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_False_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_True_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_True_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_False_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_False_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_True_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_True_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_rank0_offload_save_load_flow_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_rank0_offload_save_load_flow_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_local_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_sharded_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_type, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_sharded_state_dict_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_sharded_state_dict_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_state_dict_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_state_dict_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_torch_save_load, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_world_size_one, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_wrong_state_dict_config, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict4GPUs::test_local_state_dict_reshard 2024-12-18T00:49:36.1851975Z 2024-12-18T00:49:36.1852398Z Running distributed/_tensor/test_optimizers 1/1 ... [2024-12-18 00:49:36.157657] 2024-12-18T00:49:36.1852905Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:49:36.1854058Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_optimizers.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:49:36.158125] 2024-12-18T00:50:32.8563648Z 2024-12-18T00:50:32.8565145Z distributed/_tensor/test_optimizers 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_optimizers_1.1_bc040ff31dc8d7cf_.log 2024-12-18T00:50:32.8570711Z Running 11 items in this shard: test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_RMSprop_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adadelta_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adagrad_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adamax_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adamw_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_asgd_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_nadam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_optimizer_foreach_supported_types_include_DTensor, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_radam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_sgd_1d_sharding 2024-12-18T00:50:32.8575929Z 2024-12-18T00:50:32.8579245Z Running distributed/test_c10d_nccl 1/1 ... [2024-12-18 00:50:32.857742] 2024-12-18T00:50:32.8579722Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:50:32.8584960Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:50:32.858261] 2024-12-18T00:50:34.4660753Z 2024-12-18T00:50:34.4661772Z distributed/test_c10d_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_nccl_1.1_1b355e3bd9e0f9f3_.log 2024-12-18T00:50:34.4662514Z 2024-12-18T00:50:34.4666588Z Running distributed/fsdp/test_fsdp_overlap 1/1 ... [2024-12-18 00:50:34.466472] 2024-12-18T00:50:34.4667088Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:50:34.4671760Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:50:34.466944] 2024-12-18T00:50:43.3044021Z 2024-12-18T00:50:43.3045374Z distributed/fsdp/test_fsdp_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_2da682962fb824d3_.log 2024-12-18T00:50:43.3047083Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_overlap.py::TestForwardOverlapWorldSizeTwo::test_forward_overlap 2024-12-18T00:50:43.3047934Z 2024-12-18T00:50:43.3048406Z Running distributed/fsdp/test_fsdp_optim_state 1/1 ... [2024-12-18 00:50:43.304593] 2024-12-18T00:50:43.3048923Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:50:43.3053544Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:50:43.305083] 2024-12-18T00:55:03.0330274Z 2024-12-18T00:55:03.0331518Z distributed/fsdp/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_7a47f1813d268f5f_.log 2024-12-18T00:55:03.0372159Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_compatible_with_trec, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_nested, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_keys, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_nested_invalid, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_interface_arguments, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_no_grad, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_input_warning, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_without_param_groups, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_names, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type0, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type1, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_state_dict_with_none_tensor_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_use_orig_params, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_empty_optimizer_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_no_shard 2024-12-18T00:55:03.0410107Z 2024-12-18T00:55:03.0410428Z Running distributed/fsdp/test_fsdp_freezing_weights 1/1 ... [2024-12-18 00:55:03.033683] 2024-12-18T00:55:03.0410971Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:55:03.0412155Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_freezing_weights.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:55:03.034191] 2024-12-18T00:57:13.0545413Z 2024-12-18T00:57:13.0546622Z distributed/fsdp/test_fsdp_freezing_weights 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_freezing_weights_1.1_7043f01e47b57d67_.log 2024-12-18T00:57:13.0582253Z Running 32 items in this shard: test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True 2024-12-18T00:57:13.0614408Z 2024-12-18T00:57:13.0614750Z Running distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 ... [2024-12-18 00:57:13.054624] 2024-12-18T00:57:13.0615327Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:13.0616548Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:13.055108] 2024-12-18T00:57:17.0843639Z 2024-12-18T00:57:17.0844903Z distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks_1.1_ad4945944be5a777_.log 2024-12-18T00:57:17.0849571Z Running 6 items in this shard: test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_allreduce_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_fp16compress_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_noop_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_quantize_per_channel_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_quantize_per_tensor_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_is_last_hook 2024-12-18T00:57:17.0853270Z 2024-12-18T00:57:17.0853852Z Running distributed/fsdp/test_fsdp_exec_order 1/1 ... [2024-12-18 00:57:17.084832] 2024-12-18T00:57:17.0854421Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:17.0855591Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_exec_order.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:17.085308] 2024-12-18T00:57:21.4152623Z 2024-12-18T00:57:21.4153879Z distributed/fsdp/test_fsdp_exec_order 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_5c02d12f16b24eef_.log 2024-12-18T00:57:21.4155140Z Running 0 items in this shard: 2024-12-18T00:57:21.4155349Z 2024-12-18T00:57:21.4158984Z Running distributed/test_multi_threaded_pg 1/1 ... [2024-12-18 00:57:21.415725] 2024-12-18T00:57:21.4159490Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:21.4164185Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_multi_threaded_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:21.416212] 2024-12-18T00:57:25.8962297Z 2024-12-18T00:57:25.8963344Z distributed/test_multi_threaded_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_multi_threaded_pg_1.1_f16bd84ab7660714_.log 2024-12-18T00:57:25.8973661Z Running 22 items in this shard: test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_none, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_tensor, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_skip, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_coalesced, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_ops, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_to_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_allgather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_assert_equal_on_rank, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_bwd_sees_fwd_pg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_gather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_reduce_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_subpg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_using_pg_from_another_thread 2024-12-18T00:57:25.8983256Z 2024-12-18T00:57:25.8983535Z Running distributed/fsdp/test_fsdp_uneven 1/1 ... [2024-12-18 00:57:25.896756] 2024-12-18T00:57:25.8984029Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:25.8985438Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_uneven.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:25.897239] 2024-12-18T00:57:30.2268611Z 2024-12-18T00:57:30.2269755Z distributed/fsdp/test_fsdp_uneven 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_uneven_1.1_1791b9479564ec78_.log 2024-12-18T00:57:30.2270655Z Running 0 items in this shard: 2024-12-18T00:57:30.2270865Z 2024-12-18T00:57:30.2275380Z Running distributed/fsdp/test_fsdp_input 1/1 ... [2024-12-18 00:57:30.227350] 2024-12-18T00:57:30.2275951Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:30.2280916Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_input.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:30.227873] 2024-12-18T00:57:34.6076608Z 2024-12-18T00:57:34.6077721Z distributed/fsdp/test_fsdp_input 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_input_1.1_58eea2890866cec8_.log 2024-12-18T00:57:34.6078635Z Running 0 items in this shard: 2024-12-18T00:57:34.6078830Z 2024-12-18T00:57:34.6083198Z Running distributed/fsdp/test_fsdp_grad_acc 1/1 ... [2024-12-18 00:57:34.608130] 2024-12-18T00:57:34.6083747Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:57:34.6088553Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_grad_acc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:57:34.608634] 2024-12-18T00:58:03.2771085Z 2024-12-18T00:58:03.2772476Z distributed/fsdp/test_fsdp_grad_acc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_6809edf03f6fe563_.log 2024-12-18T00:58:03.2776045Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_True 2024-12-18T00:58:03.2779202Z 2024-12-18T00:58:03.2779494Z Running distributed/fsdp/test_fsdp_ignored_modules 1/1 ... [2024-12-18 00:58:03.277499] 2024-12-18T00:58:03.2780050Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:03.2782326Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_ignored_modules.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:03.277974] 2024-12-18T00:58:07.7105164Z 2024-12-18T00:58:07.7106424Z distributed/fsdp/test_fsdp_ignored_modules 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_ignored_modules_1.1_876e2cf5431e73f9_.log 2024-12-18T00:58:07.7112129Z Running 8 items in this shard: test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_diff_ignored_modules_across_ranks, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_modules_invalid, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_modules_nested, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_modules_not_under_wrapped_root_ignore_modules_False, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_modules_not_under_wrapped_root_ignore_modules_True, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_modules_transformer, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_states_auto_wrap, test/distributed/fsdp/test_fsdp_ignored_modules.py::TestFSDPIgnoredModules::test_ignored_states_check 2024-12-18T00:58:07.7116770Z 2024-12-18T00:58:07.7117140Z Running distributed/_composable/fsdp/test_fully_shard_memory 1/1 ... [2024-12-18 00:58:07.710940] 2024-12-18T00:58:07.7117761Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:07.7119061Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:07.711441] 2024-12-18T00:58:12.1416446Z 2024-12-18T00:58:12.1418503Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_850e760428120674_.log 2024-12-18T00:58:12.1422105Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_memory.py::TestFullyShardMemory::test_fully_shard_del_memory, test/distributed/_composable/fsdp/test_fully_shard_memory.py::TestFullyShardMemory::test_fully_shard_training_memory 2024-12-18T00:58:12.1424178Z 2024-12-18T00:58:12.1424693Z Running distributed/fsdp/test_checkpoint_wrapper 1/1 ... [2024-12-18 00:58:12.142200] 2024-12-18T00:58:12.1425550Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:12.1431790Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_checkpoint_wrapper.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:12.142814] 2024-12-18T00:58:16.6230352Z 2024-12-18T00:58:16.6231526Z distributed/fsdp/test_checkpoint_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_checkpoint_wrapper_1.1_65ed8e995078107b_.log 2024-12-18T00:58:16.6236775Z Running 8 items in this shard: test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_apply_activation_checkpointing, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_args_kwargs, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_cpu_offload, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_kwarg_support, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_parity, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_forward_missing_attributes, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_fqn, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_load_activation_checkpointed_module 2024-12-18T00:58:16.6241330Z 2024-12-18T00:58:16.6241631Z Running distributed/fsdp/test_utils 1/1 ... [2024-12-18 00:58:16.623521] 2024-12-18T00:58:16.6242196Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:16.6243350Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:16.624020] 2024-12-18T00:58:20.7535419Z 2024-12-18T00:58:20.7536531Z distributed/fsdp/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_utils_1.1_18538b7105c1e819_.log 2024-12-18T00:58:20.7537401Z Running 0 items in this shard: 2024-12-18T00:58:20.7537596Z 2024-12-18T00:58:20.7540906Z Running distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 ... [2024-12-18 00:58:20.753863] 2024-12-18T00:58:20.7541594Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:20.7546461Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_hsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:20.754350] 2024-12-18T00:58:25.1340513Z 2024-12-18T00:58:25.1342231Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_e70eb90fdaeb1947_.log 2024-12-18T00:58:25.1343591Z Running 0 items in this shard: 2024-12-18T00:58:25.1343803Z 2024-12-18T00:58:25.1347281Z Running distributed/fsdp/test_fsdp_tp_integration 1/1 ... [2024-12-18 00:58:25.134499] 2024-12-18T00:58:25.1347943Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:25.1352882Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_tp_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:25.134997] 2024-12-18T00:58:41.6342443Z 2024-12-18T00:58:41.6344072Z distributed/fsdp/test_fsdp_tp_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_bd7fd29a31625604_.log 2024-12-18T00:58:41.6346421Z Running 3 items in this shard: test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_extension_grad, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_integration, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_sync_module_state 2024-12-18T00:58:41.6348144Z 2024-12-18T00:58:41.6349057Z Running distributed/fsdp/test_fsdp_checkpoint 1/1 ... [2024-12-18 00:58:41.634707] 2024-12-18T00:58:41.6349575Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:58:41.6354498Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:58:41.635205] 2024-12-18T00:59:55.2217882Z 2024-12-18T00:59:55.2218994Z distributed/fsdp/test_fsdp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_checkpoint_1.1_c7efb3508618fcc1_.log 2024-12-18T00:59:55.2231062Z Running 16 items in this shard: test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_True_use_orig_params_True 2024-12-18T00:59:55.2242370Z 2024-12-18T00:59:55.2242654Z Running distributed/algorithms/test_join 1/1 ... [2024-12-18 00:59:55.221970] 2024-12-18T00:59:55.2243155Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T00:59:55.2244285Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/test_join.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:59:55.222495] 2024-12-18T01:00:36.2683082Z 2024-12-18T01:00:36.2684473Z distributed/algorithms/test_join 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.test_join_1.1_776f8aa35a4ec812_.log 2024-12-18T01:00:36.2688752Z Running 9 items in this shard: test/distributed/algorithms/test_join.py::TestJoin::test_join_kwargs, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables_throw, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_main_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_post_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_throw 2024-12-18T01:00:36.2692001Z 2024-12-18T01:00:36.2692344Z Running distributed/fsdp/test_fsdp_hybrid_shard 1/1 ... [2024-12-18 01:00:36.268713] 2024-12-18T01:00:36.2692997Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:00:36.2694171Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_hybrid_shard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:00:36.269184] 2024-12-18T01:01:05.0419250Z 2024-12-18T01:01:05.0420874Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_d44e546f2283968e_.log 2024-12-18T01:01:05.0424912Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_basic_setup, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_parity, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_save_load_state_dict, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_sync_module_state, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_invalid_pg_specification_raises, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_raises_manual_wrap_hybrid_shard_when_none_policy 2024-12-18T01:01:05.0428017Z 2024-12-18T01:01:05.0428380Z Running distributed/_composable/fsdp/test_fully_shard_training 1/1 ... [2024-12-18 01:01:05.042434] 2024-12-18T01:01:05.0428968Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:01:05.0431603Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_training.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:01:05.042921] 2024-12-18T01:01:09.5765029Z 2024-12-18T01:01:09.5766500Z distributed/_composable/fsdp/test_fully_shard_training 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_training_1.1_2a9e14838982005d_.log 2024-12-18T01:01:09.5782218Z Running 24 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_training.py::test_compiled_fsdp, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardForwardInputs::test_root_move_forward_input_to_device, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardRegisteredParams::test_param_registration_after_backward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardRegisteredParams::test_param_registration_after_forward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardCastAfterInit::test_to_float64_after_init, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_explicit_prefetching, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_multi_forward_module, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_non_root_forward_backward, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_post_optim_event, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group_cpu_offload_eager, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_multi_group_unshard_async_op, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_single_group_shard_dim0, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCore::test_train_parity_single_group_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShard1DTrainingCompose::test_train_parity_with_activation_checkpointing, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardShardPlacementFnMultiProcess::test_train_parity_shard_placement_fn_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardShardPlacementFnMultiThread::test_shard_placement_fn_contiguous_params_grads, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardSharedParams::test_train_parity_with_shared_params, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardGradientAccumulation::test_1f1b_microbatching, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardGradientAccumulation::test_gradient_accumulation, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardNDTraining::test_2d_mlp_with_nd_mesh, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardHSDP3DTraining::test_3d_mlp_with_nd_mesh, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardHSDPTraining::test_train_parity_hsdp, test/distributed/_composable/fsdp/test_fully_shard_training.py::TestFullyShardCustomForwardMethod::test_register_fsdp_forward_method 2024-12-18T01:01:09.5796045Z 2024-12-18T01:01:09.5796410Z Running distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 ... [2024-12-18 01:01:09.577020] 2024-12-18T01:01:09.5796998Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:01:09.5798217Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_file_system_checkpoint_cpu.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:01:09.577484] 2024-12-18T01:01:55.5285246Z 2024-12-18T01:01:55.5289221Z distributed/checkpoint/test_file_system_checkpoint_cpu 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_file_system_checkpoint_cpu_1.1_bfe4f59c816e556d_.log 2024-12-18T01:01:55.5300872Z Running 12 items in this shard: test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_save_load_bytes_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_save_load_bytes_thread_count_2, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor_thread_count_1, test/distributed/checkpoint/test_file_system_checkpoint_cpu.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor_thread_count_2 2024-12-18T01:01:55.5308801Z 2024-12-18T01:01:55.5309092Z Running distributed/rpc/test_faulty_agent 1/1 ... [2024-12-18 01:01:55.529083] 2024-12-18T01:01:55.5309573Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:01:55.5310758Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_faulty_agent.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:01:55.529571] 2024-12-18T01:08:58.8011999Z 2024-12-18T01:08:58.8013526Z distributed/rpc/test_faulty_agent 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_faulty_agent_1.1_f44f4890c3436f66_.log 2024-12-18T01:08:58.8033579Z Running 28 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_check_failed_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_faulty_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_messages_to_delay, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_no_faulty_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_builtin_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_script_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rref_to_here_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_verify_backend_options, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_context_cleanup_tensor_with_grad, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_verify_backend_options, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_remote_timeout_to_here_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_script_func, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_to_here_timeout_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_python, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_torchscript_function 2024-12-18T01:08:58.8047755Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout 2024-12-18T01:08:58.8048991Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout_to_self 2024-12-18T01:08:58.8050138Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_check_failed_messages 2024-12-18T01:08:58.8051168Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_faulty_messages 2024-12-18T01:08:58.8052188Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_messages_to_delay 2024-12-18T01:08:58.8053210Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_no_faulty_messages 2024-12-18T01:08:58.8054293Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout 2024-12-18T01:08:58.8055487Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout_to_self 2024-12-18T01:08:58.8056678Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle 2024-12-18T01:08:58.8057926Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle_to_self 2024-12-18T01:08:58.8059100Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout 2024-12-18T01:08:58.8060282Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout_to_self 2024-12-18T01:08:58.8061379Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_builtin_timeout 2024-12-18T01:08:58.8062379Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_script_timeout 2024-12-18T01:08:58.8063511Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rref_to_here_timeout 2024-12-18T01:08:58.8064584Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout 2024-12-18T01:08:58.8065747Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout_to_self 2024-12-18T01:08:58.8066925Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout 2024-12-18T01:08:58.8068113Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout_to_self 2024-12-18T01:08:58.8069774Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_verify_backend_options 2024-12-18T01:08:58.8070898Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_context_cleanup_tensor_with_grad 2024-12-18T01:08:58.8072161Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_verify_backend_options 2024-12-18T01:08:58.8073307Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_remote_timeout_to_here_in_jit 2024-12-18T01:08:58.8074428Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_in_jit 2024-12-18T01:08:58.8075567Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_script_func 2024-12-18T01:08:58.8076711Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_to_here_timeout_in_jit 2024-12-18T01:08:58.8077783Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_python 2024-12-18T01:08:58.8078879Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_torchscript_function 2024-12-18T01:08:58.8079514Z 2024-12-18T01:08:58.8079795Z Running distributed/rpc/test_tensorpipe_agent 2/4 ... [2024-12-18 01:08:58.802459] 2024-12-18T01:08:58.8080305Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:08:58.8081508Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=2', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:08:58.802943] 2024-12-18T01:29:20.8291918Z 2024-12-18T01:29:20.8293084Z distributed/rpc/test_tensorpipe_agent 2/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_740c4da14e7d0a75_.log 2024-12-18T01:29:20.8367909Z Running 122 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-12-18T01:29:20.8422468Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add 2024-12-18T01:29:20.8423473Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote 2024-12-18T01:29:20.8424574Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async 2024-12-18T01:29:20.8425696Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote 2024-12-18T01:29:20.8426784Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async 2024-12-18T01:29:20.8427920Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote 2024-12-18T01:29:20.8429032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async 2024-12-18T01:29:20.8430086Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method 2024-12-18T01:29:20.8431100Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote 2024-12-18T01:29:20.8432171Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self 2024-12-18T01:29:20.8433138Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple 2024-12-18T01:29:20.8434166Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options 2024-12-18T01:29:20.8435285Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used 2024-12-18T01:29:20.8436262Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name 2024-12-18T01:29:20.8437201Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src 2024-12-18T01:29:20.8438121Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done 2024-12-18T01:29:20.8439092Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception 2024-12-18T01:29:20.8440080Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos 2024-12-18T01:29:20.8441033Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc 2024-12-18T01:29:20.8442162Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names 2024-12-18T01:29:20.8443219Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown 2024-12-18T01:29:20.8444218Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret 2024-12-18T01:29:20.8445176Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc 2024-12-18T01:29:20.8446117Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress 2024-12-18T01:29:20.8447095Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward 2024-12-18T01:29:20.8448070Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init 2024-12-18T01:29:20.8449038Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future 2024-12-18T01:29:20.8450173Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace 2024-12-18T01:29:20.8451235Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled 2024-12-18T01:29:20.8452262Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory 2024-12-18T01:29:20.8453285Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes 2024-12-18T01:29:20.8454420Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded 2024-12-18T01:29:20.8455723Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded 2024-12-18T01:29:20.8456857Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf 2024-12-18T01:29:20.8457980Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded 2024-12-18T01:29:20.8459035Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in 2024-12-18T01:29:20.8459977Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method 2024-12-18T01:29:20.8460941Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception 2024-12-18T01:29:20.8461920Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle 2024-12-18T01:29:20.8462889Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result 2024-12-18T01:29:20.8463907Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func 2024-12-18T01:29:20.8464859Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args 2024-12-18T01:29:20.8465833Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container 2024-12-18T01:29:20.8466858Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call 2024-12-18T01:29:20.8467868Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit 2024-12-18T01:29:20.8468781Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future 2024-12-18T01:29:20.8469743Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async 2024-12-18T01:29:20.8470732Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote 2024-12-18T01:29:20.8471810Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs 2024-12-18T01:29:20.8472820Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function 2024-12-18T01:29:20.8473958Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded 2024-12-18T01:29:20.8475029Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts 2024-12-18T01:29:20.8476035Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported 2024-12-18T01:29:20.8477086Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking 2024-12-18T01:29:20.8478207Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking 2024-12-18T01:29:20.8479195Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add 2024-12-18T01:29:20.8480085Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add 2024-12-18T01:29:20.8481094Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg 2024-12-18T01:29:20.8482121Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank 2024-12-18T01:29:20.8483198Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler 2024-12-18T01:29:20.8484284Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout 2024-12-18T01:29:20.8485308Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc 2024-12-18T01:29:20.8486264Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc 2024-12-18T01:29:20.8487206Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward 2024-12-18T01:29:20.8488211Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func 2024-12-18T01:29:20.8489211Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout 2024-12-18T01:29:20.8490192Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense 2024-12-18T01:29:20.8491208Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout 2024-12-18T01:29:20.8492298Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf 2024-12-18T01:29:20.8493474Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors 2024-12-18T01:29:20.8494585Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref 2024-12-18T01:29:20.8495643Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors 2024-12-18T01:29:20.8496699Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info 2024-12-18T01:29:20.8497757Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling 2024-12-18T01:29:20.8498859Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call 2024-12-18T01:29:20.8499982Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call 2024-12-18T01:29:20.8501147Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors 2024-12-18T01:29:20.8502246Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context 2024-12-18T01:29:20.8503400Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote 2024-12-18T01:29:20.8504648Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args 2024-12-18T01:29:20.8505786Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions 2024-12-18T01:29:20.8506881Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim 2024-12-18T01:29:20.8507978Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote 2024-12-18T01:29:20.8509065Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf 2024-12-18T01:29:20.8510200Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults 2024-12-18T01:29:20.8511386Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork 2024-12-18T01:29:20.8512636Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async 2024-12-18T01:29:20.8513714Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf 2024-12-18T01:29:20.8514734Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled 2024-12-18T01:29:20.8515772Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return 2024-12-18T01:29:20.8516779Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner 2024-12-18T01:29:20.8517816Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported 2024-12-18T01:29:20.8518858Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate 2024-12-18T01:29:20.8519836Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value 2024-12-18T01:29:20.8520896Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported 2024-12-18T01:29:20.8521990Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed 2024-12-18T01:29:20.8523023Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward 2024-12-18T01:29:20.8524122Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context 2024-12-18T01:29:20.8525211Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync 2024-12-18T01:29:20.8526243Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref 2024-12-18T01:29:20.8527378Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported 2024-12-18T01:29:20.8528741Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported 2024-12-18T01:29:20.8530082Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside 2024-12-18T01:29:20.8531340Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs 2024-12-18T01:29:20.8532652Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp 2024-12-18T01:29:20.8533872Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together 2024-12-18T01:29:20.8535102Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc 2024-12-18T01:29:20.8536421Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank 2024-12-18T01:29:20.8537699Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args 2024-12-18T01:29:20.8538951Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse 2024-12-18T01:29:20.8540106Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse 2024-12-18T01:29:20.8541531Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container 2024-12-18T01:29:20.8542803Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse 2024-12-18T01:29:20.8544186Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads 2024-12-18T01:29:20.8545477Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse 2024-12-18T01:29:20.8546809Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse 2024-12-18T01:29:20.8548191Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse 2024-12-18T01:29:20.8549576Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse 2024-12-18T01:29:20.8550948Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse 2024-12-18T01:29:20.8552431Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse 2024-12-18T01:29:20.8553876Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse 2024-12-18T01:29:20.8555256Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-12-18T01:29:20.8555974Z 2024-12-18T01:29:20.8556247Z Running distributed/rpc/test_tensorpipe_agent 4/4 ... [2024-12-18 01:29:20.834509] 2024-12-18T01:29:20.8556758Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:29:20.8557960Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=4', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:20.835005] 2024-12-18T01:48:24.0269311Z 2024-12-18T01:48:24.0270723Z distributed/rpc/test_tensorpipe_agent 4/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_5c194fd43457a40e_.log 2024-12-18T01:48:24.0342124Z Running 112 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse 2024-12-18T01:48:24.0393794Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather 2024-12-18T01:48:24.0394751Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout 2024-12-18T01:48:24.0395726Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method 2024-12-18T01:48:24.0396741Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote 2024-12-18T01:48:24.0397919Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote 2024-12-18T01:48:24.0398986Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested 2024-12-18T01:48:24.0400028Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote 2024-12-18T01:48:24.0401046Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise 2024-12-18T01:48:24.0402123Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote 2024-12-18T01:48:24.0403367Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote 2024-12-18T01:48:24.0404540Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks 2024-12-18T01:48:24.0405659Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy 2024-12-18T01:48:24.0406705Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num 2024-12-18T01:48:24.0407728Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type 2024-12-18T01:48:24.0408745Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee 2024-12-18T01:48:24.0409818Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload 2024-12-18T01:48:24.0410901Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions 2024-12-18T01:48:24.0411886Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice 2024-12-18T01:48:24.0412876Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner 2024-12-18T01:48:24.0413868Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice 2024-12-18T01:48:24.0414809Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc 2024-12-18T01:48:24.0415724Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref 2024-12-18T01:48:24.0416653Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors 2024-12-18T01:48:24.0417691Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality 2024-12-18T01:48:24.0418657Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs 2024-12-18T01:48:24.0419728Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded 2024-12-18T01:48:24.0420854Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin 2024-12-18T01:48:24.0421924Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc 2024-12-18T01:48:24.0423063Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded 2024-12-18T01:48:24.0424232Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str 2024-12-18T01:48:24.0425338Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined 2024-12-18T01:48:24.0426275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw 2024-12-18T01:48:24.0427237Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception 2024-12-18T01:48:24.0428212Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all 2024-12-18T01:48:24.0429204Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded 2024-12-18T01:48:24.0430273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset 2024-12-18T01:48:24.0431273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info 2024-12-18T01:48:24.0432301Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak 2024-12-18T01:48:24.0433255Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self 2024-12-18T01:48:24.0434233Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse 2024-12-18T01:48:24.0435194Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor 2024-12-18T01:48:24.0436184Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self 2024-12-18T01:48:24.0437140Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str 2024-12-18T01:48:24.0438054Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout 2024-12-18T01:48:24.0439000Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking 2024-12-18T01:48:24.0440022Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg 2024-12-18T01:48:24.0441297Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg 2024-12-18T01:48:24.0442352Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors 2024-12-18T01:48:24.0443348Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc 2024-12-18T01:48:24.0444348Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler 2024-12-18T01:48:24.0445339Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown 2024-12-18T01:48:24.0446360Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python 2024-12-18T01:48:24.0447384Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call 2024-12-18T01:48:24.0448335Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id 2024-12-18T01:48:24.0449275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle 2024-12-18T01:48:24.0450381Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server 2024-12-18T01:48:24.0451535Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd 2024-12-18T01:48:24.0452772Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi 2024-12-18T01:48:24.0453827Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple 2024-12-18T01:48:24.0454878Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self 2024-12-18T01:48:24.0455960Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc 2024-12-18T01:48:24.0457072Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors 2024-12-18T01:48:24.0458297Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value 2024-12-18T01:48:24.0459454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself 2024-12-18T01:48:24.0460575Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward 2024-12-18T01:48:24.0461637Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded 2024-12-18T01:48:24.0462712Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads 2024-12-18T01:48:24.0463784Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote 2024-12-18T01:48:24.0464885Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order 2024-12-18T01:48:24.0465971Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw 2024-12-18T01:48:24.0467138Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported 2024-12-18T01:48:24.0468460Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script 2024-12-18T01:48:24.0469775Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script 2024-12-18T01:48:24.0470912Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain 2024-12-18T01:48:24.0472008Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote 2024-12-18T01:48:24.0473156Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit 2024-12-18T01:48:24.0474321Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified 2024-12-18T01:48:24.0475478Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref 2024-12-18T01:48:24.0476629Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function 2024-12-18T01:48:24.0477753Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception 2024-12-18T01:48:24.0478843Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients 2024-12-18T01:48:24.0479901Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script 2024-12-18T01:48:24.0481039Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs 2024-12-18T01:48:24.0482237Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script 2024-12-18T01:48:24.0483421Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters 2024-12-18T01:48:24.0484620Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire 2024-12-18T01:48:24.0486424Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside 2024-12-18T01:48:24.0487594Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs 2024-12-18T01:48:24.0488798Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote 2024-12-18T01:48:24.0490015Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads 2024-12-18T01:48:24.0491344Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda 2024-12-18T01:48:24.0492829Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank 2024-12-18T01:48:24.0494167Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse 2024-12-18T01:48:24.0495358Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse 2024-12-18T01:48:24.0496500Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse 2024-12-18T01:48:24.0497673Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse 2024-12-18T01:48:24.0498889Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse 2024-12-18T01:48:24.0500080Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout 2024-12-18T01:48:24.0501275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout 2024-12-18T01:48:24.0502477Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse 2024-12-18T01:48:24.0503772Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse 2024-12-18T01:48:24.0505171Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse 2024-12-18T01:48:24.0506495Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse 2024-12-18T01:48:24.0507811Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse 2024-12-18T01:48:24.0509198Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse 2024-12-18T01:48:24.0510682Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse 2024-12-18T01:48:24.0512137Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse 2024-12-18T01:48:24.0513536Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse 2024-12-18T01:48:24.0514943Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse 2024-12-18T01:48:24.0516322Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse 2024-12-18T01:48:24.0517691Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse 2024-12-18T01:48:24.0519019Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse 2024-12-18T01:48:24.0519702Z 2024-12-18T01:48:24.0519965Z Running distributed/fsdp/test_fsdp_fine_tune 1/1 ... [2024-12-18 01:48:24.031698] 2024-12-18T01:48:24.0520463Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:24.0521591Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fine_tune.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:24.032200] 2024-12-18T01:48:28.4623117Z 2024-12-18T01:48:28.4624731Z distributed/fsdp/test_fsdp_fine_tune 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_b4ff33174e4e9566_.log 2024-12-18T01:48:28.4625680Z Running 0 items in this shard: 2024-12-18T01:48:28.4625889Z 2024-12-18T01:48:28.4629309Z Running distributed/_shard/test_sharder 1/1 ... [2024-12-18 01:48:28.462730] 2024-12-18T01:48:28.4629908Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:28.4635168Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/test_sharder.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:28.463225] 2024-12-18T01:48:32.5459509Z 2024-12-18T01:48:32.5460889Z distributed/_shard/test_sharder 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.test_sharder_1.1_03c417808c72ac7e_.log 2024-12-18T01:48:32.5462496Z Running 2 items in this shard: test/distributed/_shard/test_sharder.py::TestCustomSharder::test_custom_sharder, test/distributed/_shard/test_sharder.py::TestCustomSharder::test_custom_sharder_errors 2024-12-18T01:48:32.5463356Z 2024-12-18T01:48:32.5466558Z Running distributed/_shard/sharded_optim/test_sharded_optim 1/1 ... [2024-12-18 01:48:32.546419] 2024-12-18T01:48:32.5467129Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:32.5471933Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_optim/test_sharded_optim.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:32.546901] 2024-12-18T01:48:36.5762929Z 2024-12-18T01:48:36.5764162Z distributed/_shard/sharded_optim/test_sharded_optim 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_optim.test_sharded_optim_1.1_a62f61eedef78f10_.log 2024-12-18T01:48:36.5766389Z Running 2 items in this shard: test/distributed/_shard/sharded_optim/test_sharded_optim.py::TestShardedOptimizer::test_named_params_with_sharded_tensor, test/distributed/_shard/sharded_optim/test_sharded_optim.py::TestShardedOptimizer::test_sharded_optim 2024-12-18T01:48:36.5767511Z 2024-12-18T01:48:36.5770708Z Running distributed/_shard/sharding_spec/test_sharding_spec 1/1 ... [2024-12-18 01:48:36.576767] 2024-12-18T01:48:36.5771293Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:36.5775269Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharding_spec/test_sharding_spec.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:36.577238] 2024-12-18T01:48:45.3666423Z 2024-12-18T01:48:45.3667992Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_19ad282708a4eddd_.log 2024-12-18T01:48:45.3674876Z Running 11 items in this shard: test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_check_overlapping, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_chunked_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_device_placement, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_enumerable_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunk_sharding_params, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunked_dim_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_split_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_infer_sharding_spec_from_shards_metadata, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_shard_tensor, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_tensor_ctor 2024-12-18T01:48:45.3680980Z 2024-12-18T01:48:45.3681242Z Running distributed/fsdp/test_fsdp_comm 1/1 ... [2024-12-18 01:48:45.367082] 2024-12-18T01:48:45.3681741Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:45.3682858Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_comm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:45.367559] 2024-12-18T01:48:49.7508930Z 2024-12-18T01:48:49.7510036Z distributed/fsdp/test_fsdp_comm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_comm_1.1_19dbc0761df1f4d7_.log 2024-12-18T01:48:49.7511002Z Running 0 items in this shard: 2024-12-18T01:48:49.7511255Z 2024-12-18T01:48:49.7515394Z Running distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 ... [2024-12-18 01:48:49.751342] 2024-12-18T01:48:49.7516073Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:49.7520993Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:49.751807] 2024-12-18T01:48:53.7838609Z 2024-12-18T01:48:53.7840330Z distributed/_shard/sharded_tensor/test_sharded_tensor_reshard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_reshard_1.1_d37a546e222a1a29_.log 2024-12-18T01:48:53.7843387Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py::TestReshard::test_sharded_tensor_reshard, test/distributed/_shard/sharded_tensor/test_sharded_tensor_reshard.py::TestReshard::test_sharded_tensor_reshard_errors 2024-12-18T01:48:53.7844721Z 2024-12-18T01:48:53.7845090Z Running distributed/test_launcher 1/1 ... [2024-12-18 01:48:53.784301] 2024-12-18T01:48:53.7845846Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:53.7850214Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_launcher.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:53.784768] 2024-12-18T01:48:59.3157583Z 2024-12-18T01:48:59.3158800Z distributed/test_launcher 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_launcher_1.1_8fa56dbaf6e54f13_.log 2024-12-18T01:48:59.3160235Z Running 1 items in this shard: test/distributed/test_launcher.py::TestDistributedLaunch::test_launch_user_script 2024-12-18T01:48:59.3160768Z 2024-12-18T01:48:59.3163968Z Running distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 ... [2024-12-18 01:48:59.316164] 2024-12-18T01:48:59.3164545Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:48:59.3169248Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/test_sharded_tensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:48:59.316643] 2024-12-18T01:49:12.4160641Z 2024-12-18T01:49:12.4162808Z distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_1.1_8610d5ceeed84593_.log 2024-12-18T01:49:12.4220703Z Running 69 items in this shard: test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorMetadata::test_serialize_and_deserialize, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorFromParams::test_empty, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardParameter::test_shard_parameter, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardParameter::test_shard_parameter_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor_with_empty_shard, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestModuleHookApi::test_collect_local_shard, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestModuleHookApi::test_reshard_output, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestLocalTensor::test_local_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestLocalTensor::test_local_tensor_error, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_cleanup, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_complete_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_like, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_full, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_ones, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_rand, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_zeros, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_gather_even, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_gather_uneven, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_insufficient_sharding_dims, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_invalid_pg_rpc_ranks, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_invalid_sharding, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_load_state_dict_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_multiple_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_partial_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharded_tensor_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharded_tensor_sizes, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharding_columns, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict_no_sharded_tensors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_create_sharded_tensor_with_ones, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_gather_even, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_gather_uneven, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_grid_sharding, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_multiple_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_partial_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_device, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_cpu, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_cuda, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_test, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_uneven_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_with_rpc_names, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalTensor::test_init_from_local_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalTensor::test_init_from_local_tensor_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_and_global_metadata_invalid_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_pin_memory, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_property_cross_ranks, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_shards_gaps, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_shards_overlap, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_st_base_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op_override, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardMetadata::test_create_shard_with_no_placement, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardMetadata::test_shard_metadata_init, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorSubGroupInit::test_sub_process_group_placement_validation, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorSubGroupInit::test_sub_process_group_sharded_tensor_init, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorNoProcessGroupMode::test_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorNoProcessGroupMode::test_non_contiguous_local_shards 2024-12-18T01:49:12.4264519Z 2024-12-18T01:49:12.4264902Z Running distributed/fsdp/test_distributed_checkpoint 1/1 ... [2024-12-18 01:49:12.417024] 2024-12-18T01:49:12.4265461Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:49:12.4266641Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_distributed_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:49:12.417632] 2024-12-18T01:49:16.7992857Z 2024-12-18T01:49:16.7993986Z distributed/fsdp/test_distributed_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_distributed_checkpoint_1.1_5362bcf1e17b3d6b_.log 2024-12-18T01:49:16.7995039Z Running 0 items in this shard: 2024-12-18T01:49:16.7995237Z 2024-12-18T01:49:16.7999210Z Running distributed/fsdp/test_fsdp_use_orig_params 1/1 ... [2024-12-18 01:49:16.799745] 2024-12-18T01:49:16.7999757Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:49:16.8005268Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_use_orig_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:49:16.800284] 2024-12-18T01:51:02.1286025Z 2024-12-18T01:51:02.1287798Z distributed/fsdp/test_fsdp_use_orig_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_99acfbe448c026d6_.log 2024-12-18T01:51:02.1307469Z Running 25 items in this shard: test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_trainability, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_fsdp_compile, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_multiple_optimizers, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsParamAccess::test_access_params_after_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_grad_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_no_reshard_and_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_param_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_between_fwd_and_bwd_for_no_reshard_raises, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_shape_mismatch, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsFQNs::test_named_parameters_in_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_correctness, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsInit::test_non_uniform_requires_grad, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cpu, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cuda 2024-12-18T01:51:02.1323374Z 2024-12-18T01:51:02.1323640Z Running distributed/test_c10d_gloo 1/1 ... [2024-12-18 01:51:02.129511] 2024-12-18T01:51:02.1324171Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T01:51:02.1325418Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:51:02.130231] 2024-12-18T02:07:40.1113447Z 2024-12-18T02:07:40.1115237Z distributed/test_c10d_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_gloo_1.1_d7281526e989f668_.log 2024-12-18T02:07:40.1202922Z Running 121 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init, test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_inference_mode, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket, test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-12-18T02:07:40.1261912Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init 2024-12-18T02:07:40.1262811Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo 2024-12-18T02:07:40.1263701Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics 2024-12-18T02:07:40.1264651Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda 2024-12-18T02:07:40.1265545Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks 2024-12-18T02:07:40.1266451Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async 2024-12-18T02:07:40.1267404Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks 2024-12-18T02:07:40.1268335Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_inference_mode 2024-12-18T02:07:40.1269318Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced 2024-12-18T02:07:40.1270571Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input 2024-12-18T02:07:40.1271613Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress 2024-12-18T02:07:40.1272514Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda 2024-12-18T02:07:40.1273418Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics 2024-12-18T02:07:40.1274317Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda 2024-12-18T02:07:40.1275200Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks 2024-12-18T02:07:40.1276250Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async 2024-12-18T02:07:40.1277221Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics 2024-12-18T02:07:40.1278327Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks 2024-12-18T02:07:40.1279627Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda 2024-12-18T02:07:40.1280615Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress 2024-12-18T02:07:40.1281526Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress 2024-12-18T02:07:40.1282405Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda 2024-12-18T02:07:40.1283326Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait 2024-12-18T02:07:40.1284222Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics 2024-12-18T02:07:40.1285111Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda 2024-12-18T02:07:40.1286004Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks 2024-12-18T02:07:40.1286872Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress 2024-12-18T02:07:40.1287767Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda 2024-12-18T02:07:40.1288638Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors 2024-12-18T02:07:40.1289498Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics 2024-12-18T02:07:40.1290370Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda 2024-12-18T02:07:40.1291244Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks 2024-12-18T02:07:40.1292147Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input 2024-12-18T02:07:40.1293049Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress 2024-12-18T02:07:40.1293915Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda 2024-12-18T02:07:40.1294813Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor 2024-12-18T02:07:40.1295708Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics 2024-12-18T02:07:40.1296574Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda 2024-12-18T02:07:40.1297552Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks 2024-12-18T02:07:40.1298439Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor 2024-12-18T02:07:40.1299399Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced 2024-12-18T02:07:40.1300333Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress 2024-12-18T02:07:40.1301190Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda 2024-12-18T02:07:40.1302144Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics 2024-12-18T02:07:40.1303026Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda 2024-12-18T02:07:40.1303905Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks 2024-12-18T02:07:40.1304763Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress 2024-12-18T02:07:40.1305638Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda 2024-12-18T02:07:40.1306524Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all 2024-12-18T02:07:40.1307415Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout 2024-12-18T02:07:40.1308324Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics 2024-12-18T02:07:40.1309282Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda 2024-12-18T02:07:40.1310237Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks 2024-12-18T02:07:40.1311215Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched 2024-12-18T02:07:40.1312305Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output 2024-12-18T02:07:40.1313303Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param 2024-12-18T02:07:40.1314394Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module 2024-12-18T02:07:40.1315540Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing 2024-12-18T02:07:40.1316754Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False 2024-12-18T02:07:40.1317937Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True 2024-12-18T02:07:40.1319155Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False 2024-12-18T02:07:40.1320443Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True 2024-12-18T02:07:40.1321676Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False 2024-12-18T02:07:40.1322870Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True 2024-12-18T02:07:40.1324102Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing 2024-12-18T02:07:40.1325302Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False 2024-12-18T02:07:40.1326552Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True 2024-12-18T02:07:40.1327800Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False 2024-12-18T02:07:40.1329045Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True 2024-12-18T02:07:40.1330291Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu 2024-12-18T02:07:40.1331410Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo 2024-12-18T02:07:40.1332526Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once 2024-12-18T02:07:40.1333614Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients 2024-12-18T02:07:40.1334680Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init 2024-12-18T02:07:40.1335746Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type 2024-12-18T02:07:40.1336928Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty 2024-12-18T02:07:40.1338085Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad 2024-12-18T02:07:40.1339242Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view 2024-12-18T02:07:40.1340463Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph 2024-12-18T02:07:40.1341894Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list 2024-12-18T02:07:40.1343137Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list 2024-12-18T02:07:40.1344275Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module 2024-12-18T02:07:40.1345297Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module 2024-12-18T02:07:40.1346301Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module 2024-12-18T02:07:40.1347349Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view 2024-12-18T02:07:40.1348376Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output 2024-12-18T02:07:40.1349400Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters 2024-12-18T02:07:40.1350466Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor 2024-12-18T02:07:40.1351530Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state 2024-12-18T02:07:40.1352657Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint 2024-12-18T02:07:40.1353613Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients 2024-12-18T02:07:40.1354602Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view 2024-12-18T02:07:40.1355659Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input 2024-12-18T02:07:40.1356722Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input 2024-12-18T02:07:40.1357752Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward 2024-12-18T02:07:40.1358590Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer 2024-12-18T02:07:40.1359503Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters 2024-12-18T02:07:40.1360398Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket 2024-12-18T02:07:40.1361253Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket 2024-12-18T02:07:40.1362099Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket 2024-12-18T02:07:40.1362904Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors 2024-12-18T02:07:40.1363709Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu 2024-12-18T02:07:40.1364577Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda 2024-12-18T02:07:40.1365420Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership 2024-12-18T02:07:40.1366236Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group 2024-12-18T02:07:40.1367095Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default 2024-12-18T02:07:40.1368028Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup 2024-12-18T02:07:40.1368944Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo 2024-12-18T02:07:40.1369838Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group 2024-12-18T02:07:40.1370680Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex 2024-12-18T02:07:40.1371497Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch 2024-12-18T02:07:40.1372489Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single 2024-12-18T02:07:40.1373661Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced 2024-12-18T02:07:40.1374845Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced 2024-12-18T02:07:40.1375998Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives 2024-12-18T02:07:40.1377235Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends 2024-12-18T02:07:40.1378659Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend 2024-12-18T02:07:40.1379919Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier 2024-12-18T02:07:40.1380938Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync 2024-12-18T02:07:40.1381836Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg 2024-12-18T02:07:40.1382767Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-12-18T02:07:40.1383369Z 2024-12-18T02:07:40.1383637Z Running distributed/elastic/timer/api_test 1/1 ... [2024-12-18 02:07:40.116064] 2024-12-18T02:07:40.1384136Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T02:07:40.1385278Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/timer/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:07:40.116681] 2024-12-18T02:07:41.6793461Z 2024-12-18T02:07:41.6794907Z distributed/elastic/timer/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.api_test_1.1_3f8b1548cf465f84_.log 2024-12-18T02:07:41.6795796Z 2024-12-18T02:07:42.5056901Z Running test batch 'tests to run' cost 6513.81 seconds 2024-12-18T02:07:43.3068609Z 2024-12-18T02:07:43.3069243Z real 108m39.931s 2024-12-18T02:07:43.3069659Z user 227m33.446s 2024-12-18T02:07:43.3069902Z sys 39m7.122s 2024-12-18T02:07:43.3070175Z + assert_git_not_dirty 2024-12-18T02:07:43.3070482Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]] 2024-12-18T02:07:43.3070825Z + [[ linux-jammy-py3.9-gcc11 != *xla* ]] 2024-12-18T02:07:43.3075551Z ++ git status --porcelain 2024-12-18T02:07:43.3076167Z ++ grep -v '?? third_party' 2024-12-18T02:08:11.4762286Z ++ true 2024-12-18T02:08:11.4762696Z + git_status= 2024-12-18T02:08:11.4762953Z + [[ -n '' ]] 2024-12-18T02:08:11.4763239Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]] 2024-12-18T02:08:11.4763680Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]] 2024-12-18T02:08:11.4764031Z + [[ 1 == 1 ]] 2024-12-18T02:08:11.4764364Z + test_rpc 2024-12-18T02:08:11.4764629Z + echo 'Testing RPC C++ tests' 2024-12-18T02:08:11.4764971Z Testing RPC C++ tests 2024-12-18T02:08:11.4767123Z + ln -sf /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libtorch.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libtorch_cpu.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libtorch_global_deps.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libtorch_python.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libtorchbind_test.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2024-12-18T02:08:11.4800276Z + ln -sf /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib/libc10.so /opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2024-12-18T02:08:11.4810119Z + CPP_TESTS_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin 2024-12-18T02:08:11.4810695Z + python test/run_test.py --cpp --verbose -i cpp/test_cpp_rpc 2024-12-18T02:08:11.5836528Z /var/lib/jenkins/workspace/test/run_test.py:22: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-12-18T02:08:11.5837420Z import pkg_resources 2024-12-18T02:08:15.7285089Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json?versionId=PhiMB7EP3187qvpKvnORewoK3InOIvX5 to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-12-18T02:08:15.7436896Z Found test times from artifacts 2024-12-18T02:08:15.8043347Z Found test times from artifacts 2024-12-18T02:08:15.8070520Z Running all tests 2024-12-18T02:08:15.8073852Z Running parallel tests on 3 processes 2024-12-18T02:08:15.8074288Z Name: tests to run (est. time: 0.0min) 2024-12-18T02:08:15.8074919Z Serial tests (1): 2024-12-18T02:08:15.8075204Z cpp/test_cpp_rpc 1/1 2024-12-18T02:08:15.8075549Z Parallel tests (0): 2024-12-18T02:08:15.8075828Z Name: excluded (est. time: 0.0min) 2024-12-18T02:08:15.8076155Z Serial tests (0): 2024-12-18T02:08:15.8076431Z Parallel tests (0): 2024-12-18T02:08:15.8364542Z Running cpp/test_cpp_rpc 1/1 ... [2024-12-18 02:08:15.835970] 2024-12-18T02:08:15.8365346Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set 2024-12-18T02:08:15.8379989Z Executing ['pytest', '/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin/test_cpp_rpc', '-v', '-vv', '-rfEX', '-n', '3', '--junit-xml-reruns', 'test-reports/python-pytest/test.run_test/test.run_test-a0eb0735e3a5e280.xml', '-x', '--reruns=2'] ... [2024-12-18 02:08:15.837483] 2024-12-18T02:08:21.1800967Z 2024-12-18T02:08:21.1801966Z cpp/test_cpp_rpc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/cpp.test_cpp_rpc_1.1_799e5525c71c1f75_.log 2024-12-18T02:08:21.1802792Z 2024-12-18T02:08:22.0211641Z Running test batch 'tests to run' cost 6.21 seconds 2024-12-18T02:08:22.8313900Z + cleanup_workspace 2024-12-18T02:08:22.8314529Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-12-18T02:08:22.8315338Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-12-18T02:08:22.8315985Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-12-18T02:08:22.8316473Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-12-18T02:08:22.8317019Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-12-18T02:08:22.8317662Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-12-18T02:08:22.8318155Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-12-18T02:08:23.3252616Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@release/2.6 2024-12-18T02:08:23.3253166Z with: 2024-12-18T02:08:23.3253433Z benchmark-results-dir: test/test-reports 2024-12-18T02:08:23.3253776Z dry-run: false 2024-12-18T02:08:23.3254019Z schema-version: v3 2024-12-18T02:08:23.3254536Z github-token: *** 2024-12-18T02:08:23.3254824Z env: 2024-12-18T02:08:23.3255056Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:23.3255539Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:23.3256041Z ##[endgroup] 2024-12-18T02:08:23.3284293Z ##[group]Run set -eux 2024-12-18T02:08:23.3284594Z set -eux 2024-12-18T02:08:23.3284881Z python3 -mpip install boto3==1.35.33 2024-12-18T02:08:23.3294241Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:23.3294754Z env: 2024-12-18T02:08:23.3294991Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:23.3295527Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:23.3296034Z ##[endgroup] 2024-12-18T02:08:23.3325249Z + python3 -mpip install boto3==1.35.33 2024-12-18T02:08:23.5830244Z Defaulting to user installation because normal site-packages is not writeable 2024-12-18T02:08:23.6004474Z Requirement already satisfied: boto3==1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.33) 2024-12-18T02:08:23.6059582Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.83) 2024-12-18T02:08:23.6063434Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4) 2024-12-18T02:08:23.6067506Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2024-12-18T02:08:23.6126138Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2024-12-18T02:08:23.6132731Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1) 2024-12-18T02:08:23.6172657Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2024-12-18T02:08:23.7587787Z ##[group]Run set -eux 2024-12-18T02:08:23.7588090Z set -eux 2024-12-18T02:08:23.7588320Z  2024-12-18T02:08:23.7588583Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2024-12-18T02:08:23.7588958Z  echo "Missing github-token input" 2024-12-18T02:08:23.7589305Z  exit 1 2024-12-18T02:08:23.7589547Z fi 2024-12-18T02:08:23.7596165Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:23.7596555Z env: 2024-12-18T02:08:23.7596803Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:23.7597314Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:23.7598226Z GITHUB_TOKEN: *** 2024-12-18T02:08:23.7598571Z ##[endgroup] 2024-12-18T02:08:23.7628299Z + [[ -z *** ]] 2024-12-18T02:08:23.7720847Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2024-12-18T02:08:23.7721310Z with: 2024-12-18T02:08:23.7721692Z github-token: *** 2024-12-18T02:08:23.7721941Z env: 2024-12-18T02:08:23.7722170Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:23.7722652Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:23.7723155Z ##[endgroup] 2024-12-18T02:08:23.7751152Z ##[group]Run set -eux 2024-12-18T02:08:23.7751550Z set -eux 2024-12-18T02:08:23.7751802Z  2024-12-18T02:08:23.7752292Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-12-18T02:08:23.7758419Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:23.7758822Z env: 2024-12-18T02:08:23.7759060Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:23.7759548Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:23.7760329Z GITHUB_TOKEN: *** 2024-12-18T02:08:23.7760658Z ##[endgroup] 2024-12-18T02:08:23.7785957Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 12383255652 i-0feeb5a43c4657cc6 2024-12-18T02:08:26.8664468Z setting job-id=34566861155 2024-12-18T02:08:26.8665027Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T02:08:26.8785069Z ##[group]Run set -eux 2024-12-18T02:08:26.8785512Z set -eux 2024-12-18T02:08:26.8785853Z  2024-12-18T02:08:26.8786470Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2024-12-18T02:08:26.8787307Z  --schema-version "${SCHEMA_VERSION}" \ 2024-12-18T02:08:26.8787839Z  --repo "${REPO}" \ 2024-12-18T02:08:26.8788316Z  --head-branch "${HEAD_BRANCH}" \ 2024-12-18T02:08:26.8788860Z  --head-sha "${HEAD_SHA}" \ 2024-12-18T02:08:26.8789425Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2024-12-18T02:08:26.8790046Z  --run-attempt "${RUN_ATTEMPT}" \ 2024-12-18T02:08:26.8790616Z  --job-id "${JOB_ID}" \ 2024-12-18T02:08:26.8791151Z  --job-name "${JOB_NAME}" 2024-12-18T02:08:26.8800449Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:26.8801140Z env: 2024-12-18T02:08:26.8801496Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:26.8802270Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:26.8803168Z SCHEMA_VERSION: v3 2024-12-18T02:08:26.8803639Z REPO: pytorch/pytorch 2024-12-18T02:08:26.8804110Z HEAD_BRANCH: refs/heads/release/2.6 2024-12-18T02:08:26.8804698Z HEAD_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 2024-12-18T02:08:26.8805293Z WORKFLOW_RUN_ID: 12383255652 2024-12-18T02:08:26.8805761Z RUN_ATTEMPT: 1 2024-12-18T02:08:26.8806148Z JOB_ID: 34566861155 2024-12-18T02:08:26.8806802Z JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) 2024-12-18T02:08:26.8807517Z ##[endgroup] 2024-12-18T02:08:26.8841804Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/release/2.6 --head-sha 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 --workflow-id 12383255652 --run-attempt 1 --job-id 34566861155 --job-name 'linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge)' 2024-12-18T02:08:26.9184605Z ##[group]Run set -eux 2024-12-18T02:08:26.9185053Z set -eux 2024-12-18T02:08:26.9185285Z  2024-12-18T02:08:26.9185555Z # TODO (huydhn): Implement this part 2024-12-18T02:08:26.9185962Z echo "runners=[]" >> "${GITHUB_OUTPUT}" 2024-12-18T02:08:26.9191979Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:26.9192389Z env: 2024-12-18T02:08:26.9192627Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:26.9193113Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:26.9193630Z ##[endgroup] 2024-12-18T02:08:26.9216743Z + echo 'runners=[]' 2024-12-18T02:08:26.9254763Z ##[group]Run set -eux 2024-12-18T02:08:26.9255213Z set -eux 2024-12-18T02:08:26.9255583Z  2024-12-18T02:08:26.9255984Z # TODO (huydhn): Implement this part 2024-12-18T02:08:26.9256602Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2024-12-18T02:08:26.9264685Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:26.9265353Z env: 2024-12-18T02:08:26.9265729Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:26.9266732Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:26.9267611Z ##[endgroup] 2024-12-18T02:08:26.9295776Z + echo 'dependencies={}' 2024-12-18T02:08:26.9324606Z ##[group]Run set -eux 2024-12-18T02:08:26.9324908Z set -eux 2024-12-18T02:08:26.9325157Z  2024-12-18T02:08:26.9325439Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2024-12-18T02:08:26.9325900Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2024-12-18T02:08:26.9326404Z  # We don't want the job to fail if the directory doesn't exist 2024-12-18T02:08:26.9326814Z  exit 0 2024-12-18T02:08:26.9327055Z fi 2024-12-18T02:08:26.9327278Z  2024-12-18T02:08:26.9327525Z if [[ "${DRY_RUN}" == "true" ]]; then 2024-12-18T02:08:26.9328014Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T02:08:26.9328602Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T02:08:26.9329058Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T02:08:26.9329427Z  --runners "${RUNNER_INFO}" \ 2024-12-18T02:08:26.9329793Z  --dependencies "${DEPENDENCIES}" \ 2024-12-18T02:08:26.9330172Z  --dry-run 2024-12-18T02:08:26.9330421Z else 2024-12-18T02:08:26.9330813Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2024-12-18T02:08:26.9331391Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2024-12-18T02:08:26.9331838Z  --metadata "${BENCHMARK_METADATA}" \ 2024-12-18T02:08:26.9332213Z  --runners "${RUNNER_INFO}" \ 2024-12-18T02:08:26.9332565Z  --dependencies "${DEPENDENCIES}" 2024-12-18T02:08:26.9332900Z fi 2024-12-18T02:08:26.9338411Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:26.9338821Z env: 2024-12-18T02:08:26.9339059Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:26.9339545Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:26.9340077Z BENCHMARK_RESULTS_DIR: test/test-reports 2024-12-18T02:08:26.9340409Z DRY_RUN: false 2024-12-18T02:08:26.9342085Z BENCHMARK_METADATA: {"timestamp": 1734487706, "schema_version": "v3", "name": "linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566861155} 2024-12-18T02:08:26.9343505Z RUNNER_INFO: [] 2024-12-18T02:08:26.9343762Z DEPENDENCIES: {} 2024-12-18T02:08:26.9344019Z ##[endgroup] 2024-12-18T02:08:26.9366679Z + [[ ! -d test/test-reports ]] 2024-12-18T02:08:26.9367228Z + [[ false == \t\r\u\e ]] 2024-12-18T02:08:26.9369840Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1734487706, "schema_version": "v3", "name": "linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566861155}' --runners '[]' --dependencies '{}' 2024-12-18T02:08:27.2033076Z ##[group]Run cat test/**/*_toprint.log || true 2024-12-18T02:08:27.2033503Z cat test/**/*_toprint.log || true 2024-12-18T02:08:27.2039267Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.2039672Z env: 2024-12-18T02:08:27.2039904Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.2040388Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.2040920Z ##[endgroup] 2024-12-18T02:08:27.2108544Z cat: 'test/**/*_toprint.log': No such file or directory 2024-12-18T02:08:27.2146181Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-12-18T02:08:27.2146559Z kill "$MONITOR_SCRIPT_PID" 2024-12-18T02:08:27.2152271Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.2152673Z env: 2024-12-18T02:08:27.2152904Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.2153379Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.2153905Z MONITOR_SCRIPT_PID: 185984 2024-12-18T02:08:27.2154179Z ##[endgroup] 2024-12-18T02:08:27.2337839Z Prepare all required actions 2024-12-18T02:08:27.2338580Z Getting action download info 2024-12-18T02:08:27.3912508Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b) 2024-12-18T02:08:27.7028798Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-12-18T02:08:27.7029184Z with: 2024-12-18T02:08:27.7029537Z file-suffix: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T02:08:27.7029955Z s3-bucket: gha-artifacts 2024-12-18T02:08:27.7030231Z env: 2024-12-18T02:08:27.7030461Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.7030938Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.7031584Z ##[endgroup] 2024-12-18T02:08:27.7063471Z ##[group]Run # Remove any previous test jsons if they exist 2024-12-18T02:08:27.7063965Z # Remove any previous test jsons if they exist 2024-12-18T02:08:27.7064360Z rm -f test-jsons-*.zip 2024-12-18T02:08:27.7064859Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2024-12-18T02:08:27.7070716Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.7071101Z env: 2024-12-18T02:08:27.7071334Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.7071967Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.7072594Z FILE_SUFFIX: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T02:08:27.7073004Z ##[endgroup] 2024-12-18T02:08:27.7221111Z adding: test/test-reports/td_exclusions-230f42f8412d726ea6bc.json (deflated 86%) 2024-12-18T02:08:27.7221832Z adding: test/test-reports/td_exclusions-18d4276b5d7d1806ed71.json (deflated 18%) 2024-12-18T02:08:27.7249179Z ##[group]Run # Remove any previous test reports if they exist 2024-12-18T02:08:27.7249697Z # Remove any previous test reports if they exist 2024-12-18T02:08:27.7250108Z rm -f test-reports-*.zip 2024-12-18T02:08:27.7250616Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2024-12-18T02:08:27.7256420Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.7256824Z env: 2024-12-18T02:08:27.7257055Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.7257534Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.7258310Z FILE_SUFFIX: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T02:08:27.7258701Z ##[endgroup] 2024-12-18T02:08:27.7351711Z adding: test/test-reports/python-pytest/distributed.test_dynamo_distributed/distributed.test_dynamo_distributed-88012dfb2c3d7468.xml (deflated 93%) 2024-12-18T02:08:27.7353193Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_binary_cmp/distributed._shard.sharded_tensor.ops.test_binary_cmp-be0d77f48dd59a3e.xml (deflated 81%) 2024-12-18T02:08:27.7354668Z adding: test/test-reports/python-pytest/distributed._tensor.test_common_rules/distributed._tensor.test_common_rules-bee0a211db4d84ce.xml (deflated 79%) 2024-12-18T02:08:27.7366578Z adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor_ops/distributed._tensor.test_dtensor_ops-e507c650c896ab35.xml (deflated 96%) 2024-12-18T02:08:27.7367813Z adding: test/test-reports/python-pytest/distributed._tensor.test_init/distributed._tensor.test_init-3a3360824849efb8.xml (deflated 75%) 2024-12-18T02:08:27.7369116Z adding: test/test-reports/python-pytest/distributed._tensor.test_experimental_ops/distributed._tensor.test_experimental_ops-7e1b0f28a261a382.xml (deflated 60%) 2024-12-18T02:08:27.7370432Z adding: test/test-reports/python-pytest/distributed._tensor.test_tensor_ops/distributed._tensor.test_tensor_ops-e8ec649950d623f1.xml (deflated 85%) 2024-12-18T02:08:27.7371660Z adding: test/test-reports/python-pytest/distributed._tensor.test_math_ops/distributed._tensor.test_math_ops-61acf3e19f39607d.xml (deflated 81%) 2024-12-18T02:08:27.7373240Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_init/distributed._shard.sharded_tensor.ops.test_init-b5b4af2c1de443a6.xml (deflated 76%) 2024-12-18T02:08:27.7374615Z adding: test/test-reports/python-pytest/distributed._tensor.test_matrix_ops/distributed._tensor.test_matrix_ops-d0816c8976fb12b3.xml (deflated 80%) 2024-12-18T02:08:27.7375953Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ca7cc2ec784e736c.xml (deflated 41%) 2024-12-18T02:08:27.7377379Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8b13806251e434a9.xml (deflated 41%) 2024-12-18T02:08:27.7378784Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1a9bf4aa79d47caa.xml (deflated 41%) 2024-12-18T02:08:27.7380180Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3ffe44389b85a0c8.xml (deflated 41%) 2024-12-18T02:08:27.7381578Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d15bf74ab629cf05.xml (deflated 41%) 2024-12-18T02:08:27.7382979Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-90e76af480121326.xml (deflated 41%) 2024-12-18T02:08:27.7384378Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-83ad6d8ca4391966.xml (deflated 41%) 2024-12-18T02:08:27.7385768Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-db3ad08ae0ca4c2b.xml (deflated 41%) 2024-12-18T02:08:27.7387168Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-99fa80a86857db6e.xml (deflated 43%) 2024-12-18T02:08:27.7388567Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-20bfe361585a6843.xml (deflated 42%) 2024-12-18T02:08:27.7389968Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bc8d7d3c8e0a834d.xml (deflated 41%) 2024-12-18T02:08:27.7391575Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-5cfdb4097d2720f7.xml (deflated 42%) 2024-12-18T02:08:27.7392970Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b88be8615b956381.xml (deflated 42%) 2024-12-18T02:08:27.7394357Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b2da2021801ccea5.xml (deflated 42%) 2024-12-18T02:08:27.7395758Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-487ad1ab2bf31f95.xml (deflated 42%) 2024-12-18T02:08:27.7397146Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7329d9c9095e13a9.xml (deflated 42%) 2024-12-18T02:08:27.7398526Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-fb466e9a64483f8f.xml (deflated 42%) 2024-12-18T02:08:27.7399920Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-78f5759bbc63ea35.xml (deflated 42%) 2024-12-18T02:08:27.7401346Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-091b53efe3990c3d.xml (deflated 42%) 2024-12-18T02:08:27.7402849Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3d00ce2c8e1b7dc3.xml (deflated 42%) 2024-12-18T02:08:27.7404261Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b00eadac561e6730.xml (deflated 42%) 2024-12-18T02:08:27.7405664Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-66bac428bcf84ecf.xml (deflated 42%) 2024-12-18T02:08:27.7407079Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-04669bb57fc8bbe4.xml (deflated 42%) 2024-12-18T02:08:27.7408478Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-84b58ea12b549d00.xml (deflated 42%) 2024-12-18T02:08:27.7409881Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9ad5e41491c63ea8.xml (deflated 42%) 2024-12-18T02:08:27.7411289Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7c06ee4d9f45a316.xml (deflated 42%) 2024-12-18T02:08:27.7412689Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-34ad4e75651c8bdd.xml (deflated 42%) 2024-12-18T02:08:27.7414083Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-33b1c9072863d2cd.xml (deflated 42%) 2024-12-18T02:08:27.7415474Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-41f9966e6d5242fa.xml (deflated 42%) 2024-12-18T02:08:27.7416868Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b645d493dec91c91.xml (deflated 36%) 2024-12-18T02:08:27.7418267Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-da4f040e40b9fa31.xml (deflated 41%) 2024-12-18T02:08:27.7419665Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-eed34c1b697e0cc6.xml (deflated 42%) 2024-12-18T02:08:27.7421071Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-4b4c33e2b1d0f2d3.xml (deflated 42%) 2024-12-18T02:08:27.7422551Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-cd1bfed552d8eeba.xml (deflated 42%) 2024-12-18T02:08:27.7423960Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ca434dcc6b4737b2.xml (deflated 41%) 2024-12-18T02:08:27.7425358Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b854283fc2d94593.xml (deflated 41%) 2024-12-18T02:08:27.7426742Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e0ee7fb470d55e23.xml (deflated 41%) 2024-12-18T02:08:27.7428157Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b61a3afd9c54e09f.xml (deflated 41%) 2024-12-18T02:08:27.7429568Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3770ab95483de468.xml (deflated 41%) 2024-12-18T02:08:27.7430963Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ab050fedb9f7ff31.xml (deflated 41%) 2024-12-18T02:08:27.7432513Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-aa8d987b2b90893f.xml (deflated 42%) 2024-12-18T02:08:27.7433913Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6a04ba2d0feeb782.xml (deflated 41%) 2024-12-18T02:08:27.7435318Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f838afe298554bff.xml (deflated 41%) 2024-12-18T02:08:27.7436723Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-400d114e862c79ca.xml (deflated 41%) 2024-12-18T02:08:27.7438120Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-edb85cf92ae3d79d.xml (deflated 41%) 2024-12-18T02:08:27.7439529Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8dd1ef0b72e3a429.xml (deflated 42%) 2024-12-18T02:08:27.7440919Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6b3de0f1e8882b4b.xml (deflated 42%) 2024-12-18T02:08:27.7443251Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-53020586c199491c.xml (deflated 41%) 2024-12-18T02:08:27.7444652Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c3b44d5c2bb69a13.xml (deflated 41%) 2024-12-18T02:08:27.7446051Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8dceb4e6c9025f14.xml (deflated 42%) 2024-12-18T02:08:27.7447450Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9d67dda6933e1c11.xml (deflated 42%) 2024-12-18T02:08:27.7448858Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d06e52bc0603fc37.xml (deflated 42%) 2024-12-18T02:08:27.7450256Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-98a1a99c23da33ef.xml (deflated 42%) 2024-12-18T02:08:27.7451657Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-01698ca1a546d123.xml (deflated 42%) 2024-12-18T02:08:27.7453230Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2d9debde3ea74ba8.xml (deflated 42%) 2024-12-18T02:08:27.7454619Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a45f9f2017c3eb03.xml (deflated 42%) 2024-12-18T02:08:27.7456016Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-da43110e269bf69b.xml (deflated 42%) 2024-12-18T02:08:27.7457410Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3536c39dde323685.xml (deflated 42%) 2024-12-18T02:08:27.7458803Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f458794fa2cc65d7.xml (deflated 42%) 2024-12-18T02:08:27.7460201Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e42d05aaa114c757.xml (deflated 42%) 2024-12-18T02:08:27.7461604Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-58d7f2b56d4a0d4f.xml (deflated 42%) 2024-12-18T02:08:27.7463010Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-dfa058b827b44765.xml (deflated 41%) 2024-12-18T02:08:27.7464514Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0bdb7830971d5851.xml (deflated 42%) 2024-12-18T02:08:27.7465918Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-73e8571cc909407c.xml (deflated 42%) 2024-12-18T02:08:27.7467303Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-517692a3ec7557f4.xml (deflated 42%) 2024-12-18T02:08:27.7468696Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8342e3fa26f4c834.xml (deflated 42%) 2024-12-18T02:08:27.7470096Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-caba950daaf3afc7.xml (deflated 42%) 2024-12-18T02:08:27.7471583Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d1e9c4955adbce80.xml (deflated 42%) 2024-12-18T02:08:27.7472980Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7a479806723a080e.xml (deflated 41%) 2024-12-18T02:08:27.7474385Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8b0d0faa74a3bbb1.xml (deflated 42%) 2024-12-18T02:08:27.7475787Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-72540e3f017e3624.xml (deflated 42%) 2024-12-18T02:08:27.7477179Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bb99eb36ca1e4ce5.xml (deflated 41%) 2024-12-18T02:08:27.7478576Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e94205e33b8e73d7.xml (deflated 41%) 2024-12-18T02:08:27.7479971Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a94790851392765d.xml (deflated 42%) 2024-12-18T02:08:27.7481354Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-693b03b1703b6882.xml (deflated 42%) 2024-12-18T02:08:27.7482863Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7cbf1f0a80aa9c5f.xml (deflated 42%) 2024-12-18T02:08:27.7484355Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b1de89d74f5b9908.xml (deflated 42%) 2024-12-18T02:08:27.7485759Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-cfc144ece2af0126.xml (deflated 41%) 2024-12-18T02:08:27.7487161Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-90b4d407e5d872a2.xml (deflated 41%) 2024-12-18T02:08:27.7488551Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0215d9eacb620ab6.xml (deflated 41%) 2024-12-18T02:08:27.7489961Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b4ef3cd45f37961e.xml (deflated 41%) 2024-12-18T02:08:27.7491350Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a27496c35ac401a9.xml (deflated 41%) 2024-12-18T02:08:27.7492741Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-985da0f8488fc3e3.xml (deflated 41%) 2024-12-18T02:08:27.7494211Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1c62fabd73dd7db5.xml (deflated 41%) 2024-12-18T02:08:27.7495628Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0ef038d5976fd689.xml (deflated 41%) 2024-12-18T02:08:27.7497037Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9ce99ab176d9bb44.xml (deflated 41%) 2024-12-18T02:08:27.7498454Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c45b58b05e1207f8.xml (deflated 41%) 2024-12-18T02:08:27.7499856Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3c5f94caab0acc8c.xml (deflated 41%) 2024-12-18T02:08:27.7501242Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2ff21124780bc01c.xml (deflated 41%) 2024-12-18T02:08:27.7502648Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-507dc990704809aa.xml (deflated 41%) 2024-12-18T02:08:27.7504041Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9a507ba9a02baa83.xml (deflated 41%) 2024-12-18T02:08:27.7505446Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-d0078a917bdc85c0.xml (deflated 41%) 2024-12-18T02:08:27.7506845Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7303dd9ecdaaa318.xml (deflated 41%) 2024-12-18T02:08:27.7508253Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-adbef0cc9e29eaf4.xml (deflated 41%) 2024-12-18T02:08:27.7509656Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ea2316d88886b94a.xml (deflated 42%) 2024-12-18T02:08:27.7511059Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-08e9b3fe7a6a164c.xml (deflated 42%) 2024-12-18T02:08:27.7512597Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9f38f9ef0570cae0.xml (deflated 42%) 2024-12-18T02:08:27.7513975Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-1857c42b1c08f133.xml (deflated 43%) 2024-12-18T02:08:27.7515370Z adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ed97a2d9057980af.xml (deflated 42%) 2024-12-18T02:08:27.7516784Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_save_load_api/distributed.checkpoint.test_save_load_api-62e601971752552f.xml (deflated 43%) 2024-12-18T02:08:27.7518184Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dedup_tensors/distributed.checkpoint.test_dedup_tensors-51eccb9f6ac36b04.xml (deflated 37%) 2024-12-18T02:08:27.7519559Z adding: test/test-reports/python-pytest/distributed._composable.test_contract/distributed._composable.test_contract-fab5822880d5e295.xml (deflated 69%) 2024-12-18T02:08:27.7520912Z adding: test/test-reports/python-pytest/distributed.pipelining.test_microbatch/distributed.pipelining.test_microbatch-ca6afc66b31b6dd0.xml (deflated 53%) 2024-12-18T02:08:27.7522296Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fsdp_ep/distributed.checkpoint.e2e.test_fsdp_ep-2bd521dc37a893d7.xml (deflated 33%) 2024-12-18T02:08:27.7523898Z adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_register_sharding/distributed._tensor.experimental.test_register_sharding-020ad60d2acf0d40.xml (deflated 52%) 2024-12-18T02:08:27.7525362Z adding: test/test-reports/python-pytest/distributed._tools.test_mem_tracker/distributed._tools.test_mem_tracker-0c05a52705a404f7.xml (deflated 65%) 2024-12-18T02:08:27.7526572Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fx/distributed.fsdp.test_fsdp_fx-dd82ef283ff09bce.xml (deflated 28%) 2024-12-18T02:08:27.7527814Z adding: test/test-reports/python-pytest/distributed._tensor.test_attention/distributed._tensor.test_attention-ef8a4e8bbfa7e659.xml (deflated 74%) 2024-12-18T02:08:27.7529033Z adding: test/test-reports/python-pytest/distributed._tensor.test_api/distributed._tensor.test_api-8d01c26f6cf26304.xml (deflated 77%) 2024-12-18T02:08:27.7530292Z adding: test/test-reports/python-pytest/distributed._composable.test_checkpoint/distributed._composable.test_checkpoint-0e24ff5cc8566203.xml (deflated 70%) 2024-12-18T02:08:27.7531724Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_resharding/distributed.checkpoint.test_dtensor_resharding-7e7ef184cee42d44.xml (deflated 80%) 2024-12-18T02:08:27.7533145Z adding: test/test-reports/python-pytest/distributed._tensor.test_redistribute/distributed._tensor.test_redistribute-a3be59db7471b666.xml (deflated 82%) 2024-12-18T02:08:27.7534469Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsspec/distributed.checkpoint.test_fsspec-7afdfef7d9420bbc.xml (deflated 65%) 2024-12-18T02:08:27.7535844Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_style/distributed.tensor.parallel.test_tp_style-a5d9a59125ef4ea1.xml (deflated 80%) 2024-12-18T02:08:27.7537225Z adding: test/test-reports/python-pytest/distributed._tools.test_fsdp2_mem_tracker/distributed._tools.test_fsdp2_mem_tracker-6d2660ab4546092d.xml (deflated 59%) 2024-12-18T02:08:27.7538669Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_e2e_save_and_load/distributed.checkpoint.e2e.test_e2e_save_and_load-3999e5dea3fdd9a4.xml (deflated 89%) 2024-12-18T02:08:27.7540093Z adding: test/test-reports/python-pytest/distributed.elastic.test_control_plane/distributed.elastic.test_control_plane-42d5fa90bcb32728.xml (deflated 75%) 2024-12-18T02:08:27.7541690Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_examples/distributed.tensor.parallel.test_tp_examples-e3cca39c8819f5fb.xml (deflated 89%) 2024-12-18T02:08:27.7543416Z adding: test/test-reports/python-pytest/distributed.test_nccl/distributed.test_nccl-ccf6b2062cc39478.xml (deflated 28%) 2024-12-18T02:08:27.7544620Z adding: test/test-reports/python-pytest/distributed.test_c10d_logger/distributed.test_c10d_logger-1227dd101c0bd0f6.xml (deflated 51%) 2024-12-18T02:08:27.7546001Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_state_dict/distributed.fsdp.test_fsdp_state_dict-c48530f0688d1ee1.xml (deflated 97%) 2024-12-18T02:08:27.7547435Z adding: test/test-reports/python-pytest/distributed._tensor.test_optimizers/distributed._tensor.test_optimizers-43ce3dff81aa6583.xml (deflated 81%) 2024-12-18T02:08:27.7548849Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_overlap/distributed.fsdp.test_fsdp_overlap-cd6baed1b1ae5aad.xml (deflated 44%) 2024-12-18T02:08:27.7550313Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_optim_state/distributed.fsdp.test_fsdp_optim_state-b59031a3f8f9f0db.xml (deflated 96%) 2024-12-18T02:08:27.7551895Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_freezing_weights/distributed.fsdp.test_fsdp_freezing_weights-a10eaa8f3e96285b.xml (deflated 96%) 2024-12-18T02:08:27.7553601Z adding: test/test-reports/python-pytest/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks-c8ba7b5e8a1d72b1.xml (deflated 85%) 2024-12-18T02:08:27.7555341Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_exec_order/distributed.fsdp.test_fsdp_exec_order-6839291a5dfbc9a8.xml (deflated 28%) 2024-12-18T02:08:27.7556774Z adding: test/test-reports/python-pytest/distributed.test_multi_threaded_pg/distributed.test_multi_threaded_pg-e557f4719d021c4e.xml (deflated 80%) 2024-12-18T02:08:27.7558158Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_uneven/distributed.fsdp.test_fsdp_uneven-d1dfbd67a764c20c.xml (deflated 28%) 2024-12-18T02:08:27.7559543Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_input/distributed.fsdp.test_fsdp_input-8cd330366a526dd3.xml (deflated 28%) 2024-12-18T02:08:27.7560931Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_grad_acc/distributed.fsdp.test_fsdp_grad_acc-b736a53633c9d975.xml (deflated 84%) 2024-12-18T02:08:27.7562380Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_ignored_modules/distributed.fsdp.test_fsdp_ignored_modules-929e4944b6e32065.xml (deflated 79%) 2024-12-18T02:08:27.7564016Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_memory/distributed._composable.fsdp.test_fully_shard_memory-b0cb5205e51eb1f8.xml (deflated 55%) 2024-12-18T02:08:27.7565648Z adding: test/test-reports/python-pytest/distributed.fsdp.test_checkpoint_wrapper/distributed.fsdp.test_checkpoint_wrapper-97ee2a872f8dc8a2.xml (deflated 74%) 2024-12-18T02:08:27.7567050Z adding: test/test-reports/python-pytest/distributed.fsdp.test_utils/distributed.fsdp.test_utils-66244db6da1d42d2.xml (deflated 28%) 2024-12-18T02:08:27.7568483Z adding: test/test-reports/python-pytest/distributed.fsdp.test_hsdp_dtensor_state_dict/distributed.fsdp.test_hsdp_dtensor_state_dict-88606974934d408b.xml (deflated 28%) 2024-12-18T02:08:27.7570052Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_tp_integration/distributed.fsdp.test_fsdp_tp_integration-37c63d8a12168397.xml (deflated 72%) 2024-12-18T02:08:27.7571528Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_checkpoint/distributed.fsdp.test_fsdp_checkpoint-325069e15aa4c592.xml (deflated 93%) 2024-12-18T02:08:27.7572964Z adding: test/test-reports/python-pytest/distributed.algorithms.test_join/distributed.algorithms.test_join-72f7c34aef33ad42.xml (deflated 79%) 2024-12-18T02:08:27.7574452Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_hybrid_shard/distributed.fsdp.test_fsdp_hybrid_shard-9a055e5fbddb08c6.xml (deflated 81%) 2024-12-18T02:08:27.7576195Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_training/distributed._composable.fsdp.test_fully_shard_training-13313030a31a9699.xml (deflated 85%) 2024-12-18T02:08:27.7577981Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_file_system_checkpoint_cpu/distributed.checkpoint.test_file_system_checkpoint_cpu-74c3c77700be0b35.xml (deflated 78%) 2024-12-18T02:08:27.7579587Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-774106acf818efa6.xml (deflated 36%) 2024-12-18T02:08:27.7580988Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-6f2d47ee7c315e5e.xml (deflated 36%) 2024-12-18T02:08:27.7582298Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-9f82acadc9cff080.xml (deflated 36%) 2024-12-18T02:08:27.7583521Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-695582e2d6e693e7.xml (deflated 36%) 2024-12-18T02:08:27.7584740Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-f1e0eaead370d803.xml (deflated 35%) 2024-12-18T02:08:27.7585968Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-4c5e9cb8ee2d1c45.xml (deflated 36%) 2024-12-18T02:08:27.7587216Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-06d1bd331de6c80c.xml (deflated 36%) 2024-12-18T02:08:27.7589339Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-aa89f73a2a343a61.xml (deflated 36%) 2024-12-18T02:08:27.7591056Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-3a2fd58cdecfdd05.xml (deflated 36%) 2024-12-18T02:08:27.7592366Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-5f106f776f1ec354.xml (deflated 36%) 2024-12-18T02:08:27.7593617Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-fcdec2d0092396d2.xml (deflated 36%) 2024-12-18T02:08:27.7594850Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-4690bb3fe6d22b4b.xml (deflated 36%) 2024-12-18T02:08:27.7596069Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-b43e29299716ecb2.xml (deflated 36%) 2024-12-18T02:08:27.7597294Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-92fa848b91d2b1e2.xml (deflated 37%) 2024-12-18T02:08:27.7598524Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-47d3b52a361b885a.xml (deflated 36%) 2024-12-18T02:08:27.7599758Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-3382e1b1aee1b29f.xml (deflated 36%) 2024-12-18T02:08:27.7600988Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-8f7ace784510f9c7.xml (deflated 36%) 2024-12-18T02:08:27.7602217Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-ee5dc9578617e31c.xml (deflated 37%) 2024-12-18T02:08:27.7603457Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-a87a3ff61dd87c1e.xml (deflated 36%) 2024-12-18T02:08:27.7604692Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-2e75a1afca06b8b5.xml (deflated 35%) 2024-12-18T02:08:27.7605911Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-c5e57b8352e64da9.xml (deflated 36%) 2024-12-18T02:08:27.7607236Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-588dede4ea69866a.xml (deflated 35%) 2024-12-18T02:08:27.7608466Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-52eecb289f239dd5.xml (deflated 35%) 2024-12-18T02:08:27.7609698Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-5678c41a24b5ce10.xml (deflated 35%) 2024-12-18T02:08:27.7610934Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-c71a76f5e9a375ca.xml (deflated 36%) 2024-12-18T02:08:27.7612168Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-8edad713784818db.xml (deflated 35%) 2024-12-18T02:08:27.7613394Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-58ff30e3ef403a6d.xml (deflated 35%) 2024-12-18T02:08:27.7614631Z adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-35aee9b5f83ac1c7.xml (deflated 35%) 2024-12-18T02:08:27.7615898Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52ea48d6fb153af2.xml (deflated 35%) 2024-12-18T02:08:27.7617195Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-716569dabeecb32f.xml (deflated 36%) 2024-12-18T02:08:27.7618594Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4888e7899bb378f3.xml (deflated 36%) 2024-12-18T02:08:27.7619905Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14d91ca88f7b187b.xml (deflated 35%) 2024-12-18T02:08:27.7621218Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c45631c454f89a76.xml (deflated 36%) 2024-12-18T02:08:27.7622539Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a7fd86779c3a9dc1.xml (deflated 35%) 2024-12-18T02:08:27.7623852Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b09875e337102012.xml (deflated 36%) 2024-12-18T02:08:27.7625177Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14d9dcad760fc852.xml (deflated 35%) 2024-12-18T02:08:27.7626494Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6a635869685558a.xml (deflated 35%) 2024-12-18T02:08:27.7627797Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e5b698d7db6845ff.xml (deflated 35%) 2024-12-18T02:08:27.7629112Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-531f91646d501308.xml (deflated 35%) 2024-12-18T02:08:27.7630417Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d5969aff983f28b7.xml (deflated 35%) 2024-12-18T02:08:27.7631798Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-51bedb101a636935.xml (deflated 35%) 2024-12-18T02:08:27.7633116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f86814389d053cb2.xml (deflated 36%) 2024-12-18T02:08:27.7634432Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6880490e1a41246f.xml (deflated 35%) 2024-12-18T02:08:27.7635746Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-694e1099d931aea2.xml (deflated 35%) 2024-12-18T02:08:27.7637154Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-faf7b6ec13640deb.xml (deflated 35%) 2024-12-18T02:08:27.7638472Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3eb70b3b0529ea02.xml (deflated 35%) 2024-12-18T02:08:27.7639785Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-80daeaf03c6f86d2.xml (deflated 35%) 2024-12-18T02:08:27.7641443Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ae034ff762b82986.xml (deflated 35%) 2024-12-18T02:08:27.7642772Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-597ee043a1ed79c8.xml (deflated 35%) 2024-12-18T02:08:27.7644089Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b6237f361fd91c0.xml (deflated 36%) 2024-12-18T02:08:27.7645408Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1da87d3c7415fdab.xml (deflated 36%) 2024-12-18T02:08:27.7646729Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-02fb412255ec0574.xml (deflated 36%) 2024-12-18T02:08:27.7648202Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52072ec1edaa3c40.xml (deflated 35%) 2024-12-18T02:08:27.7649522Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a5734117113cd25.xml (deflated 36%) 2024-12-18T02:08:27.7650834Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef0b969e55d58c3f.xml (deflated 35%) 2024-12-18T02:08:27.7652141Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0ed4850115540efe.xml (deflated 35%) 2024-12-18T02:08:27.7653455Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-be882b5a9a1a3f24.xml (deflated 37%) 2024-12-18T02:08:27.7654779Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f6bfc2d8f67066f1.xml (deflated 35%) 2024-12-18T02:08:27.7656107Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5af3840e8d72ed61.xml (deflated 36%) 2024-12-18T02:08:27.7657425Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-13babfb9f7b507d0.xml (deflated 35%) 2024-12-18T02:08:27.7658739Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-29e1e1af1c63683d.xml (deflated 35%) 2024-12-18T02:08:27.7660054Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34969e6328c752cb.xml (deflated 35%) 2024-12-18T02:08:27.7661368Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b1e4199a91f8074.xml (deflated 35%) 2024-12-18T02:08:27.7662667Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b75dc9362ed2fe1.xml (deflated 35%) 2024-12-18T02:08:27.7663977Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6daa3ec9d450116a.xml (deflated 36%) 2024-12-18T02:08:27.7665295Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b707f353dc8b861f.xml (deflated 35%) 2024-12-18T02:08:27.7666714Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e4be0cb56c5c68d.xml (deflated 35%) 2024-12-18T02:08:27.7668029Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-07446a31ebb7a847.xml (deflated 35%) 2024-12-18T02:08:27.7669343Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-55c86b66fee1ee67.xml (deflated 36%) 2024-12-18T02:08:27.7670665Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bf8ad39ed2c9bb3a.xml (deflated 36%) 2024-12-18T02:08:27.7672076Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-08ec052c72c6a89e.xml (deflated 36%) 2024-12-18T02:08:27.7673391Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8f3ec2360d251846.xml (deflated 36%) 2024-12-18T02:08:27.7674690Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2e868d1b3986bfdd.xml (deflated 36%) 2024-12-18T02:08:27.7676009Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3eaeca7611923d05.xml (deflated 35%) 2024-12-18T02:08:27.7677327Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7b3aea9a7b59486.xml (deflated 35%) 2024-12-18T02:08:27.7678738Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bddaa6d2434dd8ee.xml (deflated 36%) 2024-12-18T02:08:27.7680058Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-afe99a75279dab39.xml (deflated 35%) 2024-12-18T02:08:27.7681378Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1c559bc0e055710a.xml (deflated 36%) 2024-12-18T02:08:27.7682691Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d958df572fbbe97.xml (deflated 35%) 2024-12-18T02:08:27.7684006Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ee26d0d35cef4bc7.xml (deflated 36%) 2024-12-18T02:08:27.7685332Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7f391b810da81a00.xml (deflated 35%) 2024-12-18T02:08:27.7686638Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b6cd2ce9d3a408a8.xml (deflated 35%) 2024-12-18T02:08:27.7687959Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0b8274e30307db31.xml (deflated 35%) 2024-12-18T02:08:27.7689271Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-994f0fdb6ee8e242.xml (deflated 35%) 2024-12-18T02:08:27.7690590Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0b63e04e8b2f46f9.xml (deflated 35%) 2024-12-18T02:08:27.7691902Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3a89a596a29fd525.xml (deflated 37%) 2024-12-18T02:08:27.7693217Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40f8f08dd83f8b93.xml (deflated 35%) 2024-12-18T02:08:27.7694535Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2cbf31c8240afa4f.xml (deflated 35%) 2024-12-18T02:08:27.7695843Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a12b2083613d95f.xml (deflated 36%) 2024-12-18T02:08:27.7697229Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cde973751683ad4c.xml (deflated 35%) 2024-12-18T02:08:27.7698530Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-961cc92c5b3ef2f3.xml (deflated 35%) 2024-12-18T02:08:27.7699855Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5e64768a9bc1ffc1.xml (deflated 35%) 2024-12-18T02:08:27.7701186Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d9a4df00dbcf258.xml (deflated 35%) 2024-12-18T02:08:27.7702499Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-65f9291ab1749942.xml (deflated 36%) 2024-12-18T02:08:27.7703816Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34b0123deb7a1c35.xml (deflated 35%) 2024-12-18T02:08:27.7705126Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-812ce69aa2a341bc.xml (deflated 35%) 2024-12-18T02:08:27.7706445Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7ff301eb3d7c4b1b.xml (deflated 34%) 2024-12-18T02:08:27.7707858Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9270c8b202e9e181.xml (deflated 35%) 2024-12-18T02:08:27.7709157Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f9a31cdd0e9120ba.xml (deflated 34%) 2024-12-18T02:08:27.7710478Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b848eda1bb8bc707.xml (deflated 35%) 2024-12-18T02:08:27.7711862Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-185ef4e40483c76b.xml (deflated 34%) 2024-12-18T02:08:27.7713168Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a8624958530f26c5.xml (deflated 36%) 2024-12-18T02:08:27.7714482Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b3e768e65cbc012.xml (deflated 34%) 2024-12-18T02:08:27.7715807Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a43130afa6a30f3d.xml (deflated 34%) 2024-12-18T02:08:27.7717130Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-045a211634b313ff.xml (deflated 35%) 2024-12-18T02:08:27.7718437Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3cb6e02f21214488.xml (deflated 35%) 2024-12-18T02:08:27.7719752Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8dc91bc80a9947b9.xml (deflated 36%) 2024-12-18T02:08:27.7721053Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-319872ef3a8ffdb6.xml (deflated 34%) 2024-12-18T02:08:27.7722368Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bd76758e7b8d3562.xml (deflated 35%) 2024-12-18T02:08:27.7723679Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-edbb3457ef1615e6.xml (deflated 36%) 2024-12-18T02:08:27.7724991Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dcdd1217985bbea5.xml (deflated 34%) 2024-12-18T02:08:27.7726385Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e71e4570be769efb.xml (deflated 35%) 2024-12-18T02:08:27.7727693Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-451dee49ec305b73.xml (deflated 34%) 2024-12-18T02:08:27.7729003Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-63edc5f591fe64fa.xml (deflated 34%) 2024-12-18T02:08:27.7730316Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef35a5fef1467d62.xml (deflated 35%) 2024-12-18T02:08:27.7731635Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-90e0e79fcd9113b1.xml (deflated 35%) 2024-12-18T02:08:27.7732930Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2981fec82eff2c6e.xml (deflated 34%) 2024-12-18T02:08:27.7734241Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1a5c3d596c5868dd.xml (deflated 35%) 2024-12-18T02:08:27.7735555Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3ceec207c2b6dbf.xml (deflated 34%) 2024-12-18T02:08:27.7736935Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-36d88330cf175c4a.xml (deflated 35%) 2024-12-18T02:08:27.7738254Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4c877afd9b42c5df.xml (deflated 35%) 2024-12-18T02:08:27.7739577Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ededd36e5878f6eb.xml (deflated 34%) 2024-12-18T02:08:27.7740892Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-200e65c7a4ef5260.xml (deflated 35%) 2024-12-18T02:08:27.7742432Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8dc592517330b5c7.xml (deflated 35%) 2024-12-18T02:08:27.7743728Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-142f9490aea08a6f.xml (deflated 34%) 2024-12-18T02:08:27.7745044Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6fa1e2129b5e994.xml (deflated 34%) 2024-12-18T02:08:27.7746352Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f33792a76a3af1db.xml (deflated 35%) 2024-12-18T02:08:27.7747663Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5033704ee2b4c010.xml (deflated 35%) 2024-12-18T02:08:27.7748987Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-823b06e04e8d7067.xml (deflated 36%) 2024-12-18T02:08:27.7750318Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-723c9a8d51eaa185.xml (deflated 35%) 2024-12-18T02:08:27.7751810Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-295f12e89fa2a4d2.xml (deflated 55%) 2024-12-18T02:08:27.7753131Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-89a4d88c637b5d15.xml (deflated 55%) 2024-12-18T02:08:27.7754440Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eabd259ee18a05c5.xml (deflated 34%) 2024-12-18T02:08:27.7755900Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8ed62958c1e99490.xml (deflated 37%) 2024-12-18T02:08:27.7757207Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-84e0e78647f5cd22.xml (deflated 37%) 2024-12-18T02:08:27.7758518Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-734fd8af6036338a.xml (deflated 37%) 2024-12-18T02:08:27.7759835Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-942b0a5308a03bde.xml (deflated 36%) 2024-12-18T02:08:27.7761155Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-33b039f73b4642b1.xml (deflated 37%) 2024-12-18T02:08:27.7762466Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-31881cb50e228790.xml (deflated 37%) 2024-12-18T02:08:27.7763780Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d797ecd36d28267e.xml (deflated 37%) 2024-12-18T02:08:27.7765101Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c291d5bf49eeeab4.xml (deflated 37%) 2024-12-18T02:08:27.7766434Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eec2bb38b0b57301.xml (deflated 37%) 2024-12-18T02:08:27.7767855Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6bcc7aedf056cd93.xml (deflated 36%) 2024-12-18T02:08:27.7769165Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e997b9745060ac61.xml (deflated 36%) 2024-12-18T02:08:27.7770476Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dc809d15ab688e92.xml (deflated 37%) 2024-12-18T02:08:27.7771798Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cb8dbc1cabf6b8fe.xml (deflated 36%) 2024-12-18T02:08:27.7773125Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fc50d9c46067a4d2.xml (deflated 37%) 2024-12-18T02:08:27.7774441Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d4e7ede5b6ca94da.xml (deflated 36%) 2024-12-18T02:08:27.7775747Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1985b56191865b59.xml (deflated 37%) 2024-12-18T02:08:27.7777054Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d7bbd113ce4893b4.xml (deflated 36%) 2024-12-18T02:08:27.7778363Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d000f0b5045a4f11.xml (deflated 35%) 2024-12-18T02:08:27.7779658Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-48de3ca6f86797d4.xml (deflated 36%) 2024-12-18T02:08:27.7780967Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8e7ab004bdd6cc7e.xml (deflated 36%) 2024-12-18T02:08:27.7782280Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7324b581bfd0fec0.xml (deflated 36%) 2024-12-18T02:08:27.7783585Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c479d4126d508443.xml (deflated 35%) 2024-12-18T02:08:27.7784886Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dd72183c44d391bc.xml (deflated 35%) 2024-12-18T02:08:27.7786271Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-15884964d9e23ed4.xml (deflated 36%) 2024-12-18T02:08:27.7787578Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f52db0c26f666277.xml (deflated 35%) 2024-12-18T02:08:27.7788889Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-415e38a65c549ca9.xml (deflated 35%) 2024-12-18T02:08:27.7790185Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-66fd71aaa983c89b.xml (deflated 35%) 2024-12-18T02:08:27.7791572Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2605459354660c02.xml (deflated 36%) 2024-12-18T02:08:27.7792882Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-44cfbb8527d8cafc.xml (deflated 35%) 2024-12-18T02:08:27.7794198Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-07375db86246f47d.xml (deflated 35%) 2024-12-18T02:08:27.7795520Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2f8c676a5fb3e1cb.xml (deflated 35%) 2024-12-18T02:08:27.7796907Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-41833eb13ed19cff.xml (deflated 35%) 2024-12-18T02:08:27.7798209Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c8b7c10d8c1e6129.xml (deflated 35%) 2024-12-18T02:08:27.7799512Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9bae1ebcae72a74a.xml (deflated 35%) 2024-12-18T02:08:27.7800825Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a12e66f3025afe92.xml (deflated 36%) 2024-12-18T02:08:27.7802116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-169e43a84a4fac80.xml (deflated 35%) 2024-12-18T02:08:27.7803423Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cce603b984e95847.xml (deflated 35%) 2024-12-18T02:08:27.7804738Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cb148a4c383bcedd.xml (deflated 35%) 2024-12-18T02:08:27.7806050Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ff0c08beb9cbb832.xml (deflated 36%) 2024-12-18T02:08:27.7807369Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-39280c1ff39a4cb3.xml (deflated 36%) 2024-12-18T02:08:27.7808685Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-48ab37d060232dab.xml (deflated 35%) 2024-12-18T02:08:27.7809998Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4daa7ea4c9594d27.xml (deflated 36%) 2024-12-18T02:08:27.7811320Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2dbfa41aec83b8ea.xml (deflated 35%) 2024-12-18T02:08:27.7812631Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-986d7f105b08f20a.xml (deflated 35%) 2024-12-18T02:08:27.7813928Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2cd6ac6e34cc35ed.xml (deflated 35%) 2024-12-18T02:08:27.7815323Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bc2bf7454171c5cb.xml (deflated 35%) 2024-12-18T02:08:27.7816640Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a5d732ba0182070.xml (deflated 35%) 2024-12-18T02:08:27.7817951Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6888bc18f136ee4.xml (deflated 35%) 2024-12-18T02:08:27.7819274Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-db4f10f305ae26d1.xml (deflated 35%) 2024-12-18T02:08:27.7820584Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1af6a9be111c8992.xml (deflated 35%) 2024-12-18T02:08:27.7821896Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-620938589652898b.xml (deflated 35%) 2024-12-18T02:08:27.7823209Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-212596c9ab26bd45.xml (deflated 35%) 2024-12-18T02:08:27.7824504Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-380c46ec69018928.xml (deflated 35%) 2024-12-18T02:08:27.7825812Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7d97edf289eaf47f.xml (deflated 35%) 2024-12-18T02:08:27.7827183Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-95b6e09b21481651.xml (deflated 35%) 2024-12-18T02:08:27.7828494Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-781e2210f2342f29.xml (deflated 36%) 2024-12-18T02:08:27.7829803Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-993a60a1589f0719.xml (deflated 35%) 2024-12-18T02:08:27.7831112Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-850372f74785307e.xml (deflated 37%) 2024-12-18T02:08:27.7832483Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b2c896e6187b5d52.xml (deflated 36%) 2024-12-18T02:08:27.7833792Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-64bf50551913e661.xml (deflated 35%) 2024-12-18T02:08:27.7835097Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-89245f69300091cc.xml (deflated 36%) 2024-12-18T02:08:27.7836384Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-752165772696b3d5.xml (deflated 35%) 2024-12-18T02:08:27.7837685Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-310752f8ea3a586e.xml (deflated 37%) 2024-12-18T02:08:27.7838991Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8e6f6d2e5f0c43bd.xml (deflated 36%) 2024-12-18T02:08:27.7840300Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-88b0c26e43c3d3d3.xml (deflated 36%) 2024-12-18T02:08:27.7841816Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f124c49f232d382.xml (deflated 35%) 2024-12-18T02:08:27.7843127Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-76619b8a256a1477.xml (deflated 36%) 2024-12-18T02:08:27.7844429Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d9e4750f57427780.xml (deflated 35%) 2024-12-18T02:08:27.7845883Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d78fa5d738e81d18.xml (deflated 36%) 2024-12-18T02:08:27.7847195Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-876b3fdb2ca5f72f.xml (deflated 35%) 2024-12-18T02:08:27.7848497Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d264daf9e478dc5.xml (deflated 35%) 2024-12-18T02:08:27.7849810Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8f32d6bd54d3e71e.xml (deflated 35%) 2024-12-18T02:08:27.7851116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e8a02d52f08f505e.xml (deflated 37%) 2024-12-18T02:08:27.7852426Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d8a55cf91e41a4cd.xml (deflated 36%) 2024-12-18T02:08:27.7870493Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2330103d6c8d0c79.xml (deflated 34%) 2024-12-18T02:08:27.7871903Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-937263f5e0346629.xml (deflated 34%) 2024-12-18T02:08:27.7873508Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab2b82dfec231df4.xml (deflated 34%) 2024-12-18T02:08:27.7874821Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-aa2e53ffdf1f9a87.xml (deflated 35%) 2024-12-18T02:08:27.7876128Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b683f273ca9dc39.xml (deflated 36%) 2024-12-18T02:08:27.7877444Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a626f1b1f8c01883.xml (deflated 34%) 2024-12-18T02:08:27.7878748Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f70d6d9c725a9889.xml (deflated 35%) 2024-12-18T02:08:27.7880055Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0af1371dc3db71f7.xml (deflated 34%) 2024-12-18T02:08:27.7881344Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68d5b07832411f07.xml (deflated 34%) 2024-12-18T02:08:27.7882647Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a9616a8446509f7f.xml (deflated 35%) 2024-12-18T02:08:27.7883956Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c96fa3084d607d22.xml (deflated 35%) 2024-12-18T02:08:27.7885266Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3a3e265acf9561d6.xml (deflated 35%) 2024-12-18T02:08:27.7886567Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-70c0394de79f512a.xml (deflated 35%) 2024-12-18T02:08:27.7887880Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bcc453a759f2f058.xml (deflated 35%) 2024-12-18T02:08:27.7889193Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d91365ade9613da.xml (deflated 35%) 2024-12-18T02:08:27.7890500Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a763b06d6d4b57fd.xml (deflated 36%) 2024-12-18T02:08:27.7891877Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68162953493856cf.xml (deflated 34%) 2024-12-18T02:08:27.7893187Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e20cb0ac93c632b.xml (deflated 35%) 2024-12-18T02:08:27.7894495Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-77bc38751089bd3e.xml (deflated 34%) 2024-12-18T02:08:27.7895813Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a51bae2ac05a47a.xml (deflated 35%) 2024-12-18T02:08:27.7897124Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5c81b0df3fb03dd7.xml (deflated 35%) 2024-12-18T02:08:27.7898437Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-20c9480d2f4c6d4f.xml (deflated 35%) 2024-12-18T02:08:27.7899747Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a1dd3fbf88c03155.xml (deflated 35%) 2024-12-18T02:08:27.7901057Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9c328886e422af15.xml (deflated 34%) 2024-12-18T02:08:27.7902425Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a7bcfbd517081418.xml (deflated 34%) 2024-12-18T02:08:27.7903731Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1bab61e59e0eb08a.xml (deflated 35%) 2024-12-18T02:08:27.7905038Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5589c632cc9ef96c.xml (deflated 36%) 2024-12-18T02:08:27.7906344Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-56b71193881ad3bb.xml (deflated 37%) 2024-12-18T02:08:27.7907657Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6e7ada6ca7224b49.xml (deflated 35%) 2024-12-18T02:08:27.7908968Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14a8715ea646aad7.xml (deflated 55%) 2024-12-18T02:08:27.7910286Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f2beff5e6bc562f3.xml (deflated 36%) 2024-12-18T02:08:27.7911662Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9435f4d5454c212b.xml (deflated 35%) 2024-12-18T02:08:27.7912978Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a81eaddeb9896fc.xml (deflated 36%) 2024-12-18T02:08:27.7914295Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9d4d064ef41d4f76.xml (deflated 41%) 2024-12-18T02:08:27.7915585Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3e3dd5b380982008.xml (deflated 36%) 2024-12-18T02:08:27.7916902Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5e761fb9c56a1994.xml (deflated 37%) 2024-12-18T02:08:27.7918209Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2a37b617fc98d022.xml (deflated 37%) 2024-12-18T02:08:27.7919521Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eac0047ab694283a.xml (deflated 37%) 2024-12-18T02:08:27.7920911Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dfd114f48d7348fa.xml (deflated 37%) 2024-12-18T02:08:27.7922218Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3ad86728dae11786.xml (deflated 37%) 2024-12-18T02:08:27.7923520Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b68e63d95706394.xml (deflated 36%) 2024-12-18T02:08:27.7924827Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-08fb45086c990452.xml (deflated 38%) 2024-12-18T02:08:27.7926126Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cbb9f4eaf1e4353f.xml (deflated 36%) 2024-12-18T02:08:27.7927438Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2457f35fcf500d47.xml (deflated 36%) 2024-12-18T02:08:27.7928744Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-299c087153443b1d.xml (deflated 37%) 2024-12-18T02:08:27.7930049Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-08c29f3c28f5ddc9.xml (deflated 36%) 2024-12-18T02:08:27.7931355Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-acf537409e24b05d.xml (deflated 36%) 2024-12-18T02:08:27.7932725Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8edb83127a71233a.xml (deflated 36%) 2024-12-18T02:08:27.7934035Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-768e2f292ebdee00.xml (deflated 36%) 2024-12-18T02:08:27.7935346Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-de27896a5b2cbc36.xml (deflated 36%) 2024-12-18T02:08:27.7936661Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f3bb86cd156e901a.xml (deflated 36%) 2024-12-18T02:08:27.7937955Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-553934719e03eab6.xml (deflated 37%) 2024-12-18T02:08:27.7939266Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f5f4a31c7294762d.xml (deflated 37%) 2024-12-18T02:08:27.7940577Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8f7ce2379f21d9c0.xml (deflated 36%) 2024-12-18T02:08:27.7942139Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4498c9a31278e7c2.xml (deflated 36%) 2024-12-18T02:08:27.7943451Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fine_tune/distributed.fsdp.test_fsdp_fine_tune-f7f7eba187a7b8d2.xml (deflated 28%) 2024-12-18T02:08:27.7944702Z adding: test/test-reports/python-pytest/distributed._shard.test_sharder/distributed._shard.test_sharder-a180359bf25117d4.xml (deflated 66%) 2024-12-18T02:08:27.7946082Z adding: test/test-reports/python-pytest/distributed._shard.sharded_optim.test_sharded_optim/distributed._shard.sharded_optim.test_sharded_optim-cabeef54ca772101.xml (deflated 67%) 2024-12-18T02:08:27.7947626Z adding: test/test-reports/python-pytest/distributed._shard.sharding_spec.test_sharding_spec/distributed._shard.sharding_spec.test_sharding_spec-394e64d368a72c99.xml (deflated 83%) 2024-12-18T02:08:27.7948997Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_comm/distributed.fsdp.test_fsdp_comm-76a076c6022fb15f.xml (deflated 28%) 2024-12-18T02:08:27.7950440Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.test_sharded_tensor_reshard/distributed._shard.sharded_tensor.test_sharded_tensor_reshard-bff70f99f3aab7ef.xml (deflated 70%) 2024-12-18T02:08:27.7952063Z adding: test/test-reports/python-pytest/distributed.test_launcher/distributed.test_launcher-cea632911270da65.xml (deflated 40%) 2024-12-18T02:08:27.7953418Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.test_sharded_tensor/distributed._shard.sharded_tensor.test_sharded_tensor-1af8e1803ccefcd7.xml (deflated 95%) 2024-12-18T02:08:27.7954949Z adding: test/test-reports/python-pytest/distributed.fsdp.test_distributed_checkpoint/distributed.fsdp.test_distributed_checkpoint-db3eef8b53f3025b.xml (deflated 28%) 2024-12-18T02:08:27.7956367Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_use_orig_params/distributed.fsdp.test_fsdp_use_orig_params-1a31cbd0039f79cd.xml (deflated 90%) 2024-12-18T02:08:27.7957608Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cbb4e86d01e31df4.xml (deflated 34%) 2024-12-18T02:08:27.7958727Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7354a8b85defba2d.xml (deflated 38%) 2024-12-18T02:08:27.7959840Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fc53f12c70d84cf4.xml (deflated 35%) 2024-12-18T02:08:27.7960938Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1536b13879447cbb.xml (deflated 43%) 2024-12-18T02:08:27.7962135Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b1c06b61085eab54.xml (deflated 35%) 2024-12-18T02:08:27.7963248Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7a8bdd9ead1d9cb3.xml (deflated 35%) 2024-12-18T02:08:27.7964359Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-89b3dae4ecab70dc.xml (deflated 35%) 2024-12-18T02:08:27.7965470Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-304f7e4a300d8e87.xml (deflated 35%) 2024-12-18T02:08:27.7966576Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b90db749522bb56d.xml (deflated 35%) 2024-12-18T02:08:27.7967681Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6d9c0dba9eee3346.xml (deflated 35%) 2024-12-18T02:08:27.7968795Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-422271c3c86d92f5.xml (deflated 36%) 2024-12-18T02:08:27.7969883Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-333d31e4845f5840.xml (deflated 43%) 2024-12-18T02:08:27.7970992Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2a12e4e07c1e3d28.xml (deflated 35%) 2024-12-18T02:08:27.7972098Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8f156872d11a1c4f.xml (deflated 43%) 2024-12-18T02:08:27.7973205Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-45c2af1b42f121b0.xml (deflated 35%) 2024-12-18T02:08:27.7974307Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b80fdf790c9a863d.xml (deflated 35%) 2024-12-18T02:08:27.7975410Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-760fb784157ce5d2.xml (deflated 35%) 2024-12-18T02:08:27.7976516Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b72961f9797925f0.xml (deflated 35%) 2024-12-18T02:08:27.7977624Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8abcfd358f1848fa.xml (deflated 42%) 2024-12-18T02:08:27.7978725Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-47f2a3cd4f156a3c.xml (deflated 35%) 2024-12-18T02:08:27.7979905Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1ebb8357dd40b93f.xml (deflated 35%) 2024-12-18T02:08:27.7981013Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-aba82be8a56fe262.xml (deflated 43%) 2024-12-18T02:08:27.7982122Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-52a0d2e2ef7fa389.xml (deflated 35%) 2024-12-18T02:08:27.7983229Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-63ca994a4f23bb51.xml (deflated 36%) 2024-12-18T02:08:27.7984336Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1da4becf653024ee.xml (deflated 43%) 2024-12-18T02:08:27.7985446Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d338a2fb900fde6.xml (deflated 35%) 2024-12-18T02:08:27.7986548Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e6f7c13c3f61f7e5.xml (deflated 36%) 2024-12-18T02:08:27.7987658Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-eeb82793f90fd245.xml (deflated 43%) 2024-12-18T02:08:27.7988763Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b3d81ba534d6646e.xml (deflated 35%) 2024-12-18T02:08:27.7989934Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4fd6bc0d958a0abb.xml (deflated 35%) 2024-12-18T02:08:27.7991045Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-64b6302e4bcb94e6.xml (deflated 42%) 2024-12-18T02:08:27.7992236Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9aeec693d9cbf016.xml (deflated 35%) 2024-12-18T02:08:27.7993347Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5054e2c4657f2bb8.xml (deflated 35%) 2024-12-18T02:08:27.7994473Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7a97b99eef11420c.xml (deflated 36%) 2024-12-18T02:08:27.7995572Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a85712707b158bd6.xml (deflated 42%) 2024-12-18T02:08:27.7996676Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-07cf12d078bb34be.xml (deflated 35%) 2024-12-18T02:08:27.7997779Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b99d0981570655d7.xml (deflated 36%) 2024-12-18T02:08:27.7998886Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-de0a569ad04039d8.xml (deflated 42%) 2024-12-18T02:08:27.7999991Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-12be473a5e9ea7fc.xml (deflated 35%) 2024-12-18T02:08:27.8001105Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5951a31414fc799c.xml (deflated 35%) 2024-12-18T02:08:27.8002202Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-84f7c61065b15e71.xml (deflated 35%) 2024-12-18T02:08:27.8003305Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5e5870cfce6ac223.xml (deflated 36%) 2024-12-18T02:08:27.8004402Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-67268594112062ef.xml (deflated 43%) 2024-12-18T02:08:27.8005500Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-69b7e6191eec3ae2.xml (deflated 35%) 2024-12-18T02:08:27.8006603Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-584257d63b2baa39.xml (deflated 43%) 2024-12-18T02:08:27.8007790Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-26f87ce4122fce11.xml (deflated 35%) 2024-12-18T02:08:27.8008902Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2fcffc38d69f13b7.xml (deflated 36%) 2024-12-18T02:08:27.8010011Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3d82d12d4264d1e5.xml (deflated 47%) 2024-12-18T02:08:27.8011111Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-68c4a457bf901330.xml (deflated 36%) 2024-12-18T02:08:27.8012210Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f5b44f663e66542d.xml (deflated 36%) 2024-12-18T02:08:27.8013317Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-90716beae66b0b18.xml (deflated 36%) 2024-12-18T02:08:27.8014419Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-afc19b9ece9f5fe4.xml (deflated 42%) 2024-12-18T02:08:27.8015530Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b2ee81430113a4a4.xml (deflated 35%) 2024-12-18T02:08:27.8016634Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f0eb857a2d880df1.xml (deflated 43%) 2024-12-18T02:08:27.8017752Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c3df8c45b1e2a788.xml (deflated 43%) 2024-12-18T02:08:27.8018919Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-416f269feb0f6005.xml (deflated 42%) 2024-12-18T02:08:27.8020029Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c1af37d9c67ced92.xml (deflated 42%) 2024-12-18T02:08:27.8021128Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c03fa24a6c6e9140.xml (deflated 42%) 2024-12-18T02:08:27.8022240Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-16ed8a60b8a9943a.xml (deflated 42%) 2024-12-18T02:08:27.8023421Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-685c207ab9a3f221.xml (deflated 42%) 2024-12-18T02:08:27.8024544Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-de99e3f42e1f86c2.xml (deflated 42%) 2024-12-18T02:08:27.8025657Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8d588097234348e7.xml (deflated 42%) 2024-12-18T02:08:27.8026754Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cf49768843b422d8.xml (deflated 42%) 2024-12-18T02:08:27.8027858Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-46c9890c7a10e72e.xml (deflated 42%) 2024-12-18T02:08:27.8028971Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bc0337d33aadb484.xml (deflated 42%) 2024-12-18T02:08:27.8030058Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6818626a06972d27.xml (deflated 41%) 2024-12-18T02:08:27.8031161Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-25b0be6bd6db4f5d.xml (deflated 42%) 2024-12-18T02:08:27.8032347Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-01fb8d76f2a95eee.xml (deflated 42%) 2024-12-18T02:08:27.8033457Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0b00f4117a141d33.xml (deflated 42%) 2024-12-18T02:08:27.8034556Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d4d8f3389e979160.xml (deflated 36%) 2024-12-18T02:08:27.8035666Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d26f1a808125a49.xml (deflated 43%) 2024-12-18T02:08:27.8036840Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e60d66342569bfb8.xml (deflated 36%) 2024-12-18T02:08:27.8037931Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e7c8d718d50c7f18.xml (deflated 36%) 2024-12-18T02:08:27.8039056Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bcdc5cba40f98724.xml (deflated 36%) 2024-12-18T02:08:27.8040179Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f72ef45b0c0b3d53.xml (deflated 36%) 2024-12-18T02:08:27.8041764Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7767113e0067876f.xml (deflated 45%) 2024-12-18T02:08:27.8042882Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8470a8a491a8e43e.xml (deflated 44%) 2024-12-18T02:08:27.8043991Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-16820457edd07d45.xml (deflated 44%) 2024-12-18T02:08:27.8045093Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7393723401c4e144.xml (deflated 44%) 2024-12-18T02:08:27.8046203Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-15791cf755363713.xml (deflated 44%) 2024-12-18T02:08:27.8047468Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-54424ef69e650ea8.xml (deflated 44%) 2024-12-18T02:08:27.8048584Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e9829b259eded0f2.xml (deflated 44%) 2024-12-18T02:08:27.8049694Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d5385dc6d9022566.xml (deflated 43%) 2024-12-18T02:08:27.8050812Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-66a2e5f349fc0839.xml (deflated 36%) 2024-12-18T02:08:27.8051927Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e5befb01c7b64b96.xml (deflated 36%) 2024-12-18T02:08:27.8053039Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f7feb85a0b502c45.xml (deflated 36%) 2024-12-18T02:08:27.8054150Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fd05fc675bc41869.xml (deflated 36%) 2024-12-18T02:08:27.8055267Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2ceb71ce0f9ee704.xml (deflated 44%) 2024-12-18T02:08:27.8056365Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bbfc1820f3e90aa6.xml (deflated 35%) 2024-12-18T02:08:27.8057479Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-44c1d8f6a9e68ae2.xml (deflated 58%) 2024-12-18T02:08:27.8058591Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-deac4d906d713721.xml (deflated 36%) 2024-12-18T02:08:27.8059698Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7aae0031631455b5.xml (deflated 57%) 2024-12-18T02:08:27.8060795Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-300ce89743017840.xml (deflated 42%) 2024-12-18T02:08:27.8061895Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-799803471644647d.xml (deflated 42%) 2024-12-18T02:08:27.8062983Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-83804219b701796d.xml (deflated 36%) 2024-12-18T02:08:27.8064071Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5e702d9a0e989060.xml (deflated 36%) 2024-12-18T02:08:27.8065259Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e67ac8658107ed29.xml (deflated 36%) 2024-12-18T02:08:27.8066369Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f2288242cd0635d6.xml (deflated 36%) 2024-12-18T02:08:27.8067469Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3e23a2479b523270.xml (deflated 36%) 2024-12-18T02:08:27.8068578Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-41b3ed659c757710.xml (deflated 37%) 2024-12-18T02:08:27.8069681Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2bf3786a6cb791c1.xml (deflated 36%) 2024-12-18T02:08:27.8070786Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d0149cc0b8a23637.xml (deflated 37%) 2024-12-18T02:08:27.8071952Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-08bd5cbc883a3eb7.xml (deflated 44%) 2024-12-18T02:08:27.8073053Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-29998fd608ea47cc.xml (deflated 44%) 2024-12-18T02:08:27.8074159Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cf44ec6b9ab1cc23.xml (deflated 43%) 2024-12-18T02:08:27.8075279Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ff003adefd98ea78.xml (deflated 43%) 2024-12-18T02:08:27.8076453Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-023259f1dc597952.xml (deflated 43%) 2024-12-18T02:08:27.8077548Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-97423e6a989c1fe2.xml (deflated 43%) 2024-12-18T02:08:27.8078644Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e97813126899c871.xml (deflated 43%) 2024-12-18T02:08:27.8079748Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-96467f6409454db2.xml (deflated 58%) 2024-12-18T02:08:27.8080834Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-822f5b38bd811f34.xml (deflated 43%) 2024-12-18T02:08:27.8081937Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6fa6038a69bd0401.xml (deflated 34%) 2024-12-18T02:08:27.8083045Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cba91e7b8de5546c.xml (deflated 34%) 2024-12-18T02:08:27.8084152Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7b916874e2bca1e0.xml (deflated 34%) 2024-12-18T02:08:27.8085259Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fb4cbbfed5a38783.xml (deflated 35%) 2024-12-18T02:08:27.8086366Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-36bb1a531c49c520.xml (deflated 34%) 2024-12-18T02:08:27.8087469Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bfdafa5bc589b92c.xml (deflated 34%) 2024-12-18T02:08:27.8088577Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1fba3f1143b216d6.xml (deflated 34%) 2024-12-18T02:08:27.8089680Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-41fab7691f51eaab.xml (deflated 34%) 2024-12-18T02:08:27.8090784Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f7d154fd2801c6c3.xml (deflated 35%) 2024-12-18T02:08:27.8091883Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-82f65b53403e0628.xml (deflated 34%) 2024-12-18T02:08:27.8092866Z adding: test/test-reports/python-pytest/test.run_test/test.run_test-a0eb0735e3a5e280.xml (deflated 64%) 2024-12-18T02:08:27.8120719Z ##[group]Run # Remove any previous usage logs if they exist 2024-12-18T02:08:27.8121225Z # Remove any previous usage logs if they exist 2024-12-18T02:08:27.8121615Z rm -f logs-*.zip 2024-12-18T02:08:27.8122102Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-12-18T02:08:27.8122664Z # so check to see if the file exists first 2024-12-18T02:08:27.8123029Z if [ -f 'usage_log.txt' ]; then 2024-12-18T02:08:27.8123426Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-12-18T02:08:27.8123788Z fi 2024-12-18T02:08:27.8124172Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2024-12-18T02:08:27.8124741Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2024-12-18T02:08:27.8125153Z fi 2024-12-18T02:08:27.8130823Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.8131222Z env: 2024-12-18T02:08:27.8131461Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.8131943Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.8132555Z FILE_SUFFIX: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T02:08:27.8132947Z ##[endgroup] 2024-12-18T02:08:27.8370300Z adding: usage_log.txt (deflated 96%) 2024-12-18T02:08:27.8476476Z adding: test/test-reports/distributed.test_dynamo_distributed_1.1_dc43c3b523037a19_.log (deflated 88%) 2024-12-18T02:08:27.8477756Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_6f7acdae3fe38b87_.log (deflated 70%) 2024-12-18T02:08:27.8478699Z adding: test/test-reports/distributed._tensor.test_common_rules_1.1_e09d77423b19fc25_.log (deflated 75%) 2024-12-18T02:08:27.9695905Z adding: test/test-reports/distributed._tensor.test_dtensor_ops_1.1_9be8e2385ef15897_.log (deflated 96%) 2024-12-18T02:08:27.9696815Z adding: test/test-reports/distributed._tensor.test_init_1.1_bc9407217b9b4590_.log (deflated 69%) 2024-12-18T02:08:27.9697677Z adding: test/test-reports/distributed._tensor.test_experimental_ops_1.1_ef99caa3c1f99845_.log (deflated 74%) 2024-12-18T02:08:27.9703461Z adding: test/test-reports/distributed._tensor.test_tensor_ops_1.1_685e7cc7b47983e4_.log (deflated 95%) 2024-12-18T02:08:27.9704544Z adding: test/test-reports/distributed._tensor.test_math_ops_1.1_df3cf4895e28fac6_.log (deflated 91%) 2024-12-18T02:08:27.9705455Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_62849d643d077e70_.log (deflated 67%) 2024-12-18T02:08:27.9706613Z adding: test/test-reports/distributed._tensor.test_matrix_ops_1.1_83ec18a2a117d567_.log (deflated 89%) 2024-12-18T02:08:27.9717351Z adding: test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_e9a72336a01d4052_.log (deflated 96%) 2024-12-18T02:08:27.9718324Z adding: test/test-reports/distributed.test_c10d_ops_nccl_1.1_3509e881cc314672_.log (stored 0%) 2024-12-18T02:08:27.9719253Z adding: test/test-reports/distributed.checkpoint.test_save_load_api_1.1_fc06309b83e8f9d5_.log (deflated 53%) 2024-12-18T02:08:27.9720303Z adding: test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_d321d7414566aa6f_.log (deflated 52%) 2024-12-18T02:08:27.9721289Z adding: test/test-reports/distributed._composable.test_contract_1.1_b3a5a3d603973aae_.log (deflated 66%) 2024-12-18T02:08:27.9722206Z adding: test/test-reports/distributed.pipelining.test_microbatch_1.1_535f6e467c8e1750_.log (deflated 58%) 2024-12-18T02:08:27.9723139Z adding: test/test-reports/distributed.optim.test_named_optimizer_1.1_a78a70951bfd937b_.log (stored 0%) 2024-12-18T02:08:27.9724165Z adding: test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_15a5221d28fb0e48_.log (deflated 54%) 2024-12-18T02:08:27.9725225Z adding: test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_8dbb88e45c9fb03d_.log (deflated 77%) 2024-12-18T02:08:27.9726410Z adding: test/test-reports/distributed._tools.test_mem_tracker_1.1_5cef7eb4598f12b2_.log (deflated 61%) 2024-12-18T02:08:27.9727226Z adding: test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_8905a40f724141c9_.log (deflated 51%) 2024-12-18T02:08:27.9728039Z adding: test/test-reports/distributed._tensor.test_attention_1.1_4458f73ea7776327_.log (deflated 63%) 2024-12-18T02:08:27.9728862Z adding: test/test-reports/distributed._tensor.test_api_1.1_cbaad98787efbaf6_.log (deflated 89%) 2024-12-18T02:08:27.9729698Z adding: test/test-reports/distributed.pipelining.test_stage_1.1_4bf6746f0621c19b_.log (deflated 2%) 2024-12-18T02:08:27.9730569Z adding: test/test-reports/distributed._composable.test_checkpoint_1.1_d90ff5820260c364_.log (deflated 68%) 2024-12-18T02:08:27.9731485Z adding: test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_ffcb747aaa05349a_.log (deflated 71%) 2024-12-18T02:08:27.9739323Z adding: test/test-reports/distributed._tensor.test_redistribute_1.1_273b345e98fd314a_.log (deflated 96%) 2024-12-18T02:08:27.9740213Z adding: test/test-reports/distributed.checkpoint.test_fsspec_1.1_f27efb7492e6d9d7_.log (deflated 57%) 2024-12-18T02:08:27.9741448Z adding: test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_c132f2a8548fe7a8_.log (deflated 89%) 2024-12-18T02:08:27.9742367Z adding: test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_cda22b0101bbcda0_.log (deflated 66%) 2024-12-18T02:08:27.9744811Z adding: test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_f0dc69f9a07d9d36_.log (deflated 94%) 2024-12-18T02:08:27.9745980Z adding: test/test-reports/distributed.elastic.test_control_plane_1.1_d0df3a100b683767_.log (deflated 73%) 2024-12-18T02:08:27.9747056Z adding: test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_45d7a0283e6687c1_.log (deflated 89%) 2024-12-18T02:08:27.9747943Z adding: test/test-reports/distributed.test_nccl_1.1_af51a1faf905fb4b_.log (deflated 49%) 2024-12-18T02:08:27.9748698Z adding: test/test-reports/distributed.test_c10d_logger_1.1_c521d2374697bb03_.log (deflated 55%) 2024-12-18T02:08:27.9756073Z adding: test/test-reports/distributed.fsdp.test_fsdp_state_dict_1.1_98f71012a6228f1a_.log (deflated 96%) 2024-12-18T02:08:27.9765246Z adding: test/test-reports/distributed._tensor.test_optimizers_1.1_bc040ff31dc8d7cf_.log (deflated 95%) 2024-12-18T02:08:27.9766116Z adding: test/test-reports/distributed.test_c10d_nccl_1.1_1b355e3bd9e0f9f3_.log (stored 0%) 2024-12-18T02:08:27.9766922Z adding: test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_2da682962fb824d3_.log (deflated 53%) 2024-12-18T02:08:27.9768164Z adding: test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_7a47f1813d268f5f_.log (deflated 92%) 2024-12-18T02:08:27.9769830Z adding: test/test-reports/distributed.fsdp.test_fsdp_freezing_weights_1.1_7043f01e47b57d67_.log (deflated 93%) 2024-12-18T02:08:27.9770949Z adding: test/test-reports/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks_1.1_ad4945944be5a777_.log (deflated 76%) 2024-12-18T02:08:27.9771930Z adding: test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_5c02d12f16b24eef_.log (deflated 52%) 2024-12-18T02:08:27.9772885Z adding: test/test-reports/distributed.test_multi_threaded_pg_1.1_f16bd84ab7660714_.log (deflated 86%) 2024-12-18T02:08:27.9773769Z adding: test/test-reports/distributed.fsdp.test_fsdp_uneven_1.1_1791b9479564ec78_.log (deflated 51%) 2024-12-18T02:08:27.9774680Z adding: test/test-reports/distributed.fsdp.test_fsdp_input_1.1_58eea2890866cec8_.log (deflated 51%) 2024-12-18T02:08:27.9775551Z adding: test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_6809edf03f6fe563_.log (deflated 74%) 2024-12-18T02:08:27.9776541Z adding: test/test-reports/distributed.fsdp.test_fsdp_ignored_modules_1.1_876e2cf5431e73f9_.log (deflated 79%) 2024-12-18T02:08:27.9777577Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_850e760428120674_.log (deflated 62%) 2024-12-18T02:08:27.9778749Z adding: test/test-reports/distributed.fsdp.test_checkpoint_wrapper_1.1_65ed8e995078107b_.log (deflated 71%) 2024-12-18T02:08:27.9779682Z adding: test/test-reports/distributed.fsdp.test_utils_1.1_18538b7105c1e819_.log (deflated 50%) 2024-12-18T02:08:27.9780560Z adding: test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_e70eb90fdaeb1947_.log (deflated 52%) 2024-12-18T02:08:27.9781555Z adding: test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_bd7fd29a31625604_.log (deflated 65%) 2024-12-18T02:08:27.9782440Z adding: test/test-reports/distributed.fsdp.test_fsdp_checkpoint_1.1_c7efb3508618fcc1_.log (deflated 87%) 2024-12-18T02:08:27.9783278Z adding: test/test-reports/distributed.algorithms.test_join_1.1_776f8aa35a4ec812_.log (deflated 80%) 2024-12-18T02:08:27.9784190Z adding: test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_d44e546f2283968e_.log (deflated 73%) 2024-12-18T02:08:27.9785140Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_training_1.1_2a9e14838982005d_.log (deflated 86%) 2024-12-18T02:08:27.9786171Z adding: test/test-reports/distributed.checkpoint.test_file_system_checkpoint_cpu_1.1_bfe4f59c816e556d_.log (deflated 94%) 2024-12-18T02:08:27.9788837Z adding: test/test-reports/distributed.rpc.test_faulty_agent_1.1_f44f4890c3436f66_.log (deflated 94%) 2024-12-18T02:08:27.9814453Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_740c4da14e7d0a75_.log (deflated 97%) 2024-12-18T02:08:27.9838973Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_5c194fd43457a40e_.log (deflated 96%) 2024-12-18T02:08:27.9840048Z adding: test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_b4ff33174e4e9566_.log (deflated 52%) 2024-12-18T02:08:27.9840938Z adding: test/test-reports/distributed._shard.test_sharder_1.1_03c417808c72ac7e_.log (deflated 59%) 2024-12-18T02:08:27.9842140Z adding: test/test-reports/distributed._shard.sharded_optim.test_sharded_optim_1.1_a62f61eedef78f10_.log (deflated 62%) 2024-12-18T02:08:27.9843199Z adding: test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_19ad282708a4eddd_.log (deflated 77%) 2024-12-18T02:08:27.9844101Z adding: test/test-reports/distributed.fsdp.test_fsdp_comm_1.1_19dbc0761df1f4d7_.log (deflated 51%) 2024-12-18T02:08:27.9845142Z adding: test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_reshard_1.1_d37a546e222a1a29_.log (deflated 64%) 2024-12-18T02:08:27.9846103Z adding: test/test-reports/distributed.test_launcher_1.1_8fa56dbaf6e54f13_.log (deflated 59%) 2024-12-18T02:08:27.9847098Z adding: test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_1.1_8610d5ceeed84593_.log (deflated 91%) 2024-12-18T02:08:27.9848059Z adding: test/test-reports/distributed.fsdp.test_distributed_checkpoint_1.1_5362bcf1e17b3d6b_.log (deflated 53%) 2024-12-18T02:08:27.9848985Z adding: test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_99acfbe448c026d6_.log (deflated 86%) 2024-12-18T02:08:27.9862062Z adding: test/test-reports/distributed.test_c10d_gloo_1.1_d7281526e989f668_.log (deflated 96%) 2024-12-18T02:08:27.9862925Z adding: test/test-reports/distributed.elastic.timer.api_test_1.1_3f8b1548cf465f84_.log (stored 0%) 2024-12-18T02:08:27.9863676Z adding: test/test-reports/cpp.test_cpp_rpc_1.1_799e5525c71c1f75_.log (deflated 78%) 2024-12-18T02:08:27.9894700Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-12-18T02:08:27.9895259Z # Remove any previous debugging artifacts if they exist 2024-12-18T02:08:27.9895681Z rm -f debug-*.zip 2024-12-18T02:08:27.9895987Z if [ -d 'test/debug' ]; then 2024-12-18T02:08:27.9896363Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-12-18T02:08:27.9896724Z fi 2024-12-18T02:08:27.9902404Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:27.9902805Z env: 2024-12-18T02:08:27.9903039Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.9903662Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.9904282Z FILE_SUFFIX: test-distributed-1-2-linux.2xlarge_34566861155 2024-12-18T02:08:27.9904689Z ##[endgroup] 2024-12-18T02:08:27.9986344Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:08:27.9986713Z with: 2024-12-18T02:08:27.9986953Z s3-bucket: gha-artifacts 2024-12-18T02:08:27.9987282Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:27.9987652Z retention-days: 14 2024-12-18T02:08:27.9987925Z if-no-files-found: warn 2024-12-18T02:08:27.9988221Z path: test-jsons-*.zip 2024-12-18T02:08:27.9988508Z name: artifact 2024-12-18T02:08:27.9988744Z region: us-east-1 2024-12-18T02:08:27.9988995Z env: 2024-12-18T02:08:27.9989224Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:27.9989699Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:27.9990213Z ##[endgroup] 2024-12-18T02:08:28.3718930Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:08:28.3719473Z With the provided path, there will be 1 file uploaded 2024-12-18T02:08:28.3719938Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:28.3760928Z Starting upload of test-jsons-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:28.5031620Z Finished upload of test-jsons-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:28.5214414Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:08:28.5214782Z with: 2024-12-18T02:08:28.5215010Z s3-bucket: gha-artifacts 2024-12-18T02:08:28.5215519Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:28.5215894Z retention-days: 14 2024-12-18T02:08:28.5216170Z if-no-files-found: error 2024-12-18T02:08:28.5216468Z path: test-reports-*.zip 2024-12-18T02:08:28.5216735Z name: artifact 2024-12-18T02:08:28.5216982Z region: us-east-1 2024-12-18T02:08:28.5217229Z env: 2024-12-18T02:08:28.5217458Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:28.5217948Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:28.5218447Z ##[endgroup] 2024-12-18T02:08:28.8586730Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:08:28.8587448Z With the provided path, there will be 1 file uploaded 2024-12-18T02:08:28.8588331Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:28.8630116Z Starting upload of test-reports-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:28.9908018Z Finished upload of test-reports-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:29.0095230Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:08:29.0095597Z with: 2024-12-18T02:08:29.0095822Z s3-bucket: gha-artifacts 2024-12-18T02:08:29.0096161Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:29.0096534Z retention-days: 14 2024-12-18T02:08:29.0096808Z if-no-files-found: ignore 2024-12-18T02:08:29.0097095Z path: logs-*.zip 2024-12-18T02:08:29.0097355Z name: artifact 2024-12-18T02:08:29.0097600Z region: us-east-1 2024-12-18T02:08:29.0097846Z env: 2024-12-18T02:08:29.0098071Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:29.0098547Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:29.0099046Z ##[endgroup] 2024-12-18T02:08:29.3458632Z NOTE: s3-prefix specified, ignoring name parameter 2024-12-18T02:08:29.3459427Z With the provided path, there will be 1 file uploaded 2024-12-18T02:08:29.3480316Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:29.3508121Z Starting upload of logs-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:29.5585288Z Finished upload of logs-test-distributed-1-2-linux.2xlarge_34566861155.zip 2024-12-18T02:08:29.5769186Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-12-18T02:08:29.5769560Z with: 2024-12-18T02:08:29.5769788Z s3-bucket: gha-artifacts 2024-12-18T02:08:29.5770130Z s3-prefix: pytorch/pytorch/12383255652/1/artifact 2024-12-18T02:08:29.5770671Z retention-days: 14 2024-12-18T02:08:29.5770951Z if-no-files-found: ignore 2024-12-18T02:08:29.5771242Z path: debug-*.zip 2024-12-18T02:08:29.5771480Z name: artifact 2024-12-18T02:08:29.5771725Z region: us-east-1 2024-12-18T02:08:29.5771972Z env: 2024-12-18T02:08:29.5772206Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:29.5772675Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:29.5773191Z ##[endgroup] 2024-12-18T02:08:29.9078005Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-12-18T02:08:29.9270532Z ##[group]Run # shellcheck disable=SC2156 2024-12-18T02:08:29.9270937Z # shellcheck disable=SC2156 2024-12-18T02:08:29.9271694Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-12-18T02:08:29.9277716Z shell: /usr/bin/bash -e {0} 2024-12-18T02:08:29.9278032Z env: 2024-12-18T02:08:29.9278262Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:29.9278740Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:29.9279240Z ##[endgroup] 2024-12-18T02:08:30.1564872Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6 2024-12-18T02:08:30.1565371Z with: 2024-12-18T02:08:30.1565594Z env: 2024-12-18T02:08:30.1565820Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:30.1566301Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:30.1566992Z ##[endgroup] 2024-12-18T02:08:30.1593625Z ##[group]Run set -eou pipefail 2024-12-18T02:08:30.1594143Z set -eou pipefail 2024-12-18T02:08:30.1594532Z  2024-12-18T02:08:30.1595030Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-12-18T02:08:30.1595595Z for _ in $(seq 1440); do 2024-12-18T02:08:30.1596046Z  # Break if no ssh session exists anymore 2024-12-18T02:08:30.1596541Z  if [ "$(who)" = "" ]; then 2024-12-18T02:08:30.1596986Z  break 2024-12-18T02:08:30.1597338Z  fi 2024-12-18T02:08:30.1597780Z  echo "." 2024-12-18T02:08:30.1598204Z  sleep 5 2024-12-18T02:08:30.1598661Z done 2024-12-18T02:08:30.1604687Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:30.1605098Z env: 2024-12-18T02:08:30.1605336Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:30.1605822Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:30.1606346Z ##[endgroup] 2024-12-18T02:08:30.1629129Z Holding runner for 2 hours until all ssh sessions have logged out 2024-12-18T02:08:30.1706922Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T02:08:30.1707528Z # ignore expansion of "docker ps -q" since it could be empty 2024-12-18T02:08:30.1707982Z # shellcheck disable=SC2046 2024-12-18T02:08:30.1708353Z docker stop $(docker ps -q) || true 2024-12-18T02:08:30.1708729Z # Prune all of the docker images 2024-12-18T02:08:30.1709080Z docker system prune -af 2024-12-18T02:08:30.1714998Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:30.1715414Z env: 2024-12-18T02:08:30.1715738Z GIT_DEFAULT_BRANCH: main 2024-12-18T02:08:30.1716563Z DOCKER_CONTAINER_ID: 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:30.1717150Z ##[endgroup] 2024-12-18T02:08:40.8235960Z 9632dd430339 2024-12-18T02:08:41.1905695Z Deleted Containers: 2024-12-18T02:08:41.1906153Z 9632dd430339bfd7fda378c6f1040a54444a36bb6adb9cb23e5684d0989a6cd7 2024-12-18T02:08:41.1906515Z 2024-12-18T02:08:44.9947004Z Deleted Images: 2024-12-18T02:08:44.9947986Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 2024-12-18T02:08:44.9949548Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11@sha256:8ce44960e47173a8d6260b111dd55523c2bac3a784dcddfb2273090443b4b985 2024-12-18T02:08:44.9950683Z deleted: sha256:ba75b8db23c6110013be41fbdb3cc39e97537b627e86e17327cbf783b8db17b3 2024-12-18T02:08:44.9951349Z deleted: sha256:aeb31b248ae8adf4509f5e01d580207d387071af5f4f4297e3d9e39f5d1cc262 2024-12-18T02:08:44.9952075Z deleted: sha256:1e223a22a3d6338cc364952bcd646dee47934aff3d19b2f8b6489e42e91a43b1 2024-12-18T02:08:44.9952732Z deleted: sha256:586c95ff7e9b84395f0ce9c35b6548a5e98ca6bc5f0b038241e81926b56d723c 2024-12-18T02:08:44.9953398Z deleted: sha256:246abd68085ecb1d1a3eb1428ee0747da876ca48f9ec048280dfbeff0074ac95 2024-12-18T02:08:44.9954065Z deleted: sha256:b92b2ff7f6ce6a5451cf921dfc731379c0a9b007f246e3daed7c60b4d5137d99 2024-12-18T02:08:44.9954720Z deleted: sha256:f8d8126016d906f5c73a3fcca17bda1ed3452ff4dff252a3c03888a3d7b42ab2 2024-12-18T02:08:44.9955384Z deleted: sha256:2c3a02b8657cf1dcac006b6b543b9142ab90226c4c7d1f53777b43acad05c1a7 2024-12-18T02:08:44.9956059Z deleted: sha256:c22810e8c09be9d6d45c72f1ffe0fb192d95e0bed3ddbf61f0c79dba2c90018a 2024-12-18T02:08:44.9956887Z deleted: sha256:73f699de8e4c822099cdff6d3d18d8b6fa3239d3dedc650a17639c28ceb510c5 2024-12-18T02:08:44.9957553Z deleted: sha256:d3ed5a77027814959f0fd12e5b80744c711d60fa30dc6a445d6f832eb1a5496e 2024-12-18T02:08:44.9958212Z deleted: sha256:1a7c842ce650c9021a132560fea5b18c14e778c9ecc47ea829ca8794136767b3 2024-12-18T02:08:44.9958860Z deleted: sha256:0f8a619247ee52fa526795a2224bc4f38fb6c26cf9fcc15c159076fa20d6d431 2024-12-18T02:08:44.9959527Z deleted: sha256:6bbd71156d8f32d92d6c43614c216e81dbd839bbae04550d948ba35abab0275c 2024-12-18T02:08:44.9960188Z deleted: sha256:3ef4fd24c00a30cfe335415866299c884d6eec5e214a6ce6266476eb5609a251 2024-12-18T02:08:44.9960857Z deleted: sha256:c051dbcd3b39a81b527fbabd88ea3e0f59fa8ac8219b3d9985db56e47094aa04 2024-12-18T02:08:44.9961532Z deleted: sha256:4d0ec5432feffd89ad55ce2d2f8dee8df2ee77d52f67154330eff867b49e10cc 2024-12-18T02:08:44.9962249Z deleted: sha256:d4d31c12cf2f8627decfcdb0305d3c29b36e45209894e6f1bf32306279a80eb2 2024-12-18T02:08:44.9962904Z deleted: sha256:0e9fff3f3281d5c4fe945357a13b019f1e3c8f703a864837330ce7bc37ef7874 2024-12-18T02:08:44.9963555Z deleted: sha256:f2f7b89123825ac5fb1c96b24c83014857425516b9b723ff9f0f39e01b55b0ba 2024-12-18T02:08:44.9964201Z deleted: sha256:6d0f5923b72e6c51119f010a01113b33c3b1908340235020c2e88f16e4ff95fc 2024-12-18T02:08:44.9964864Z deleted: sha256:5416d3f4bde212b3aa132a395a893b97d8d82cfff3f5c1adeb81fd195c56e120 2024-12-18T02:08:44.9965532Z deleted: sha256:0f2b68696d6f02eb26ed1ee845dbcbe074d1f20e975f6bfe674b4ae92e47f1ee 2024-12-18T02:08:44.9966195Z deleted: sha256:ac6c71881760b93ebcab71ccc8586ca73d23dd649971c817fcc72043735715fa 2024-12-18T02:08:44.9966864Z deleted: sha256:8ec7dc3fe13c5ac656e1ce8a9d4085e3ae6bffafe95863b06bfcd1dadd0c50b7 2024-12-18T02:08:44.9967525Z deleted: sha256:295d66ca14c997cdb9573b02a83922ddb7de0761bbf5116c64fafcd90abdd5d1 2024-12-18T02:08:44.9968179Z deleted: sha256:db23495642b38685d72ac449cd76cf7924ca1d6a16b0a06892588518bceb6b17 2024-12-18T02:08:44.9968841Z deleted: sha256:878e24ba2da51ef71abb9f5f0696ae05491b2a43b01c2bc64ecfb734c83554fc 2024-12-18T02:08:44.9969506Z deleted: sha256:0e6f24fb0632d6dc796fdb8a05f84c308e1f888c1884fedcf200c751675c80c9 2024-12-18T02:08:44.9970158Z deleted: sha256:7d6980d8a243b5f504c57d0619fb57e0e378298f52184a53ec757fd44a6d18cc 2024-12-18T02:08:44.9970813Z deleted: sha256:45b06526bf9f4acdae25f6ae3547220f80d8ca70bf3daf5b150c35046175f5e1 2024-12-18T02:08:44.9971454Z deleted: sha256:a539530bf66d9b75e34736f432dffca8005f4bb9246577c9e59a9bbacefe4e13 2024-12-18T02:08:44.9972110Z deleted: sha256:86a6dbb8582051332e0a6a65a2264f436e66454e84176171faf0e29a3afe70e7 2024-12-18T02:08:44.9972758Z deleted: sha256:160a24c1f8ab9f6e412b9452281eb8037ee100735b78d95aea1934c9628c1293 2024-12-18T02:08:44.9973409Z deleted: sha256:dd910b80f21074c66b36f8caf667bd36b8eb08a7e1ae20664198f3ce120ab2e8 2024-12-18T02:08:44.9974066Z deleted: sha256:3fc1aa7a4da8301c2ae6b29f652a136e2ef805e92863f121870955e37ff6970e 2024-12-18T02:08:44.9974854Z deleted: sha256:1cc14ebec8bc75a3313bbd143f89284ae8195c2b3604e3557c203c20c0cd1d6b 2024-12-18T02:08:44.9975533Z deleted: sha256:ed26e0eaaa30bc5ff07733f6079732409c415c81dc9d8efb220c15e7df3bacd2 2024-12-18T02:08:44.9976193Z deleted: sha256:a57c3e94b916cf07f67523e57781993dad7cbd839292a3346971863814b5db7b 2024-12-18T02:08:44.9976825Z deleted: sha256:5651b9c446349755343e61dd7f5434cb82ed57cd0d1197ba453654984f300129 2024-12-18T02:08:44.9977484Z deleted: sha256:19dda05ec0ff3f6c1e9e6fb3f954974b239b401d7cb8603eada0464aa62f45f9 2024-12-18T02:08:44.9978154Z deleted: sha256:ac5748f8b22f42e238491aff23acfd76b9e50ef45e5a05bb3ae9339010657a4a 2024-12-18T02:08:44.9978812Z deleted: sha256:5c0906a40108fc75d8b32a9686621080f65255ac3e8d71bd97798da03c95e53e 2024-12-18T02:08:44.9979457Z deleted: sha256:4614766629331e5858a201b0d5bcb6a37013c71baef80f7e87c35e9e8ea8dc49 2024-12-18T02:08:44.9980104Z deleted: sha256:8d6b9a23baf8985c711ed535e499ad6979e90f8e74798c89c0c238d0fe278f0a 2024-12-18T02:08:44.9980762Z deleted: sha256:31cc38ea0198ecdd3ec451700807ce4a7ffaea00aec0d6da1daa7e156d5e60e2 2024-12-18T02:08:44.9981427Z deleted: sha256:80aa0d10ad3f8def7708276348016c03bd68fbd921d66ab54ae962da9097a1fb 2024-12-18T02:08:44.9982183Z deleted: sha256:b2cec93458c1528084d7c8f5ecb5b247f400e1cd5c4c5494e772fc730384d9b5 2024-12-18T02:08:44.9982847Z deleted: sha256:c07a3cbfdb9f456cab10ff7a9b5e6d8a9b1539d1651912123378ca79a4beee6b 2024-12-18T02:08:44.9983512Z deleted: sha256:af532aa89116bf717712b89a57c9b263b1875b98cfd5cf26e02cf41be2fc1013 2024-12-18T02:08:44.9984178Z deleted: sha256:17d75eb3114e3c9c1bfd66df1a7238914dcdf84b07724b4b5bf6cfc85348e9e6 2024-12-18T02:08:44.9984833Z deleted: sha256:9a1cdfa255a7727e862de25c192deb6f6c25e97c06474dd2dcf2e6ce92d902dd 2024-12-18T02:08:44.9985501Z deleted: sha256:b566aff8fcc130a4a7b53c56a44aa82176e34a6a86c2f3aafcfed3076bc349d3 2024-12-18T02:08:44.9986160Z deleted: sha256:45bee2354cf9957f14ae5bba48434310bb76f6d7b9bb8e618c1f17246cb51fc8 2024-12-18T02:08:44.9986815Z deleted: sha256:9e190be19e27140bf038fc4e451552b3fa3beb9ba1710492970ddd1f0e3fa029 2024-12-18T02:08:44.9987482Z deleted: sha256:9e1415a7ba8cca6ab5c74a6b7e0e8fb8b1c6421a89fb377981012309bf6b4f0c 2024-12-18T02:08:44.9988147Z deleted: sha256:2c567bed494c25ee2d27912c572112c534e4d63eabc6fd7cf4e725b57648a148 2024-12-18T02:08:44.9988784Z deleted: sha256:1e999f6c5f49af604968d674e81018998a7379d85f759e4bb5d37703c53b86e0 2024-12-18T02:08:44.9989430Z deleted: sha256:b30ade727a853d719f75f79626a47e323ee040ba4b74b86704d2c672cd8d26c5 2024-12-18T02:08:44.9990082Z deleted: sha256:8c34eb0148fbde02b056ee5159c674405b4e6c45b9c928c0d09991986f29cc3b 2024-12-18T02:08:44.9990732Z deleted: sha256:f246ca8961e72fae0e36c74fc8131454e1c74dd99788ab4c46de695a81fd705a 2024-12-18T02:08:44.9991465Z deleted: sha256:e65c9bd66e2c9e0185c429e37a4f1d46b929d0d30feddf9a93df46d89b8d42ec 2024-12-18T02:08:44.9992123Z deleted: sha256:3774863ff6f02735140a4d72693c5dc3547b83350de6ce336c527ba7d5467308 2024-12-18T02:08:44.9992755Z deleted: sha256:e17e166aadec0c7f25954419e95e3b47b4f7f8a6f39c737385baa39612d44e92 2024-12-18T02:08:44.9993412Z deleted: sha256:5fba9281815179bbce0a79bcd0f801431cf639d81d1c96302454d4cb255d9a65 2024-12-18T02:08:44.9994064Z deleted: sha256:7895c77f0946ac84964a102e6b0396aa9afd7b5bb5f399f95192743d65d278fd 2024-12-18T02:08:44.9994712Z deleted: sha256:a914a87f9b9df03ec837d8145959e294fc40b53db7200f4aa19df708aa917d0a 2024-12-18T02:08:44.9995368Z deleted: sha256:4e851ff77a00ea886affd52d302a788fa1dc6e5086f3da273dd3f892f5a25a87 2024-12-18T02:08:44.9996020Z deleted: sha256:24a67e4c1291641c80c27612beff31554f87aa99a361451b48e38bdd390ee52b 2024-12-18T02:08:44.9996650Z deleted: sha256:e5108cb11e4a0399e9d2e97768480b2162c8ed08c7d3d928881716b58f7d6a06 2024-12-18T02:08:44.9997306Z deleted: sha256:3645dcd9fb7cfddd3837947579db0257dde78596304428d1daa92ff2626c03e7 2024-12-18T02:08:44.9997962Z deleted: sha256:fa1875e33008bfe122d5fcc20dc79d779bc53905359af1113332936ff17cb1b9 2024-12-18T02:08:44.9998619Z deleted: sha256:f8bed40e703ff2a2ab99ee6033afc7b6e9cc3646747798260c6dfce01d340567 2024-12-18T02:08:44.9999378Z deleted: sha256:86f67a8ebecb756d3a39f7bdc902541146354a466c2b1a41f9622248435537b9 2024-12-18T02:08:45.0000024Z deleted: sha256:10f4b37f40901aa6a384f56d192a951db810177e640e4899d9e5433219784696 2024-12-18T02:08:45.0000650Z deleted: sha256:433436db19108287e6066ef506f03435459f1f8030a4e71272598e9bcdd8fed1 2024-12-18T02:08:45.0001301Z deleted: sha256:9df77c78b35d6913e368eaf4da3a8a30bb84956b53b93535adbf83e3f080bb45 2024-12-18T02:08:45.0001967Z deleted: sha256:9c5a001178848db25de9aa27faa5a3a970e9adb6a5de5af11f551b3cf8c640af 2024-12-18T02:08:45.0002633Z deleted: sha256:49215fb32aff9c76cd9b1a48305b7ca3b262a769826cdef352c6a2ddd6b61e2e 2024-12-18T02:08:45.0003297Z deleted: sha256:266e809a72cfd156276f0d2cfe1d7f560ce71ecfff0871ad75a54b46a888458c 2024-12-18T02:08:45.0003937Z deleted: sha256:7824aef9285092646c0e847bacc350150b5593e4dd50d476c97a7b9ef2bd5832 2024-12-18T02:08:45.0004586Z deleted: sha256:dd2955a3c1730d510a7b8727749ea263b29c24004e3db0591c5e01187fd04ebb 2024-12-18T02:08:45.0005244Z deleted: sha256:776fdef2552a20b841f6123adef24358398ce96b0bcf4f063b77b43af75ccabe 2024-12-18T02:08:45.0005895Z deleted: sha256:3debd486979133b9fb2d2b60175532b65f25959777e148056b24d48630ea7580 2024-12-18T02:08:45.0006609Z deleted: sha256:350913dc408831d71f1d6cad376922537125851c919370a8e50e31d3ec2cda0b 2024-12-18T02:08:45.0007254Z deleted: sha256:4083e3d0e14e534d7532677ae2dfcf0f4e61f9727daa77bc6a457d19af86531b 2024-12-18T02:08:45.0007895Z deleted: sha256:a3a312998a133afbd1f853f9dbb938fd2df577d715601d8fa7b1795957486c55 2024-12-18T02:08:45.0008560Z deleted: sha256:a01dc28d4cb6dc69779fd9a36faa6d962d11c32e2bcafa3bb518e9739eb830be 2024-12-18T02:08:45.0009229Z deleted: sha256:e6b80ded1eac5dc87de66c217fe26ced6a84403732f31a66603a4ef84e51a629 2024-12-18T02:08:45.0009894Z deleted: sha256:4f1b3dba7d93f46f40596ef2ad87c27bff39abb592f484286a507403d8a5f2ae 2024-12-18T02:08:45.0010554Z deleted: sha256:6831241403c4ce00ca6d2e124af8eae501c2e9b27433704edf468abd652dfacd 2024-12-18T02:08:45.0011210Z deleted: sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465 2024-12-18T02:08:45.0011601Z 2024-12-18T02:08:45.0039626Z Total reclaimed space: 22.98GB 2024-12-18T02:08:45.0129212Z Post job cleanup. 2024-12-18T02:08:45.0186536Z Post job cleanup. 2024-12-18T02:08:45.1012878Z [command]/usr/bin/git version 2024-12-18T02:08:45.1048793Z git version 2.40.1 2024-12-18T02:08:45.1089241Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/1a3b1998-9f19-4957-b5fd-47ca8e5037e0' before making global git config changes 2024-12-18T02:08:45.1090229Z Adding repository directory to the temporary git global config as a safe directory 2024-12-18T02:08:45.1093733Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-12-18T02:08:45.1124358Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-12-18T02:08:45.1150224Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-12-18T02:08:45.1501591Z Entering 'android/libs/fbjni' 2024-12-18T02:08:45.1557465Z Entering 'third_party/FP16' 2024-12-18T02:08:45.1610366Z Entering 'third_party/FXdiv' 2024-12-18T02:08:45.1662551Z Entering 'third_party/NNPACK' 2024-12-18T02:08:45.1715001Z Entering 'third_party/NVTX' 2024-12-18T02:08:45.1767767Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T02:08:45.1818963Z Entering 'third_party/XNNPACK' 2024-12-18T02:08:45.1888249Z Entering 'third_party/benchmark' 2024-12-18T02:08:45.1939566Z Entering 'third_party/composable_kernel' 2024-12-18T02:08:45.2000825Z Entering 'third_party/cpp-httplib' 2024-12-18T02:08:45.2053347Z Entering 'third_party/cpuinfo' 2024-12-18T02:08:45.2108180Z Entering 'third_party/cudnn_frontend' 2024-12-18T02:08:45.2160847Z Entering 'third_party/cutlass' 2024-12-18T02:08:45.2221360Z Entering 'third_party/eigen' 2024-12-18T02:08:45.2277206Z Entering 'third_party/fbgemm' 2024-12-18T02:08:45.2330949Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T02:08:45.2381999Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T02:08:45.2433815Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T02:08:45.2491896Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T02:08:45.2543354Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T02:08:45.2594980Z Entering 'third_party/flatbuffers' 2024-12-18T02:08:45.2651140Z Entering 'third_party/fmt' 2024-12-18T02:08:45.2702492Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T02:08:45.2754555Z Entering 'third_party/gloo' 2024-12-18T02:08:45.2805512Z Entering 'third_party/googletest' 2024-12-18T02:08:45.2857328Z Entering 'third_party/ideep' 2024-12-18T02:08:45.2907635Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T02:08:45.2965972Z Entering 'third_party/ittapi' 2024-12-18T02:08:45.3017576Z Entering 'third_party/kineto' 2024-12-18T02:08:45.3069849Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T02:08:45.3120652Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T02:08:45.3174676Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T02:08:45.3226063Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T02:08:45.3277705Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T02:08:45.3327432Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T02:08:45.3381062Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T02:08:45.3445066Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T02:08:45.3484090Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T02:08:45.3535787Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T02:08:45.3589436Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T02:08:45.3640620Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T02:08:45.3692285Z Entering 'third_party/mimalloc' 2024-12-18T02:08:45.3745915Z Entering 'third_party/nccl/nccl' 2024-12-18T02:08:45.3797402Z Entering 'third_party/nlohmann' 2024-12-18T02:08:45.3850149Z Entering 'third_party/onnx' 2024-12-18T02:08:45.3918282Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T02:08:45.3972995Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T02:08:45.4025169Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T02:08:45.4075799Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T02:08:45.4127302Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T02:08:45.4178279Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T02:08:45.4229601Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T02:08:45.4279683Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T02:08:45.4329925Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T02:08:45.4379292Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T02:08:45.4432237Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T02:08:45.4484298Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T02:08:45.4556071Z Entering 'third_party/pocketfft' 2024-12-18T02:08:45.4608289Z Entering 'third_party/protobuf' 2024-12-18T02:08:45.4662793Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T02:08:45.4713638Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T02:08:45.4766477Z Entering 'third_party/psimd' 2024-12-18T02:08:45.4817899Z Entering 'third_party/pthreadpool' 2024-12-18T02:08:45.4869793Z Entering 'third_party/pybind11' 2024-12-18T02:08:45.4922123Z Entering 'third_party/python-peachpy' 2024-12-18T02:08:45.4973074Z Entering 'third_party/sleef' 2024-12-18T02:08:45.5023303Z Entering 'third_party/tensorpipe' 2024-12-18T02:08:45.5074299Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T02:08:45.5124360Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T02:08:45.5174366Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T02:08:45.5224449Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T02:08:45.5273713Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T02:08:45.5341925Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-12-18T02:08:45.5359466Z http.https://github.com/.extraheader 2024-12-18T02:08:45.5368239Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-12-18T02:08:45.5394851Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-12-18T02:08:45.5672675Z Entering 'android/libs/fbjni' 2024-12-18T02:08:45.5708927Z http.https://github.com/.extraheader 2024-12-18T02:08:45.5742150Z Entering 'third_party/FP16' 2024-12-18T02:08:45.5776589Z http.https://github.com/.extraheader 2024-12-18T02:08:45.5809661Z Entering 'third_party/FXdiv' 2024-12-18T02:08:45.5844993Z http.https://github.com/.extraheader 2024-12-18T02:08:45.5876789Z Entering 'third_party/NNPACK' 2024-12-18T02:08:45.5912376Z http.https://github.com/.extraheader 2024-12-18T02:08:45.5944336Z Entering 'third_party/NVTX' 2024-12-18T02:08:45.5978998Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6012450Z Entering 'third_party/VulkanMemoryAllocator' 2024-12-18T02:08:45.6048646Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6079856Z Entering 'third_party/XNNPACK' 2024-12-18T02:08:45.6114709Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6162499Z Entering 'third_party/benchmark' 2024-12-18T02:08:45.6198199Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6229580Z Entering 'third_party/composable_kernel' 2024-12-18T02:08:45.6263973Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6302413Z Entering 'third_party/cpp-httplib' 2024-12-18T02:08:45.6336590Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6367727Z Entering 'third_party/cpuinfo' 2024-12-18T02:08:45.6403337Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6434834Z Entering 'third_party/cudnn_frontend' 2024-12-18T02:08:45.6471196Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6503971Z Entering 'third_party/cutlass' 2024-12-18T02:08:45.6540339Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6581181Z Entering 'third_party/eigen' 2024-12-18T02:08:45.6616692Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6650292Z Entering 'third_party/fbgemm' 2024-12-18T02:08:45.6685526Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6717310Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-12-18T02:08:45.6751207Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6784062Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-12-18T02:08:45.6817660Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6849487Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-12-18T02:08:45.6883482Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6922447Z Entering 'third_party/fbgemm/third_party/googletest' 2024-12-18T02:08:45.6956605Z http.https://github.com/.extraheader 2024-12-18T02:08:45.6987595Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-12-18T02:08:45.7020355Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7052815Z Entering 'third_party/flatbuffers' 2024-12-18T02:08:45.7088454Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7123502Z Entering 'third_party/fmt' 2024-12-18T02:08:45.7158746Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7190393Z Entering 'third_party/gemmlowp/gemmlowp' 2024-12-18T02:08:45.7225941Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7258727Z Entering 'third_party/gloo' 2024-12-18T02:08:45.7293282Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7324907Z Entering 'third_party/googletest' 2024-12-18T02:08:45.7359976Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7391615Z Entering 'third_party/ideep' 2024-12-18T02:08:45.7426387Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7458243Z Entering 'third_party/ideep/mkl-dnn' 2024-12-18T02:08:45.7493261Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7533557Z Entering 'third_party/ittapi' 2024-12-18T02:08:45.7569819Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7602472Z Entering 'third_party/kineto' 2024-12-18T02:08:45.7638438Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7673498Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-12-18T02:08:45.7707507Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7740285Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-12-18T02:08:45.7774843Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7808423Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-12-18T02:08:45.7843338Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7876943Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-12-18T02:08:45.7911467Z http.https://github.com/.extraheader 2024-12-18T02:08:45.7943817Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-12-18T02:08:45.7977328Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8009776Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-12-18T02:08:45.8046034Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8080978Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-12-18T02:08:45.8115700Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8149777Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-12-18T02:08:45.8184569Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8218021Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-12-18T02:08:45.8252830Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8286467Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-12-18T02:08:45.8319734Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8354372Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-12-18T02:08:45.8388151Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8420227Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-12-18T02:08:45.8455105Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8489356Z Entering 'third_party/mimalloc' 2024-12-18T02:08:45.8525122Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8558161Z Entering 'third_party/nccl/nccl' 2024-12-18T02:08:45.8594136Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8627087Z Entering 'third_party/nlohmann' 2024-12-18T02:08:45.8662313Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8695881Z Entering 'third_party/onnx' 2024-12-18T02:08:45.8730716Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8779687Z Entering 'third_party/onnx/third_party/pybind11' 2024-12-18T02:08:45.8814247Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8848587Z Entering 'third_party/opentelemetry-cpp' 2024-12-18T02:08:45.8884236Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8918907Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-12-18T02:08:45.8953364Z http.https://github.com/.extraheader 2024-12-18T02:08:45.8984933Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-12-18T02:08:45.9018344Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9050510Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-12-18T02:08:45.9083958Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9114946Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-12-18T02:08:45.9148649Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9182177Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-12-18T02:08:45.9215550Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9246696Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-12-18T02:08:45.9281552Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9312542Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-12-18T02:08:45.9347208Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9377820Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-12-18T02:08:45.9412228Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9445932Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-12-18T02:08:45.9480109Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9514023Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-12-18T02:08:45.9551125Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9604107Z Entering 'third_party/pocketfft' 2024-12-18T02:08:45.9640195Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9671638Z Entering 'third_party/protobuf' 2024-12-18T02:08:45.9706598Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9742683Z Entering 'third_party/protobuf/third_party/benchmark' 2024-12-18T02:08:45.9776572Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9808967Z Entering 'third_party/protobuf/third_party/googletest' 2024-12-18T02:08:45.9843462Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9878073Z Entering 'third_party/psimd' 2024-12-18T02:08:45.9913571Z http.https://github.com/.extraheader 2024-12-18T02:08:45.9946252Z Entering 'third_party/pthreadpool' 2024-12-18T02:08:45.9981479Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0013324Z Entering 'third_party/pybind11' 2024-12-18T02:08:46.0048697Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0081358Z Entering 'third_party/python-peachpy' 2024-12-18T02:08:46.0117341Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0152006Z Entering 'third_party/sleef' 2024-12-18T02:08:46.0187477Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0220528Z Entering 'third_party/tensorpipe' 2024-12-18T02:08:46.0256566Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0291190Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-12-18T02:08:46.0326802Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0360790Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-12-18T02:08:46.0397515Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0431853Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-12-18T02:08:46.0468951Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0503247Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-12-18T02:08:46.0537725Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0570591Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-12-18T02:08:46.0606810Z http.https://github.com/.extraheader 2024-12-18T02:08:46.0726697Z A job completed hook has been configured by the self-hosted runner administrator 2024-12-18T02:08:46.0753957Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-12-18T02:08:46.0759154Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-12-18T02:08:46.0759558Z ##[endgroup] 2024-12-18T02:08:53.3288391Z Cleaning up orphan processes