2024-10-08T20:11:37.2194872Z Current runner version: '2.320.0'
2024-10-08T20:11:37.2201534Z Runner name: 'i-05d4cdd6accd1587b'
2024-10-08T20:11:37.2202182Z Runner group name: 'Default'
2024-10-08T20:11:37.2202916Z Machine name: 'ip-10-0-78-74'
2024-10-08T20:11:37.2220262Z Testing runner upgrade compatibility
2024-10-08T20:11:37.5022163Z ##[group]GITHUB_TOKEN Permissions
2024-10-08T20:11:37.5024356Z Actions: read
2024-10-08T20:11:37.5024772Z Attestations: read
2024-10-08T20:11:37.5025151Z Checks: read
2024-10-08T20:11:37.5025507Z Contents: read
2024-10-08T20:11:37.5025892Z Deployments: read
2024-10-08T20:11:37.5026278Z Discussions: read
2024-10-08T20:11:37.5026666Z Issues: read
2024-10-08T20:11:37.5027030Z Metadata: read
2024-10-08T20:11:37.5027406Z Packages: read
2024-10-08T20:11:37.5027778Z Pages: read
2024-10-08T20:11:37.5028140Z PullRequests: read
2024-10-08T20:11:37.5028570Z RepositoryProjects: read
2024-10-08T20:11:37.5029040Z SecurityEvents: read
2024-10-08T20:11:37.5029446Z Statuses: read
2024-10-08T20:11:37.5029957Z ##[endgroup]
2024-10-08T20:11:37.5033562Z Secret source: Actions
2024-10-08T20:11:37.5034165Z Prepare workflow directory
2024-10-08T20:11:37.8781413Z Prepare all required actions
2024-10-08T20:11:37.8956809Z Getting action download info
2024-10-08T20:11:38.1115089Z Download action repository 'pytorch/test-infra@main' (SHA:d420136f568806947b1ab3a763151299d32d5621)
2024-10-08T20:11:38.5554501Z Download action repository 'pytorch/pytorch@main' (SHA:3c1ab9367885fdb0ead5fcc14a22d6934070ca92)
2024-10-08T20:11:41.7523539Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0)
2024-10-08T20:11:41.8874411Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a)
2024-10-08T20:11:42.1300156Z Getting action download info
2024-10-08T20:11:42.2495170Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c)
2024-10-08T20:11:42.4751924Z Getting action download info
2024-10-08T20:11:42.5718211Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482)
2024-10-08T20:11:42.7345842Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/134247/merge (cbe39ffc96498585a83508a23de66f3eecb751d5)
2024-10-08T20:11:42.7348277Z ##[group] Inputs
2024-10-08T20:11:42.7348701Z   build-environment: linux-jammy-py3.9-gcc11
2024-10-08T20:11:42.7352265Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}
2024-10-08T20:11:42.7356361Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:11:42.7357404Z   sync-tag: 
2024-10-08T20:11:42.7358204Z   timeout-minutes: 240
2024-10-08T20:11:42.7358525Z   use-gha: 
2024-10-08T20:11:42.7358809Z   dashboard-tag: 
2024-10-08T20:11:42.7359133Z   s3-bucket: gha-artifacts
2024-10-08T20:11:42.7359494Z   aws-role-to-assume: 
2024-10-08T20:11:42.7359817Z ##[endgroup]
2024-10-08T20:11:42.7360585Z Complete job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:11:42.7977467Z A job started hook has been configured by the self-hosted runner administrator
2024-10-08T20:11:42.8129403Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2024-10-08T20:11:42.8140141Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:11:42.8140708Z ##[endgroup]
2024-10-08T20:11:44.4206816Z Runner Type: linux.2xlarge
2024-10-08T20:11:44.4207317Z Instance Type: c5.2xlarge
2024-10-08T20:11:44.4207709Z AMI Name: unknown
2024-10-08T20:11:44.4208294Z AMI ID: ami-0fff1b9a61dec8a5f
2024-10-08T20:11:50.5794276Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main
2024-10-08T20:11:50.5794904Z with:
2024-10-08T20:11:50.5795804Z   github-secret: ***
2024-10-08T20:11:50.5796806Z   instructions: All testing is done inside the container, to start an interactive session run:
  docker exec -it $(docker container ps --format '{{.ID}}') bash

2024-10-08T20:11:50.5797896Z   activate-with-label: false
2024-10-08T20:11:50.5798258Z   label: with-ssh
2024-10-08T20:11:50.5798574Z   remove-existing-keys: true
2024-10-08T20:11:50.5798928Z   fail-silently: true
2024-10-08T20:11:50.5799238Z env:
2024-10-08T20:11:50.5799507Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:11:50.5799870Z ##[endgroup]
2024-10-08T20:11:50.6692551Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info.
2024-10-08T20:11:51.0072256Z Grabbing public ssh keys from https://github.com/kwen2501.keys
2024-10-08T20:11:51.0678847Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh
2024-10-08T20:11:51.0700176Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys
2024-10-08T20:11:51.0727453Z Login using: ssh ec2-user@ec2-3-230-166-242.compute-1.amazonaws.com
2024-10-08T20:11:51.0728279Z All testing is done inside the container, to start an interactive session run:
2024-10-08T20:11:51.0729159Z   docker exec -it $(docker container ps --format '{{.ID}}') bash
2024-10-08T20:11:51.0856396Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main
2024-10-08T20:11:51.0856960Z with:
2024-10-08T20:11:51.0857229Z   submodules: recursive
2024-10-08T20:11:51.0857564Z   fetch-depth: 0
2024-10-08T20:11:51.0857833Z env:
2024-10-08T20:11:51.0858112Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:11:51.0858453Z ##[endgroup]
2024-10-08T20:11:51.1060434Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:11:51.1061869Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:11:51.1072057Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:11:51.1072593Z env:
2024-10-08T20:11:51.1072871Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:11:51.1073209Z ##[endgroup]
2024-10-08T20:11:51.1162223Z ##[group]Run retry () {
2024-10-08T20:11:51.1162653Z retry () {
2024-10-08T20:11:51.1163169Z   $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*)
2024-10-08T20:11:51.1163742Z }
2024-10-08T20:11:51.1164052Z echo "${GITHUB_WORKSPACE}"
2024-10-08T20:11:51.1164492Z if [ -z "${NO_SUDO}" ]; then
2024-10-08T20:11:51.1164985Z   retry sudo rm -rf "${GITHUB_WORKSPACE}"
2024-10-08T20:11:51.1165460Z else
2024-10-08T20:11:51.1165807Z   retry rm -rf "${GITHUB_WORKSPACE}"
2024-10-08T20:11:51.1166244Z fi
2024-10-08T20:11:51.1166539Z mkdir "${GITHUB_WORKSPACE}"
2024-10-08T20:11:51.1172340Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:11:51.1172970Z env:
2024-10-08T20:11:51.1173243Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:11:51.1173734Z   NO_SUDO: 
2024-10-08T20:11:51.1174000Z ##[endgroup]
2024-10-08T20:11:51.1227849Z /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T20:11:53.3603869Z ##[group]Run malfet/checkout@silent-checkout
2024-10-08T20:11:53.3604308Z with:
2024-10-08T20:11:53.3604632Z   ref: 47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:11:53.3605086Z   fetch-depth: 0
2024-10-08T20:11:53.3605380Z   submodules: recursive
2024-10-08T20:11:53.3605718Z   quiet-checkout: true
2024-10-08T20:11:53.3606253Z   repository: pytorch/pytorch
2024-10-08T20:11:53.3606754Z   token: ***
2024-10-08T20:11:53.3607023Z   ssh-strict: true
2024-10-08T20:11:53.3607342Z   persist-credentials: true
2024-10-08T20:11:53.3607698Z   clean: true
2024-10-08T20:11:53.3608011Z   sparse-checkout-cone-mode: true
2024-10-08T20:11:53.3608390Z   lfs: false
2024-10-08T20:11:53.3608682Z   set-safe-directory: true
2024-10-08T20:11:53.3609014Z env:
2024-10-08T20:11:53.3609275Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:11:53.3609598Z ##[endgroup]
2024-10-08T20:11:53.4596075Z Syncing repository: pytorch/pytorch
2024-10-08T20:11:53.4597877Z ##[group]Getting Git version info
2024-10-08T20:11:53.4598775Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-10-08T20:11:53.4599691Z [command]/usr/bin/git version
2024-10-08T20:11:53.4600065Z git version 2.40.1
2024-10-08T20:11:53.4601436Z ##[endgroup]
2024-10-08T20:11:53.4613760Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/4e211f61-4694-48a9-926e-48abd81bbb0e' before making global git config changes
2024-10-08T20:11:53.4615133Z Adding repository directory to the temporary git global config as a safe directory
2024-10-08T20:11:53.4616361Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T20:11:53.4656281Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-10-08T20:11:53.4660287Z ##[group]Initializing the repository
2024-10-08T20:11:53.4663413Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T20:11:53.4750528Z hint: Using 'master' as the name for the initial branch. This default branch name
2024-10-08T20:11:53.4751746Z hint: is subject to change. To configure the initial branch name to use in all
2024-10-08T20:11:53.4752619Z hint: of your new repositories, which will suppress this warning, call:
2024-10-08T20:11:53.4753235Z hint: 
2024-10-08T20:11:53.4753690Z hint: 	git config --global init.defaultBranch <name>
2024-10-08T20:11:53.4754198Z hint: 
2024-10-08T20:11:53.4754744Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2024-10-08T20:11:53.4755659Z hint: 'development'. The just-created branch can be renamed via this command:
2024-10-08T20:11:53.4756264Z hint: 
2024-10-08T20:11:53.4756591Z hint: 	git branch -m <name>
2024-10-08T20:11:53.4757422Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/
2024-10-08T20:11:53.4760679Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch
2024-10-08T20:11:53.4800395Z ##[endgroup]
2024-10-08T20:11:53.4800987Z ##[group]Disabling automatic garbage collection
2024-10-08T20:11:53.4804012Z [command]/usr/bin/git config --local gc.auto 0
2024-10-08T20:11:53.4836680Z ##[endgroup]
2024-10-08T20:11:53.4837198Z ##[group]Setting up auth
2024-10-08T20:11:53.4843344Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-10-08T20:11:53.4873917Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-10-08T20:11:53.5138588Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-10-08T20:11:53.5170025Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-10-08T20:11:53.5439041Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-10-08T20:11:53.5486612Z ##[endgroup]
2024-10-08T20:11:53.5487241Z ##[group]Fetching the repository
2024-10-08T20:11:53.5493788Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/*
2024-10-08T20:11:56.0949874Z remote: Enumerating objects: 1011020        
2024-10-08T20:11:56.0951043Z remote: Enumerating objects: 1011998, done.        
2024-10-08T20:11:56.0951839Z remote: Counting objects:   0% (1/978)        
2024-10-08T20:11:56.0952854Z remote: Counting objects:   1% (10/978)        
2024-10-08T20:11:56.0953841Z remote: Counting objects:   2% (20/978)        
2024-10-08T20:11:56.0955057Z remote: Counting objects:   3% (30/978)        
2024-10-08T20:11:56.0956106Z remote: Counting objects:   4% (40/978)        
2024-10-08T20:11:56.0957133Z remote: Counting objects:   5% (49/978)        
2024-10-08T20:11:56.0958254Z remote: Counting objects:   6% (59/978)        
2024-10-08T20:11:56.0959330Z remote: Counting objects:   7% (69/978)        
2024-10-08T20:11:56.0960226Z remote: Counting objects:   8% (79/978)        
2024-10-08T20:11:56.0961219Z remote: Counting objects:   9% (89/978)        
2024-10-08T20:11:56.0962174Z remote: Counting objects:  10% (98/978)        
2024-10-08T20:11:56.0963093Z remote: Counting objects:  11% (108/978)        
2024-10-08T20:11:56.0964038Z remote: Counting objects:  12% (118/978)        
2024-10-08T20:11:56.0964938Z remote: Counting objects:  13% (128/978)        
2024-10-08T20:11:56.0965720Z remote: Counting objects:  14% (137/978)        
2024-10-08T20:11:56.0966557Z remote: Counting objects:  15% (147/978)        
2024-10-08T20:11:56.0967404Z remote: Counting objects:  16% (157/978)        
2024-10-08T20:11:56.0968329Z remote: Counting objects:  17% (167/978)        
2024-10-08T20:11:56.0968851Z remote: Counting objects:  18% (177/978)        
2024-10-08T20:11:56.0969358Z remote: Counting objects:  19% (186/978)        
2024-10-08T20:11:56.0969856Z remote: Counting objects:  20% (196/978)        
2024-10-08T20:11:56.0970713Z remote: Counting objects:  21% (206/978)        
2024-10-08T20:11:56.0971230Z remote: Counting objects:  22% (216/978)        
2024-10-08T20:11:56.0971738Z remote: Counting objects:  23% (225/978)        
2024-10-08T20:11:56.0972233Z remote: Counting objects:  24% (235/978)        
2024-10-08T20:11:56.0972864Z remote: Counting objects:  25% (245/978)        
2024-10-08T20:11:56.0973374Z remote: Counting objects:  26% (255/978)        
2024-10-08T20:11:56.0973878Z remote: Counting objects:  27% (265/978)        
2024-10-08T20:11:56.0974371Z remote: Counting objects:  28% (274/978)        
2024-10-08T20:11:56.0974878Z remote: Counting objects:  29% (284/978)        
2024-10-08T20:11:56.0975386Z remote: Counting objects:  30% (294/978)        
2024-10-08T20:11:56.0975893Z remote: Counting objects:  31% (304/978)        
2024-10-08T20:11:56.0976386Z remote: Counting objects:  32% (313/978)        
2024-10-08T20:11:56.0976894Z remote: Counting objects:  33% (323/978)        
2024-10-08T20:11:56.0977407Z remote: Counting objects:  34% (333/978)        
2024-10-08T20:11:56.0977912Z remote: Counting objects:  35% (343/978)        
2024-10-08T20:11:56.0978405Z remote: Counting objects:  36% (353/978)        
2024-10-08T20:11:56.0978912Z remote: Counting objects:  37% (362/978)        
2024-10-08T20:11:56.0979420Z remote: Counting objects:  38% (372/978)        
2024-10-08T20:11:56.0979958Z remote: Counting objects:  39% (382/978)        
2024-10-08T20:11:56.0980450Z remote: Counting objects:  40% (392/978)        
2024-10-08T20:11:56.0980955Z remote: Counting objects:  41% (401/978)        
2024-10-08T20:11:56.0981465Z remote: Counting objects:  42% (411/978)        
2024-10-08T20:11:56.0981970Z remote: Counting objects:  43% (421/978)        
2024-10-08T20:11:56.0982462Z remote: Counting objects:  44% (431/978)        
2024-10-08T20:11:56.0982968Z remote: Counting objects:  45% (441/978)        
2024-10-08T20:11:56.0983473Z remote: Counting objects:  46% (450/978)        
2024-10-08T20:11:56.0983981Z remote: Counting objects:  47% (460/978)        
2024-10-08T20:11:56.0984474Z remote: Counting objects:  48% (470/978)        
2024-10-08T20:11:56.0984985Z remote: Counting objects:  49% (480/978)        
2024-10-08T20:11:56.0985493Z remote: Counting objects:  50% (489/978)        
2024-10-08T20:11:56.0986128Z remote: Counting objects:  51% (499/978)        
2024-10-08T20:11:56.0986621Z remote: Counting objects:  52% (509/978)        
2024-10-08T20:11:56.0987130Z remote: Counting objects:  53% (519/978)        
2024-10-08T20:11:56.0987636Z remote: Counting objects:  54% (529/978)        
2024-10-08T20:11:56.0988138Z remote: Counting objects:  55% (538/978)        
2024-10-08T20:11:56.0988883Z remote: Counting objects:  56% (548/978)        
2024-10-08T20:11:56.0989399Z remote: Counting objects:  57% (558/978)        
2024-10-08T20:11:56.0989906Z remote: Counting objects:  58% (568/978)        
2024-10-08T20:11:56.0990415Z remote: Counting objects:  59% (578/978)        
2024-10-08T20:11:56.0990914Z remote: Counting objects:  60% (587/978)        
2024-10-08T20:11:56.0991422Z remote: Counting objects:  61% (597/978)        
2024-10-08T20:11:56.0991928Z remote: Counting objects:  62% (607/978)        
2024-10-08T20:11:56.0992451Z remote: Counting objects:  63% (617/978)        
2024-10-08T20:11:56.0992957Z remote: Counting objects:  64% (626/978)        
2024-10-08T20:11:56.0993448Z remote: Counting objects:  65% (636/978)        
2024-10-08T20:11:56.0993951Z remote: Counting objects:  66% (646/978)        
2024-10-08T20:11:56.0994458Z remote: Counting objects:  67% (656/978)        
2024-10-08T20:11:56.0994950Z remote: Counting objects:  68% (666/978)        
2024-10-08T20:11:56.0995452Z remote: Counting objects:  69% (675/978)        
2024-10-08T20:11:56.0995955Z remote: Counting objects:  70% (685/978)        
2024-10-08T20:11:56.0996460Z remote: Counting objects:  71% (695/978)        
2024-10-08T20:11:56.0996952Z remote: Counting objects:  72% (705/978)        
2024-10-08T20:11:56.0997570Z remote: Counting objects:  73% (714/978)        
2024-10-08T20:11:56.0998079Z remote: Counting objects:  74% (724/978)        
2024-10-08T20:11:56.0998586Z remote: Counting objects:  75% (734/978)        
2024-10-08T20:11:56.0999078Z remote: Counting objects:  76% (744/978)        
2024-10-08T20:11:56.0999587Z remote: Counting objects:  77% (754/978)        
2024-10-08T20:11:56.1000090Z remote: Counting objects:  78% (763/978)        
2024-10-08T20:11:56.1000593Z remote: Counting objects:  79% (773/978)        
2024-10-08T20:11:56.1001083Z remote: Counting objects:  80% (783/978)        
2024-10-08T20:11:56.1001588Z remote: Counting objects:  81% (793/978)        
2024-10-08T20:11:56.1002091Z remote: Counting objects:  82% (802/978)        
2024-10-08T20:11:56.1002594Z remote: Counting objects:  83% (812/978)        
2024-10-08T20:11:56.1003086Z remote: Counting objects:  84% (822/978)        
2024-10-08T20:11:56.1003588Z remote: Counting objects:  85% (832/978)        
2024-10-08T20:11:56.1004093Z remote: Counting objects:  86% (842/978)        
2024-10-08T20:11:56.1004595Z remote: Counting objects:  87% (851/978)        
2024-10-08T20:11:56.1005086Z remote: Counting objects:  88% (861/978)        
2024-10-08T20:11:56.1005591Z remote: Counting objects:  89% (871/978)        
2024-10-08T20:11:56.1006102Z remote: Counting objects:  90% (881/978)        
2024-10-08T20:11:56.1006602Z remote: Counting objects:  91% (890/978)        
2024-10-08T20:11:56.1007095Z remote: Counting objects:  92% (900/978)        
2024-10-08T20:11:56.1007596Z remote: Counting objects:  93% (910/978)        
2024-10-08T20:11:56.1008105Z remote: Counting objects:  94% (920/978)        
2024-10-08T20:11:56.1008605Z remote: Counting objects:  95% (930/978)        
2024-10-08T20:11:56.1009094Z remote: Counting objects:  96% (939/978)        
2024-10-08T20:11:56.1009601Z remote: Counting objects:  97% (949/978)        
2024-10-08T20:11:56.1010104Z remote: Counting objects:  98% (959/978)        
2024-10-08T20:11:56.1010608Z remote: Counting objects:  99% (969/978)        
2024-10-08T20:11:56.1011105Z remote: Counting objects: 100% (978/978)        
2024-10-08T20:11:56.1011647Z remote: Counting objects: 100% (978/978), done.        
2024-10-08T20:11:56.1176746Z remote: Compressing objects:   0% (1/506)        
2024-10-08T20:11:56.1629278Z remote: Compressing objects:   1% (6/506)        
2024-10-08T20:11:56.1791415Z remote: Compressing objects:   2% (11/506)        
2024-10-08T20:11:56.1875052Z remote: Compressing objects:   3% (16/506)        
2024-10-08T20:11:56.2188257Z remote: Compressing objects:   4% (21/506)        
2024-10-08T20:11:56.2481485Z remote: Compressing objects:   5% (26/506)        
2024-10-08T20:11:56.2836132Z remote: Compressing objects:   6% (31/506)        
2024-10-08T20:11:56.3112891Z remote: Compressing objects:   7% (36/506)        
2024-10-08T20:11:56.3385803Z remote: Compressing objects:   8% (41/506)        
2024-10-08T20:11:56.3504288Z remote: Compressing objects:   9% (46/506)        
2024-10-08T20:11:56.3574043Z remote: Compressing objects:  10% (51/506)        
2024-10-08T20:11:56.3651299Z remote: Compressing objects:  11% (56/506)        
2024-10-08T20:11:56.3716626Z remote: Compressing objects:  12% (61/506)        
2024-10-08T20:11:56.3880417Z remote: Compressing objects:  13% (66/506)        
2024-10-08T20:11:56.3974407Z remote: Compressing objects:  14% (71/506)        
2024-10-08T20:11:56.4056372Z remote: Compressing objects:  15% (76/506)        
2024-10-08T20:11:56.4099265Z remote: Compressing objects:  16% (81/506)        
2024-10-08T20:11:56.4130442Z remote: Compressing objects:  17% (87/506)        
2024-10-08T20:11:56.4165926Z remote: Compressing objects:  18% (92/506)        
2024-10-08T20:11:56.4179806Z remote: Compressing objects:  19% (97/506)        
2024-10-08T20:11:56.4200486Z remote: Compressing objects:  20% (102/506)        
2024-10-08T20:11:56.4217095Z remote: Compressing objects:  21% (107/506)        
2024-10-08T20:11:56.4230663Z remote: Compressing objects:  22% (112/506)        
2024-10-08T20:11:56.4238417Z remote: Compressing objects:  23% (117/506)        
2024-10-08T20:11:56.4240601Z remote: Compressing objects:  24% (122/506)        
2024-10-08T20:11:56.4243418Z remote: Compressing objects:  25% (127/506)        
2024-10-08T20:11:56.4244354Z remote: Compressing objects:  26% (132/506)        
2024-10-08T20:11:56.4245448Z remote: Compressing objects:  27% (137/506)        
2024-10-08T20:11:56.4247873Z remote: Compressing objects:  28% (142/506)        
2024-10-08T20:11:56.4253011Z remote: Compressing objects:  29% (147/506)        
2024-10-08T20:11:56.4256346Z remote: Compressing objects:  30% (152/506)        
2024-10-08T20:11:56.4257372Z remote: Compressing objects:  31% (157/506)        
2024-10-08T20:11:56.4260226Z remote: Compressing objects:  32% (162/506)        
2024-10-08T20:11:56.4262098Z remote: Compressing objects:  33% (167/506)        
2024-10-08T20:11:56.4266909Z remote: Compressing objects:  34% (173/506)        
2024-10-08T20:11:56.4274498Z remote: Compressing objects:  35% (178/506)        
2024-10-08T20:11:56.4285309Z remote: Compressing objects:  36% (183/506)        
2024-10-08T20:11:56.4286479Z remote: Compressing objects:  37% (188/506)        
2024-10-08T20:11:56.4293473Z remote: Compressing objects:  38% (193/506)        
2024-10-08T20:11:56.4296282Z remote: Compressing objects:  39% (198/506)        
2024-10-08T20:11:56.4301411Z remote: Compressing objects:  40% (203/506)        
2024-10-08T20:11:56.4304598Z remote: Compressing objects:  41% (208/506)        
2024-10-08T20:11:56.4311444Z remote: Compressing objects:  42% (213/506)        
2024-10-08T20:11:56.4312319Z remote: Compressing objects:  43% (218/506)        
2024-10-08T20:11:56.4315779Z remote: Compressing objects:  44% (223/506)        
2024-10-08T20:11:56.4317925Z remote: Compressing objects:  45% (228/506)        
2024-10-08T20:11:56.4318846Z remote: Compressing objects:  46% (233/506)        
2024-10-08T20:11:56.4319719Z remote: Compressing objects:  47% (238/506)        
2024-10-08T20:11:56.4322384Z remote: Compressing objects:  48% (243/506)        
2024-10-08T20:11:56.4323482Z remote: Compressing objects:  49% (248/506)        
2024-10-08T20:11:56.4324684Z remote: Compressing objects:  50% (253/506)        
2024-10-08T20:11:56.4326235Z remote: Compressing objects:  51% (259/506)        
2024-10-08T20:11:56.4327709Z remote: Compressing objects:  52% (264/506)        
2024-10-08T20:11:56.4329095Z remote: Compressing objects:  53% (269/506)        
2024-10-08T20:11:56.4330646Z remote: Compressing objects:  54% (274/506)        
2024-10-08T20:11:56.4331642Z remote: Compressing objects:  55% (279/506)        
2024-10-08T20:11:56.4332721Z remote: Compressing objects:  56% (284/506)        
2024-10-08T20:11:56.4333718Z remote: Compressing objects:  57% (289/506)        
2024-10-08T20:11:56.4334734Z remote: Compressing objects:  58% (294/506)        
2024-10-08T20:11:56.4335729Z remote: Compressing objects:  59% (299/506)        
2024-10-08T20:11:56.4336729Z remote: Compressing objects:  60% (304/506)        
2024-10-08T20:11:56.4337353Z remote: Compressing objects:  61% (309/506)        
2024-10-08T20:11:56.4338093Z remote: Compressing objects:  62% (314/506)        
2024-10-08T20:11:56.4338829Z remote: Compressing objects:  63% (319/506)        
2024-10-08T20:11:56.4339369Z remote: Compressing objects:  64% (324/506)        
2024-10-08T20:11:56.4339916Z remote: Compressing objects:  65% (329/506)        
2024-10-08T20:11:56.4340457Z remote: Compressing objects:  66% (334/506)        
2024-10-08T20:11:56.4341044Z remote: Compressing objects:  67% (340/506)        
2024-10-08T20:11:56.4341668Z remote: Compressing objects:  68% (345/506)        
2024-10-08T20:11:56.4342535Z remote: Compressing objects:  69% (350/506)        
2024-10-08T20:11:56.4347966Z remote: Compressing objects:  70% (355/506)        
2024-10-08T20:11:56.4351034Z remote: Compressing objects:  71% (360/506)        
2024-10-08T20:11:56.4353562Z remote: Compressing objects:  72% (365/506)        
2024-10-08T20:11:56.4355057Z remote: Compressing objects:  73% (370/506)        
2024-10-08T20:11:56.4357411Z remote: Compressing objects:  74% (375/506)        
2024-10-08T20:11:56.4359365Z remote: Compressing objects:  75% (380/506)        
2024-10-08T20:11:56.4360666Z remote: Compressing objects:  76% (385/506)        
2024-10-08T20:11:56.4361739Z remote: Compressing objects:  77% (390/506)        
2024-10-08T20:11:56.4362757Z remote: Compressing objects:  78% (395/506)        
2024-10-08T20:11:56.4363602Z remote: Compressing objects:  79% (400/506)        
2024-10-08T20:11:56.4364742Z remote: Compressing objects:  80% (405/506)        
2024-10-08T20:11:56.4365749Z remote: Compressing objects:  81% (410/506)        
2024-10-08T20:11:56.4366657Z remote: Compressing objects:  82% (415/506)        
2024-10-08T20:11:56.4367969Z remote: Compressing objects:  83% (420/506)        
2024-10-08T20:11:56.4369380Z remote: Compressing objects:  84% (426/506)        
2024-10-08T20:11:56.4370388Z remote: Compressing objects:  85% (431/506)        
2024-10-08T20:11:56.4371140Z remote: Compressing objects:  86% (436/506)        
2024-10-08T20:11:56.4372351Z remote: Compressing objects:  87% (441/506)        
2024-10-08T20:11:56.4373459Z remote: Compressing objects:  88% (446/506)        
2024-10-08T20:11:56.4374401Z remote: Compressing objects:  89% (451/506)        
2024-10-08T20:11:56.4375244Z remote: Compressing objects:  90% (456/506)        
2024-10-08T20:11:56.4376258Z remote: Compressing objects:  91% (461/506)        
2024-10-08T20:11:56.4377272Z remote: Compressing objects:  92% (466/506)        
2024-10-08T20:11:56.4378287Z remote: Compressing objects:  93% (471/506)        
2024-10-08T20:11:56.4379290Z remote: Compressing objects:  94% (476/506)        
2024-10-08T20:11:56.4380293Z remote: Compressing objects:  95% (481/506)        
2024-10-08T20:11:56.4381169Z remote: Compressing objects:  96% (486/506)        
2024-10-08T20:11:56.4381708Z remote: Compressing objects:  97% (491/506)        
2024-10-08T20:11:56.4382238Z remote: Compressing objects:  98% (496/506)        
2024-10-08T20:11:56.4382780Z remote: Compressing objects:  99% (501/506)        
2024-10-08T20:11:56.4383323Z remote: Compressing objects: 100% (506/506)        
2024-10-08T20:11:56.4383920Z remote: Compressing objects: 100% (506/506), done.        
2024-10-08T20:12:18.0396487Z remote: Total 1011998 (delta 563), reused 815 (delta 469), pack-reused 1011020 (from 1)        
2024-10-08T20:12:47.0777570Z [command]/usr/bin/git rev-parse --verify --quiet 47952c0a8001fd60c9ffe52b121d022d440bef8b^{object}
2024-10-08T20:12:47.0807594Z 47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:12:47.0811923Z ##[endgroup]
2024-10-08T20:12:47.0812537Z ##[group]Determining the checkout info
2024-10-08T20:12:47.0813594Z ##[endgroup]
2024-10-08T20:12:47.0814170Z ##[group]Checking out the ref
2024-10-08T20:12:47.0818738Z [command]/usr/bin/git checkout --quiet --force 47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:12:48.5288776Z ##[endgroup]
2024-10-08T20:12:48.5289484Z ##[group]Setting up auth for fetching submodules
2024-10-08T20:12:48.5292217Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-10-08T20:12:48.5342356Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf
2024-10-08T20:12:48.5375544Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com:
2024-10-08T20:12:48.5408273Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com:
2024-10-08T20:12:48.5436870Z ##[endgroup]
2024-10-08T20:12:48.5437394Z ##[group]Fetching submodules
2024-10-08T20:12:48.5440847Z [command]/usr/bin/git submodule sync --recursive
2024-10-08T20:12:48.5736291Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive
2024-10-08T20:12:48.6027405Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni'
2024-10-08T20:12:48.6029708Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16'
2024-10-08T20:12:48.6031692Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv'
2024-10-08T20:12:48.6033388Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK'
2024-10-08T20:12:48.6034994Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX'
2024-10-08T20:12:48.6037225Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator'
2024-10-08T20:12:48.6039504Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK'
2024-10-08T20:12:48.6042382Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
2024-10-08T20:12:48.6045317Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib'
2024-10-08T20:12:48.6048238Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo'
2024-10-08T20:12:48.6051504Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend'
2024-10-08T20:12:48.6054656Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass'
2024-10-08T20:12:48.6058054Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen'
2024-10-08T20:12:48.6061444Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm'
2024-10-08T20:12:48.6065137Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers'
2024-10-08T20:12:48.6069611Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt'
2024-10-08T20:12:48.6075229Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:12:48.6079003Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo'
2024-10-08T20:12:48.6082979Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
2024-10-08T20:12:48.6086966Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep'
2024-10-08T20:12:48.6091819Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi'
2024-10-08T20:12:48.6096195Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto'
2024-10-08T20:12:48.6100729Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc'
2024-10-08T20:12:48.6104924Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl'
2024-10-08T20:12:48.6109477Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann'
2024-10-08T20:12:48.6113872Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx'
2024-10-08T20:12:48.6118928Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp'
2024-10-08T20:12:48.6123419Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft'
2024-10-08T20:12:48.6128345Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf'
2024-10-08T20:12:48.6133524Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd'
2024-10-08T20:12:48.6165217Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool'
2024-10-08T20:12:48.6167487Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
2024-10-08T20:12:48.6169033Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy'
2024-10-08T20:12:48.6170480Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef'
2024-10-08T20:12:48.6171908Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe'
2024-10-08T20:12:48.6193702Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'...
2024-10-08T20:12:48.9183353Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'...
2024-10-08T20:12:49.1114990Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'...
2024-10-08T20:12:49.3118308Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'...
2024-10-08T20:12:49.5962880Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'...
2024-10-08T20:12:49.9416068Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'...
2024-10-08T20:12:52.2580437Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'...
2024-10-08T20:13:06.0457647Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'...
2024-10-08T20:13:06.5099275Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'...
2024-10-08T20:13:07.1072823Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'...
2024-10-08T20:13:07.7318349Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'...
2024-10-08T20:13:09.0031021Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'...
2024-10-08T20:13:10.9121168Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'...
2024-10-08T20:13:16.5385941Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'...
2024-10-08T20:13:18.2248878Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'...
2024-10-08T20:13:20.0656726Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'...
2024-10-08T20:13:21.8330917Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'...
2024-10-08T20:13:22.3002766Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'...
2024-10-08T20:13:22.6737427Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'...
2024-10-08T20:13:24.2444924Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'...
2024-10-08T20:13:24.6534794Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'...
2024-10-08T20:13:24.9158099Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'...
2024-10-08T20:13:26.5064724Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'...
2024-10-08T20:13:27.2727159Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'...
2024-10-08T20:13:27.7174648Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'...
2024-10-08T20:13:34.3873155Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'...
2024-10-08T20:13:37.1140646Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'...
2024-10-08T20:13:44.9071730Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'...
2024-10-08T20:13:45.1877432Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'...
2024-10-08T20:13:55.5822620Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'...
2024-10-08T20:13:55.7997613Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'...
2024-10-08T20:13:56.0510067Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'...
2024-10-08T20:13:58.3189311Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'...
2024-10-08T20:13:58.6394203Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'...
2024-10-08T20:13:59.3965974Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'...
2024-10-08T20:13:59.8811666Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f'
2024-10-08T20:13:59.8932023Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3'
2024-10-08T20:13:59.9023712Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1'
2024-10-08T20:13:59.9264145Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73'
2024-10-08T20:13:59.9567245Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1'
2024-10-08T20:13:59.9931477Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191'
2024-10-08T20:14:00.7917474Z Submodule path 'third_party/XNNPACK': checked out '87ee0b46b834f67bad9025d4a82ed5654f3403d3'
2024-10-08T20:14:00.8152940Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415'
2024-10-08T20:14:00.8630059Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006'
2024-10-08T20:14:00.9624052Z Submodule path 'third_party/cpuinfo': checked out 'a5ff6df40ce528721cfc310c7ed43946d77404d5'
2024-10-08T20:14:00.9969367Z Submodule path 'third_party/cudnn_frontend': checked out '2533f5e5c1877fd76266133c1479ef1643ce3a8b'
2024-10-08T20:14:01.5096959Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49'
2024-10-08T20:14:01.7688199Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c'
2024-10-08T20:14:01.8585861Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e'
2024-10-08T20:14:01.8605100Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:14:01.8606989Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:14:01.8609435Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:14:01.8612076Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:14:01.8615020Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:14:01.8642541Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'...
2024-10-08T20:14:02.9405449Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'...
2024-10-08T20:14:03.6405622Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'...
2024-10-08T20:14:05.6001578Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'...
2024-10-08T20:14:06.7707295Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'...
2024-10-08T20:14:07.1360696Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81'
2024-10-08T20:14:07.2336044Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3'
2024-10-08T20:14:07.6446701Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6'
2024-10-08T20:14:07.7084860Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796'
2024-10-08T20:14:07.7217614Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1'
2024-10-08T20:14:07.8423691Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b'
2024-10-08T20:14:07.8815501Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592'
2024-10-08T20:14:07.9226669Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350'
2024-10-08T20:14:07.9487675Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509'
2024-10-08T20:14:07.9947991Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
2024-10-08T20:14:08.0078000Z Submodule path 'third_party/ideep': checked out '41d636c2bbcea6bff0faf97cdb65a48cdde987af'
2024-10-08T20:14:08.0092574Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn'
2024-10-08T20:14:08.0116479Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'...
2024-10-08T20:14:20.8664746Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af'
2024-10-08T20:14:20.8858220Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42'
2024-10-08T20:14:20.9767991Z Submodule path 'third_party/kineto': checked out 'b5c85daac1ee123aa7f04eb6f2bc71363f429e68'
2024-10-08T20:14:20.9786293Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:14:20.9788847Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:14:20.9790970Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:14:20.9817758Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'...
2024-10-08T20:14:21.5797483Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'...
2024-10-08T20:14:23.1064047Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'...
2024-10-08T20:14:24.3120681Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e'
2024-10-08T20:14:24.3137078Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:14:24.3139875Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:14:24.3142744Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:14:24.3146019Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:14:24.3148887Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:14:24.3152185Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:14:24.3155345Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:14:24.3158730Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:14:24.3187772Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'...
2024-10-08T20:14:25.1719589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'...
2024-10-08T20:14:25.5699051Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'...
2024-10-08T20:14:27.1839077Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'...
2024-10-08T20:14:27.5267662Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'...
2024-10-08T20:14:28.1606461Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'...
2024-10-08T20:14:29.3076065Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'...
2024-10-08T20:14:37.3153215Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'...
2024-10-08T20:14:37.8151679Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9'
2024-10-08T20:14:37.8338833Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400'
2024-10-08T20:14:37.8719399Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05'
2024-10-08T20:14:37.8861007Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067'
2024-10-08T20:14:37.8875646Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:14:37.8902937Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'...
2024-10-08T20:14:38.3250842Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4'
2024-10-08T20:14:38.3442289Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446'
2024-10-08T20:14:38.3861803Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850'
2024-10-08T20:14:38.4942458Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5'
2024-10-08T20:14:38.5118573Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150'
2024-10-08T20:14:38.5517789Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164'
2024-10-08T20:14:38.6128209Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347'
2024-10-08T20:14:38.6526510Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78'
2024-10-08T20:14:38.6831140Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290'
2024-10-08T20:14:38.7890803Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806'
2024-10-08T20:14:39.1504221Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557'
2024-10-08T20:14:39.1538176Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark'
2024-10-08T20:14:39.1540119Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11'
2024-10-08T20:14:39.1567699Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'...
2024-10-08T20:14:39.8153307Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'...
2024-10-08T20:14:40.9119162Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6'
2024-10-08T20:14:40.9470537Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242'
2024-10-08T20:14:41.0169354Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878'
2024-10-08T20:14:41.0190305Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:14:41.0192609Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:14:41.0194806Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:14:41.0197000Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:14:41.0199850Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:14:41.0202606Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:14:41.0205280Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:14:41.0207977Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:14:41.0235817Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'...
2024-10-08T20:14:41.4718889Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'...
2024-10-08T20:14:42.5866958Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'...
2024-10-08T20:14:42.9254732Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'...
2024-10-08T20:14:49.6608013Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'...
2024-10-08T20:14:49.9699541Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'...
2024-10-08T20:14:50.2225071Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'...
2024-10-08T20:14:50.5434351Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'...
2024-10-08T20:14:57.8025389Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2'
2024-10-08T20:14:57.8431818Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1'
2024-10-08T20:14:57.8589761Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa'
2024-10-08T20:14:57.9593971Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d'
2024-10-08T20:14:57.9727194Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce'
2024-10-08T20:14:57.9872866Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5'
2024-10-08T20:14:58.0032651Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d'
2024-10-08T20:14:58.0047943Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:14:58.0050156Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:14:58.0076750Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'...
2024-10-08T20:15:00.3195962Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'...
2024-10-08T20:15:01.7629627Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4'
2024-10-08T20:15:01.8107287Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
2024-10-08T20:15:02.2731642Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50'
2024-10-08T20:15:02.2853543Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe'
2024-10-08T20:15:02.5687776Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a'
2024-10-08T20:15:02.5710797Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:02.5713194Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:02.5739946Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'...
2024-10-08T20:15:03.0497420Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'...
2024-10-08T20:15:04.2556071Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
2024-10-08T20:15:04.3293355Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081'
2024-10-08T20:15:04.3384419Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900'
2024-10-08T20:15:04.3507974Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8'
2024-10-08T20:15:04.3864112Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4'
2024-10-08T20:15:04.4154013Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67'
2024-10-08T20:15:04.4581322Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b'
2024-10-08T20:15:04.4854503Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e'
2024-10-08T20:15:04.4871568Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:04.4873697Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:04.4876214Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:04.4878801Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:04.4906199Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'...
2024-10-08T20:15:05.6653943Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'...
2024-10-08T20:15:06.0326911Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'...
2024-10-08T20:15:07.4347720Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'...
2024-10-08T20:15:08.5753727Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e'
2024-10-08T20:15:08.5911894Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281'
2024-10-08T20:15:08.6624875Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242'
2024-10-08T20:15:08.6919607Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef'
2024-10-08T20:15:08.6933974Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:08.6960262Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'...
2024-10-08T20:15:08.9329153Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
2024-10-08T20:15:08.9364533Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0
2024-10-08T20:15:08.9669484Z Entering 'android/libs/fbjni'
2024-10-08T20:15:08.9711650Z Entering 'third_party/FP16'
2024-10-08T20:15:08.9755504Z Entering 'third_party/FXdiv'
2024-10-08T20:15:08.9797357Z Entering 'third_party/NNPACK'
2024-10-08T20:15:08.9839519Z Entering 'third_party/NVTX'
2024-10-08T20:15:08.9880446Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T20:15:08.9922128Z Entering 'third_party/XNNPACK'
2024-10-08T20:15:08.9981251Z Entering 'third_party/benchmark'
2024-10-08T20:15:09.0023093Z Entering 'third_party/cpp-httplib'
2024-10-08T20:15:09.0064594Z Entering 'third_party/cpuinfo'
2024-10-08T20:15:09.0106859Z Entering 'third_party/cudnn_frontend'
2024-10-08T20:15:09.0148801Z Entering 'third_party/cutlass'
2024-10-08T20:15:09.0199329Z Entering 'third_party/eigen'
2024-10-08T20:15:09.0242652Z Entering 'third_party/fbgemm'
2024-10-08T20:15:09.0283013Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:15:09.0322653Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:15:09.0362959Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:15:09.0410185Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:15:09.0449547Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:15:09.0490442Z Entering 'third_party/flatbuffers'
2024-10-08T20:15:09.0535345Z Entering 'third_party/fmt'
2024-10-08T20:15:09.0575303Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:15:09.0615597Z Entering 'third_party/gloo'
2024-10-08T20:15:09.0658168Z Entering 'third_party/googletest'
2024-10-08T20:15:09.0699217Z Entering 'third_party/ideep'
2024-10-08T20:15:09.0739004Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T20:15:09.0789057Z Entering 'third_party/ittapi'
2024-10-08T20:15:09.0828185Z Entering 'third_party/kineto'
2024-10-08T20:15:09.0868972Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:15:09.0910112Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:15:09.0951442Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:15:09.0991875Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:15:09.1031584Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:15:09.1070770Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:15:09.1113714Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:15:09.1153825Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:15:09.1193418Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:15:09.1233990Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:15:09.1275634Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:15:09.1318056Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:15:09.1358478Z Entering 'third_party/mimalloc'
2024-10-08T20:15:09.1399117Z Entering 'third_party/nccl/nccl'
2024-10-08T20:15:09.1439385Z Entering 'third_party/nlohmann'
2024-10-08T20:15:09.1480115Z Entering 'third_party/onnx'
2024-10-08T20:15:09.1537126Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T20:15:09.1576729Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T20:15:09.1619464Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T20:15:09.1661134Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:15:09.1700824Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:15:09.1740136Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:15:09.1779129Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:15:09.1821835Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:15:09.1860750Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:15:09.1900017Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:15:09.1938391Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:15:09.1979762Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:15:09.2020697Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:15:09.2080454Z Entering 'third_party/pocketfft'
2024-10-08T20:15:09.2121854Z Entering 'third_party/protobuf'
2024-10-08T20:15:09.2164771Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:09.2203777Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:09.2245585Z Entering 'third_party/psimd'
2024-10-08T20:15:09.2285337Z Entering 'third_party/pthreadpool'
2024-10-08T20:15:09.2326366Z Entering 'third_party/pybind11'
2024-10-08T20:15:09.2366278Z Entering 'third_party/python-peachpy'
2024-10-08T20:15:09.2406507Z Entering 'third_party/sleef'
2024-10-08T20:15:09.2446527Z Entering 'third_party/tensorpipe'
2024-10-08T20:15:09.2486403Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:09.2526446Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:09.2566498Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:09.2607774Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:09.2648624Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:09.2707839Z ##[endgroup]
2024-10-08T20:15:09.2709877Z ##[group]Persisting credentials for submodules
2024-10-08T20:15:09.2713248Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :"
2024-10-08T20:15:09.3009445Z Entering 'android/libs/fbjni'
2024-10-08T20:15:09.3064079Z Entering 'third_party/FP16'
2024-10-08T20:15:09.3121272Z Entering 'third_party/FXdiv'
2024-10-08T20:15:09.3176126Z Entering 'third_party/NNPACK'
2024-10-08T20:15:09.3231085Z Entering 'third_party/NVTX'
2024-10-08T20:15:09.3285585Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T20:15:09.3339713Z Entering 'third_party/XNNPACK'
2024-10-08T20:15:09.3411004Z Entering 'third_party/benchmark'
2024-10-08T20:15:09.3465327Z Entering 'third_party/cpp-httplib'
2024-10-08T20:15:09.3519295Z Entering 'third_party/cpuinfo'
2024-10-08T20:15:09.3573461Z Entering 'third_party/cudnn_frontend'
2024-10-08T20:15:09.3627830Z Entering 'third_party/cutlass'
2024-10-08T20:15:09.3690418Z Entering 'third_party/eigen'
2024-10-08T20:15:09.3747409Z Entering 'third_party/fbgemm'
2024-10-08T20:15:09.3800982Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:15:09.3856788Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:15:09.3911139Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:15:09.3970976Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:15:09.4025162Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:15:09.4079470Z Entering 'third_party/flatbuffers'
2024-10-08T20:15:09.4139187Z Entering 'third_party/fmt'
2024-10-08T20:15:09.4196169Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:15:09.4250512Z Entering 'third_party/gloo'
2024-10-08T20:15:09.4303844Z Entering 'third_party/googletest'
2024-10-08T20:15:09.4356951Z Entering 'third_party/ideep'
2024-10-08T20:15:09.4408387Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T20:15:09.4469903Z Entering 'third_party/ittapi'
2024-10-08T20:15:09.4524218Z Entering 'third_party/kineto'
2024-10-08T20:15:09.4576953Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:15:09.4630587Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:15:09.4685573Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:15:09.4744844Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:15:09.4796722Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:15:09.4848075Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:15:09.4902457Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:15:09.4954166Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:15:09.5005586Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:15:09.5059016Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:15:09.5112760Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:15:09.5164639Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:15:09.5219214Z Entering 'third_party/mimalloc'
2024-10-08T20:15:09.5272756Z Entering 'third_party/nccl/nccl'
2024-10-08T20:15:09.5326006Z Entering 'third_party/nlohmann'
2024-10-08T20:15:09.5380124Z Entering 'third_party/onnx'
2024-10-08T20:15:09.5450088Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T20:15:09.5503478Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T20:15:09.5558943Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T20:15:09.5613909Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:15:09.5665416Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:15:09.5717295Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:15:09.5768332Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:15:09.5821823Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:15:09.5872724Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:15:09.5925236Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:15:09.5975985Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:15:09.6031224Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:15:09.6084718Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:15:09.6157106Z Entering 'third_party/pocketfft'
2024-10-08T20:15:09.6209644Z Entering 'third_party/protobuf'
2024-10-08T20:15:09.6265968Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:09.6318580Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:09.6372399Z Entering 'third_party/psimd'
2024-10-08T20:15:09.6425740Z Entering 'third_party/pthreadpool'
2024-10-08T20:15:09.6478359Z Entering 'third_party/pybind11'
2024-10-08T20:15:09.6532759Z Entering 'third_party/python-peachpy'
2024-10-08T20:15:09.6585299Z Entering 'third_party/sleef'
2024-10-08T20:15:09.6639999Z Entering 'third_party/tensorpipe'
2024-10-08T20:15:09.6692112Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:09.6744308Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:09.6797432Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:09.6850778Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:09.6902911Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:09.6974121Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url"
2024-10-08T20:15:09.7269499Z Entering 'android/libs/fbjni'
2024-10-08T20:15:09.7321032Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config	remote.origin.url
2024-10-08T20:15:09.7337163Z Entering 'third_party/FP16'
2024-10-08T20:15:09.7387798Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config	remote.origin.url
2024-10-08T20:15:09.7403304Z Entering 'third_party/FXdiv'
2024-10-08T20:15:09.7461345Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config	remote.origin.url
2024-10-08T20:15:09.7469267Z Entering 'third_party/NNPACK'
2024-10-08T20:15:09.7520288Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config	remote.origin.url
2024-10-08T20:15:09.7536272Z Entering 'third_party/NVTX'
2024-10-08T20:15:09.7587685Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config	remote.origin.url
2024-10-08T20:15:09.7604691Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T20:15:09.7655812Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config	remote.origin.url
2024-10-08T20:15:09.7671334Z Entering 'third_party/XNNPACK'
2024-10-08T20:15:09.7722098Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config	remote.origin.url
2024-10-08T20:15:09.7755183Z Entering 'third_party/benchmark'
2024-10-08T20:15:09.7806275Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config	remote.origin.url
2024-10-08T20:15:09.7822399Z Entering 'third_party/cpp-httplib'
2024-10-08T20:15:09.7873639Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config	remote.origin.url
2024-10-08T20:15:09.7889233Z Entering 'third_party/cpuinfo'
2024-10-08T20:15:09.7941028Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config	remote.origin.url
2024-10-08T20:15:09.7957184Z Entering 'third_party/cudnn_frontend'
2024-10-08T20:15:09.8008279Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config	remote.origin.url
2024-10-08T20:15:09.8024104Z Entering 'third_party/cutlass'
2024-10-08T20:15:09.8072642Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config	remote.origin.url
2024-10-08T20:15:09.8097469Z Entering 'third_party/eigen'
2024-10-08T20:15:09.8147224Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config	remote.origin.url
2024-10-08T20:15:09.8165271Z Entering 'third_party/fbgemm'
2024-10-08T20:15:09.8216881Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config	remote.origin.url
2024-10-08T20:15:09.8231715Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:15:09.8282561Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config	remote.origin.url
2024-10-08T20:15:09.8298170Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:15:09.8346547Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config	remote.origin.url
2024-10-08T20:15:09.8361977Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:15:09.8411361Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config	remote.origin.url
2024-10-08T20:15:09.8433484Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:15:09.8481499Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:09.8496789Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:15:09.8545166Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config	remote.origin.url
2024-10-08T20:15:09.8560973Z Entering 'third_party/flatbuffers'
2024-10-08T20:15:09.8611955Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config	remote.origin.url
2024-10-08T20:15:09.8630491Z Entering 'third_party/fmt'
2024-10-08T20:15:09.8677892Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config	remote.origin.url
2024-10-08T20:15:09.8694068Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:15:09.8742160Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config	remote.origin.url
2024-10-08T20:15:09.8757488Z Entering 'third_party/gloo'
2024-10-08T20:15:09.8805481Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config	remote.origin.url
2024-10-08T20:15:09.8821391Z Entering 'third_party/googletest'
2024-10-08T20:15:09.8869287Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:09.8884685Z Entering 'third_party/ideep'
2024-10-08T20:15:09.8933800Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config	remote.origin.url
2024-10-08T20:15:09.8947982Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T20:15:09.9000493Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config	remote.origin.url
2024-10-08T20:15:09.9022918Z Entering 'third_party/ittapi'
2024-10-08T20:15:09.9070771Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config	remote.origin.url
2024-10-08T20:15:09.9086683Z Entering 'third_party/kineto'
2024-10-08T20:15:09.9134977Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config	remote.origin.url
2024-10-08T20:15:09.9149802Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:15:09.9201406Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config	remote.origin.url
2024-10-08T20:15:09.9215868Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:15:09.9264719Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config	remote.origin.url
2024-10-08T20:15:09.9280603Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:15:09.9329223Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config	remote.origin.url
2024-10-08T20:15:09.9344321Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:15:09.9394484Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config	remote.origin.url
2024-10-08T20:15:09.9409387Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:15:09.9458395Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config	remote.origin.url
2024-10-08T20:15:09.9472318Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:15:09.9522521Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config	remote.origin.url
2024-10-08T20:15:09.9540022Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:15:09.9589782Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config	remote.origin.url
2024-10-08T20:15:09.9605220Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:15:09.9654545Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:09.9669903Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:15:09.9719918Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config	remote.origin.url
2024-10-08T20:15:09.9736055Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:15:09.9785395Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config	remote.origin.url
2024-10-08T20:15:09.9801775Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:15:09.9849903Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config	remote.origin.url
2024-10-08T20:15:09.9865147Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:15:09.9914684Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:09.9931097Z Entering 'third_party/mimalloc'
2024-10-08T20:15:09.9980126Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config	remote.origin.url
2024-10-08T20:15:09.9997044Z Entering 'third_party/nccl/nccl'
2024-10-08T20:15:10.0045906Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config	remote.origin.url
2024-10-08T20:15:10.0062071Z Entering 'third_party/nlohmann'
2024-10-08T20:15:10.0111280Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config	remote.origin.url
2024-10-08T20:15:10.0128614Z Entering 'third_party/onnx'
2024-10-08T20:15:10.0177630Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config	remote.origin.url
2024-10-08T20:15:10.0210311Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T20:15:10.0259345Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config	remote.origin.url
2024-10-08T20:15:10.0274642Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T20:15:10.0323820Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config	remote.origin.url
2024-10-08T20:15:10.0342144Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T20:15:10.0395640Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config	remote.origin.url
2024-10-08T20:15:10.0412905Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:15:10.0463116Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config	remote.origin.url
2024-10-08T20:15:10.0478181Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:15:10.0528536Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:10.0544436Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:15:10.0593399Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config	remote.origin.url
2024-10-08T20:15:10.0608022Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:15:10.0657546Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config	remote.origin.url
2024-10-08T20:15:10.0673636Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:15:10.0722583Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config	remote.origin.url
2024-10-08T20:15:10.0737880Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:15:10.0788514Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config	remote.origin.url
2024-10-08T20:15:10.0804902Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:15:10.0853912Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config	remote.origin.url
2024-10-08T20:15:10.0882673Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:15:10.0921099Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config	remote.origin.url
2024-10-08T20:15:10.0937126Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:15:10.0985848Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config	remote.origin.url
2024-10-08T20:15:10.1002954Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:15:10.1051413Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config	remote.origin.url
2024-10-08T20:15:10.1086207Z Entering 'third_party/pocketfft'
2024-10-08T20:15:10.1135163Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config	remote.origin.url
2024-10-08T20:15:10.1150747Z Entering 'third_party/protobuf'
2024-10-08T20:15:10.1199243Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config	remote.origin.url
2024-10-08T20:15:10.1217627Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:10.1267379Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config	remote.origin.url
2024-10-08T20:15:10.1281948Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:10.1330065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:10.1346977Z Entering 'third_party/psimd'
2024-10-08T20:15:10.1396135Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config	remote.origin.url
2024-10-08T20:15:10.1411801Z Entering 'third_party/pthreadpool'
2024-10-08T20:15:10.1459548Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config	remote.origin.url
2024-10-08T20:15:10.1474899Z Entering 'third_party/pybind11'
2024-10-08T20:15:10.1524465Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config	remote.origin.url
2024-10-08T20:15:10.1540363Z Entering 'third_party/python-peachpy'
2024-10-08T20:15:10.1589344Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config	remote.origin.url
2024-10-08T20:15:10.1605160Z Entering 'third_party/sleef'
2024-10-08T20:15:10.1654761Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config	remote.origin.url
2024-10-08T20:15:10.1670408Z Entering 'third_party/tensorpipe'
2024-10-08T20:15:10.1722060Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config	remote.origin.url
2024-10-08T20:15:10.1737588Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:10.1788065Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config	remote.origin.url
2024-10-08T20:15:10.1804264Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:10.1854489Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config	remote.origin.url
2024-10-08T20:15:10.1869221Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:10.1917941Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config	remote.origin.url
2024-10-08T20:15:10.1932402Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:10.1981110Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config	remote.origin.url
2024-10-08T20:15:10.1994255Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:10.2045055Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config	remote.origin.url
2024-10-08T20:15:10.2738467Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:'
2024-10-08T20:15:10.3039412Z Entering 'android/libs/fbjni'
2024-10-08T20:15:10.3080535Z Entering 'third_party/FP16'
2024-10-08T20:15:10.3122753Z Entering 'third_party/FXdiv'
2024-10-08T20:15:10.3163182Z Entering 'third_party/NNPACK'
2024-10-08T20:15:10.3203372Z Entering 'third_party/NVTX'
2024-10-08T20:15:10.3244657Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T20:15:10.3284995Z Entering 'third_party/XNNPACK'
2024-10-08T20:15:10.3341707Z Entering 'third_party/benchmark'
2024-10-08T20:15:10.3381682Z Entering 'third_party/cpp-httplib'
2024-10-08T20:15:10.3422572Z Entering 'third_party/cpuinfo'
2024-10-08T20:15:10.3462970Z Entering 'third_party/cudnn_frontend'
2024-10-08T20:15:10.3503116Z Entering 'third_party/cutlass'
2024-10-08T20:15:10.3551411Z Entering 'third_party/eigen'
2024-10-08T20:15:10.3593301Z Entering 'third_party/fbgemm'
2024-10-08T20:15:10.3633753Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:15:10.3672723Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:15:10.3713515Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:15:10.3760791Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:15:10.3799534Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:15:10.3839424Z Entering 'third_party/flatbuffers'
2024-10-08T20:15:10.3882062Z Entering 'third_party/fmt'
2024-10-08T20:15:10.3926862Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:15:10.3967257Z Entering 'third_party/gloo'
2024-10-08T20:15:10.4009944Z Entering 'third_party/googletest'
2024-10-08T20:15:10.4052990Z Entering 'third_party/ideep'
2024-10-08T20:15:10.4095373Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T20:15:10.4143996Z Entering 'third_party/ittapi'
2024-10-08T20:15:10.4185621Z Entering 'third_party/kineto'
2024-10-08T20:15:10.4230683Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:15:10.4270938Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:15:10.4313422Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:15:10.4354070Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:15:10.4394278Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:15:10.4434380Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:15:10.4476236Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:15:10.4516643Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:15:10.4558246Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:15:10.4600261Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:15:10.4644883Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:15:10.4685415Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:15:10.4727826Z Entering 'third_party/mimalloc'
2024-10-08T20:15:10.4769437Z Entering 'third_party/nccl/nccl'
2024-10-08T20:15:10.4813617Z Entering 'third_party/nlohmann'
2024-10-08T20:15:10.4856599Z Entering 'third_party/onnx'
2024-10-08T20:15:10.4913434Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T20:15:10.4954833Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T20:15:10.4999113Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T20:15:10.5042187Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:15:10.5084497Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:15:10.5125742Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:15:10.5168539Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:15:10.5212671Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:15:10.5259365Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:15:10.5300381Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:15:10.5340178Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:15:10.5383408Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:15:10.5430170Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:15:10.5491515Z Entering 'third_party/pocketfft'
2024-10-08T20:15:10.5534594Z Entering 'third_party/protobuf'
2024-10-08T20:15:10.5585697Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:10.5634505Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:10.5677172Z Entering 'third_party/psimd'
2024-10-08T20:15:10.5721870Z Entering 'third_party/pthreadpool'
2024-10-08T20:15:10.5765597Z Entering 'third_party/pybind11'
2024-10-08T20:15:10.5809370Z Entering 'third_party/python-peachpy'
2024-10-08T20:15:10.5854132Z Entering 'third_party/sleef'
2024-10-08T20:15:10.5896200Z Entering 'third_party/tensorpipe'
2024-10-08T20:15:10.5939821Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:10.5981335Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:10.6027827Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:10.6069261Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:10.6112036Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:10.6170452Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:'
2024-10-08T20:15:10.6481300Z Entering 'android/libs/fbjni'
2024-10-08T20:15:10.6523485Z Entering 'third_party/FP16'
2024-10-08T20:15:10.6565434Z Entering 'third_party/FXdiv'
2024-10-08T20:15:10.6610582Z Entering 'third_party/NNPACK'
2024-10-08T20:15:10.6654207Z Entering 'third_party/NVTX'
2024-10-08T20:15:10.6697192Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T20:15:10.6739130Z Entering 'third_party/XNNPACK'
2024-10-08T20:15:10.6800794Z Entering 'third_party/benchmark'
2024-10-08T20:15:10.6843483Z Entering 'third_party/cpp-httplib'
2024-10-08T20:15:10.6888474Z Entering 'third_party/cpuinfo'
2024-10-08T20:15:10.6930782Z Entering 'third_party/cudnn_frontend'
2024-10-08T20:15:10.6972269Z Entering 'third_party/cutlass'
2024-10-08T20:15:10.7025034Z Entering 'third_party/eigen'
2024-10-08T20:15:10.7072184Z Entering 'third_party/fbgemm'
2024-10-08T20:15:10.7117369Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T20:15:10.7156994Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T20:15:10.7199255Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T20:15:10.7247692Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T20:15:10.7290636Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T20:15:10.7331739Z Entering 'third_party/flatbuffers'
2024-10-08T20:15:10.7375558Z Entering 'third_party/fmt'
2024-10-08T20:15:10.7419555Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T20:15:10.7462818Z Entering 'third_party/gloo'
2024-10-08T20:15:10.7503960Z Entering 'third_party/googletest'
2024-10-08T20:15:10.7547321Z Entering 'third_party/ideep'
2024-10-08T20:15:10.7588160Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T20:15:10.7636046Z Entering 'third_party/ittapi'
2024-10-08T20:15:10.7676793Z Entering 'third_party/kineto'
2024-10-08T20:15:10.7717798Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T20:15:10.7757815Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T20:15:10.7802911Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T20:15:10.7843484Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T20:15:10.7884156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T20:15:10.7928046Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T20:15:10.7970469Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T20:15:10.8014757Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T20:15:10.8058081Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T20:15:10.8099922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T20:15:10.8143496Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T20:15:10.8183498Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T20:15:10.8227480Z Entering 'third_party/mimalloc'
2024-10-08T20:15:10.8270754Z Entering 'third_party/nccl/nccl'
2024-10-08T20:15:10.8312706Z Entering 'third_party/nlohmann'
2024-10-08T20:15:10.8357412Z Entering 'third_party/onnx'
2024-10-08T20:15:10.8419059Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T20:15:10.8461148Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T20:15:10.8507445Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T20:15:10.8553677Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T20:15:10.8594301Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T20:15:10.8636910Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T20:15:10.8678278Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T20:15:10.8724822Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T20:15:10.8765517Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T20:15:10.8807388Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T20:15:10.8846545Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T20:15:10.8890964Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T20:15:10.8938598Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T20:15:10.9005167Z Entering 'third_party/pocketfft'
2024-10-08T20:15:10.9047838Z Entering 'third_party/protobuf'
2024-10-08T20:15:10.9092753Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T20:15:10.9137010Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T20:15:10.9179413Z Entering 'third_party/psimd'
2024-10-08T20:15:10.9220500Z Entering 'third_party/pthreadpool'
2024-10-08T20:15:10.9262731Z Entering 'third_party/pybind11'
2024-10-08T20:15:10.9304396Z Entering 'third_party/python-peachpy'
2024-10-08T20:15:10.9346929Z Entering 'third_party/sleef'
2024-10-08T20:15:10.9388284Z Entering 'third_party/tensorpipe'
2024-10-08T20:15:10.9431814Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T20:15:10.9473288Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T20:15:10.9514984Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T20:15:10.9556816Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T20:15:10.9597806Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T20:15:10.9655706Z ##[endgroup]
2024-10-08T20:15:10.9706908Z [command]/usr/bin/git log -1 --format='%H'
2024-10-08T20:15:10.9744913Z '47952c0a8001fd60c9ffe52b121d022d440bef8b'
2024-10-08T20:15:10.9964373Z Prepare all required actions
2024-10-08T20:15:10.9964861Z Getting action download info
2024-10-08T20:15:11.1972795Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e)
2024-10-08T20:15:11.3453080Z ##[group]Run ./.github/actions/setup-linux
2024-10-08T20:15:11.3453515Z env:
2024-10-08T20:15:11.3453783Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:11.3454149Z ##[endgroup]
2024-10-08T20:15:11.3521643Z ##[group]Run set -euo pipefail
2024-10-08T20:15:11.3522095Z set -euo pipefail
2024-10-08T20:15:11.3522474Z function get_ec2_metadata() {
2024-10-08T20:15:11.3523025Z   # Pulled from instance metadata endpoint for EC2
2024-10-08T20:15:11.3523983Z   # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html
2024-10-08T20:15:11.3524807Z   category=$1
2024-10-08T20:15:11.3525334Z   # If it is GCP runner (runner name contains gcp), do not run this
2024-10-08T20:15:11.3526059Z   runner_name_str=i-05d4cdd6accd1587b
2024-10-08T20:15:11.3526537Z   if [[ -f /.inarc ]]; then
2024-10-08T20:15:11.3527026Z     echo "ARC Runner, no info on ec2 metadata"
2024-10-08T20:15:11.3527611Z   elif [[ $runner_name_str == *"gcp"* ]]; then
2024-10-08T20:15:11.3528330Z     echo "Runner is from Google Cloud Platform, No info on ec2 metadata"
2024-10-08T20:15:11.3528978Z   else
2024-10-08T20:15:11.3529463Z     curl -fsSL "http://169.254.169.254/latest/meta-data/${category}"
2024-10-08T20:15:11.3530055Z   fi
2024-10-08T20:15:11.3530335Z }
2024-10-08T20:15:11.3530688Z echo "ami-id: $(get_ec2_metadata ami-id)"
2024-10-08T20:15:11.3531281Z echo "instance-id: $(get_ec2_metadata instance-id)"
2024-10-08T20:15:11.3531965Z echo "instance-type: $(get_ec2_metadata instance-type)"
2024-10-08T20:15:11.3532670Z echo "system info $(uname -a)"
2024-10-08T20:15:11.3539186Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:11.3539687Z env:
2024-10-08T20:15:11.3539953Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:11.3540298Z ##[endgroup]
2024-10-08T20:15:11.3638348Z ami-id: ami-0fff1b9a61dec8a5f
2024-10-08T20:15:11.3691117Z instance-id: i-05d4cdd6accd1587b
2024-10-08T20:15:11.3741560Z instance-type: c5.2xlarge
2024-10-08T20:15:11.3752483Z system info Linux ip-10-0-78-74.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
2024-10-08T20:15:11.3804091Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:15:11.3805487Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:15:11.3817301Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:11.3817827Z env:
2024-10-08T20:15:11.3818104Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:11.3818436Z ##[endgroup]
2024-10-08T20:15:11.3965774Z ##[group]Run if systemctl is-active --quiet docker; then
2024-10-08T20:15:11.3966562Z if systemctl is-active --quiet docker; then
2024-10-08T20:15:11.3967127Z     echo "Docker daemon is running...";
2024-10-08T20:15:11.3967595Z else
2024-10-08T20:15:11.3968260Z     echo "Starting docker deamon..." && sudo systemctl start docker;
2024-10-08T20:15:11.3968920Z fi
2024-10-08T20:15:11.3975096Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:11.3975618Z env:
2024-10-08T20:15:11.3975895Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:11.3976231Z ##[endgroup]
2024-10-08T20:15:11.4050616Z Docker daemon is running...
2024-10-08T20:15:11.4101319Z ##[group]Run nick-fields/retry@v3.0.0
2024-10-08T20:15:11.4101737Z with:
2024-10-08T20:15:11.4101996Z   shell: bash
2024-10-08T20:15:11.4102455Z   timeout_minutes: 5
2024-10-08T20:15:11.4102779Z   max_attempts: 3
2024-10-08T20:15:11.4103090Z   retry_wait_seconds: 30
2024-10-08T20:15:11.4106431Z   command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\")
aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
    --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"

# For LF Runners we need to make sure we also login to Meta's ECR docker registry too.
META_AWS_ACCOUNT_ID=308535385114
if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then
    aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
        --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"
fi

2024-10-08T20:15:11.4109836Z   polling_interval_seconds: 1
2024-10-08T20:15:11.4110215Z   warning_on_retry: true
2024-10-08T20:15:11.4110547Z   continue_on_error: false
2024-10-08T20:15:11.4110882Z env:
2024-10-08T20:15:11.4111147Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:11.4111504Z   AWS_RETRY_MODE: standard
2024-10-08T20:15:11.4111836Z   AWS_MAX_ATTEMPTS: 5
2024-10-08T20:15:11.4112170Z   AWS_DEFAULT_REGION: us-east-1
2024-10-08T20:15:11.4112544Z ##[endgroup]
2024-10-08T20:15:12.8302939Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-10-08T20:15:12.8303807Z Configure a credential helper to remove this warning. See
2024-10-08T20:15:12.8304727Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-10-08T20:15:12.8305308Z 
2024-10-08T20:15:12.8305416Z Login Succeeded
2024-10-08T20:15:13.6428358Z Command completed after 1 attempt(s).
2024-10-08T20:15:13.6522379Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-10-08T20:15:13.6523161Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-10-08T20:15:13.6523844Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-10-08T20:15:13.6530561Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:13.6531059Z env:
2024-10-08T20:15:13.6531327Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:13.6531676Z ##[endgroup]
2024-10-08T20:15:13.6618324Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-10-08T20:15:13.6619133Z # ignore expansion of "docker ps -q" since it could be empty
2024-10-08T20:15:13.6619756Z # shellcheck disable=SC2046
2024-10-08T20:15:13.6620235Z docker stop $(docker ps -q) || true
2024-10-08T20:15:13.6620709Z # Prune all of the docker images
2024-10-08T20:15:13.6621167Z docker system prune -af
2024-10-08T20:15:13.6627351Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:13.6627863Z env:
2024-10-08T20:15:13.6628120Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:13.6628463Z ##[endgroup]
2024-10-08T20:15:13.6889871Z "docker stop" requires at least 1 argument.
2024-10-08T20:15:13.6890608Z See 'docker stop --help'.
2024-10-08T20:15:13.6890857Z 
2024-10-08T20:15:13.6891097Z Usage:  docker stop [OPTIONS] CONTAINER [CONTAINER...]
2024-10-08T20:15:13.6891503Z 
2024-10-08T20:15:13.6891643Z Stop one or more running containers
2024-10-08T20:15:13.7039734Z Total reclaimed space: 0B
2024-10-08T20:15:13.7075599Z ##[group]Run set +e
2024-10-08T20:15:13.7075961Z set +e
2024-10-08T20:15:13.7076260Z set -x
2024-10-08T20:15:13.7076550Z 
2024-10-08T20:15:13.7076996Z PT_DOMAIN=download.pytorch.org
2024-10-08T20:15:13.7077821Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400,
2024-10-08T20:15:13.7078983Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last
2024-10-08T20:15:13.7079786Z # one is returned at random
2024-10-08T20:15:13.7080342Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1)
2024-10-08T20:15:13.7080873Z 
2024-10-08T20:15:13.7081280Z if [ -z "${RESOLVED_IP}" ]; then
2024-10-08T20:15:13.7081928Z   echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..."
2024-10-08T20:15:13.7082730Z   RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1)
2024-10-08T20:15:13.7083310Z 
2024-10-08T20:15:13.7083616Z   if [ -z "${RESOLVED_IP}" ]; then
2024-10-08T20:15:13.7084183Z     echo "Couldn't resolve ${PT_DOMAIN}, exiting..."
2024-10-08T20:15:13.7084717Z     exit 1
2024-10-08T20:15:13.7085028Z   fi
2024-10-08T20:15:13.7085296Z fi
2024-10-08T20:15:13.7085566Z 
2024-10-08T20:15:13.7085923Z if grep -r "${PT_DOMAIN}" /etc/hosts; then
2024-10-08T20:15:13.7086440Z   # Clean up any old records first
2024-10-08T20:15:13.7086963Z   sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts
2024-10-08T20:15:13.7087426Z fi
2024-10-08T20:15:13.7087695Z 
2024-10-08T20:15:13.7088118Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts
2024-10-08T20:15:13.7088935Z cat /etc/hosts
2024-10-08T20:15:13.7095487Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:13.7096001Z env:
2024-10-08T20:15:13.7096257Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:13.7096607Z ##[endgroup]
2024-10-08T20:15:13.7120324Z + PT_DOMAIN=download.pytorch.org
2024-10-08T20:15:13.7126512Z ++ dig -4 +short download.pytorch.org
2024-10-08T20:15:13.7127037Z ++ tail -n1
2024-10-08T20:15:13.7756021Z + RESOLVED_IP=108.138.64.61
2024-10-08T20:15:13.7756955Z + '[' -z 108.138.64.61 ']'
2024-10-08T20:15:13.7757728Z + grep -r download.pytorch.org /etc/hosts
2024-10-08T20:15:13.7767981Z 18.160.10.36 download.pytorch.org
2024-10-08T20:15:13.7769421Z + sudo sed -i /download.pytorch.org/d /etc/hosts
2024-10-08T20:15:14.0447262Z + echo '108.138.64.61 download.pytorch.org'
2024-10-08T20:15:14.0447847Z + sudo tee -a /etc/hosts
2024-10-08T20:15:14.0871146Z 108.138.64.61 download.pytorch.org
2024-10-08T20:15:14.0886980Z + cat /etc/hosts
2024-10-08T20:15:14.0896840Z 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
2024-10-08T20:15:14.0910756Z ::1         localhost6 localhost6.localdomain6
2024-10-08T20:15:14.0911358Z 108.138.64.61 download.pytorch.org
2024-10-08T20:15:14.1126262Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main
2024-10-08T20:15:14.1126901Z with:
2024-10-08T20:15:14.1127875Z   docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1128965Z   docker-build-dir: .ci/docker
2024-10-08T20:15:14.1129345Z   working-directory: .
2024-10-08T20:15:14.1129824Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.1130372Z   force-push: false
2024-10-08T20:15:14.1130656Z env:
2024-10-08T20:15:14.1130916Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:14.1131255Z ##[endgroup]
2024-10-08T20:15:14.1153343Z ##[group]Run set -ex
2024-10-08T20:15:14.1153712Z set -ex
2024-10-08T20:15:14.1153998Z 
2024-10-08T20:15:14.1154562Z # If the docker build directory or the build script doesn't exist, the action will
2024-10-08T20:15:14.1155664Z # gracefully return the docker image name as it is.  Pulling docker image in Linux
2024-10-08T20:15:14.1156519Z # job could then download the pre-built image as usual
2024-10-08T20:15:14.1157427Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then
2024-10-08T20:15:14.1158134Z   echo "skip=true" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1158795Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1159380Z 
2024-10-08T20:15:14.1159890Z   echo "There is no Docker build script in ${REPO_NAME} repo, skipping..."
2024-10-08T20:15:14.1160539Z   exit 0
2024-10-08T20:15:14.1160831Z else
2024-10-08T20:15:14.1161194Z   echo "skip=false" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1161640Z fi
2024-10-08T20:15:14.1161907Z 
2024-10-08T20:15:14.1162380Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then
2024-10-08T20:15:14.1163446Z   # The docker image name already includes the ECR prefix and tag, so we can just
2024-10-08T20:15:14.1164255Z   # use it as it is, but first let's extract the tag
2024-10-08T20:15:14.1165002Z   DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}')
2024-10-08T20:15:14.1165764Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1166492Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1167057Z else
2024-10-08T20:15:14.1167495Z   DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}")
2024-10-08T20:15:14.1168184Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1169135Z   echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1169930Z fi
2024-10-08T20:15:14.1179357Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:14.1179874Z env:
2024-10-08T20:15:14.1180145Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:14.1180489Z   REPO_NAME: pytorch
2024-10-08T20:15:14.1181488Z   DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1182557Z   DOCKER_BUILD_DIR: .ci/docker
2024-10-08T20:15:14.1183068Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.1183601Z ##[endgroup]
2024-10-08T20:15:14.1210022Z + [[ ! -d .ci/docker ]]
2024-10-08T20:15:14.1210432Z + [[ ! -f .ci/docker/build.sh ]]
2024-10-08T20:15:14.1210807Z + echo skip=false
2024-10-08T20:15:14.1212621Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]]
2024-10-08T20:15:14.1218049Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1219292Z ++ awk -F '[:,]' '{print $2}'
2024-10-08T20:15:14.1279497Z + DOCKER_TAG=46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1280283Z + echo docker-tag=46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1281854Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1311143Z ##[group]Run set +e
2024-10-08T20:15:14.1311511Z set +e
2024-10-08T20:15:14.1311808Z set -x
2024-10-08T20:15:14.1312095Z 
2024-10-08T20:15:14.1312351Z login() {
2024-10-08T20:15:14.1313039Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-10-08T20:15:14.1313797Z }
2024-10-08T20:15:14.1314056Z 
2024-10-08T20:15:14.1314326Z retry () {
2024-10-08T20:15:14.1314724Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-10-08T20:15:14.1315182Z }
2024-10-08T20:15:14.1315434Z 
2024-10-08T20:15:14.1315746Z retry login "${DOCKER_REGISTRY}"
2024-10-08T20:15:14.1316293Z 
2024-10-08T20:15:14.1316766Z # Check if image already exists, if it does then skip building it
2024-10-08T20:15:14.1317494Z if docker manifest inspect "${DOCKER_IMAGE}"; then
2024-10-08T20:15:14.1318015Z   exit 0
2024-10-08T20:15:14.1318309Z fi
2024-10-08T20:15:14.1318578Z 
2024-10-08T20:15:14.1319076Z # NB: This part requires a full checkout. Otherwise, the merge base will
2024-10-08T20:15:14.1319953Z # be empty.  The default action would be to continue rebuild the image
2024-10-08T20:15:14.1320721Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then
2024-10-08T20:15:14.1321416Z   # if we're on the base branch then use the parent commit
2024-10-08T20:15:14.1322017Z   MERGE_BASE=$(git rev-parse HEAD~)
2024-10-08T20:15:14.1322457Z else
2024-10-08T20:15:14.1322934Z   # otherwise we're on a PR, so use the most recent base commit
2024-10-08T20:15:14.1323661Z   MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION")
2024-10-08T20:15:14.1324167Z fi
2024-10-08T20:15:14.1324438Z 
2024-10-08T20:15:14.1324748Z if [[ -z "${MERGE_BASE}" ]]; then
2024-10-08T20:15:14.1325265Z   echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1325719Z 
2024-10-08T20:15:14.1326402Z   echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..."
2024-10-08T20:15:14.1327208Z   exit 0
2024-10-08T20:15:14.1327504Z fi
2024-10-08T20:15:14.1327758Z 
2024-10-08T20:15:14.1328196Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then
2024-10-08T20:15:14.1329240Z   echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit"
2024-10-08T20:15:14.1330102Z   exit 1
2024-10-08T20:15:14.1330397Z fi
2024-10-08T20:15:14.1330663Z 
2024-10-08T20:15:14.1331161Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}")
2024-10-08T20:15:14.1332179Z # If no image exists but the hash is the same as the previous hash then we should error out here
2024-10-08T20:15:14.1333194Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then
2024-10-08T20:15:14.1334226Z   echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch"
2024-10-08T20:15:14.1335397Z   echo "         Will re-build docker image to store in local cache, TTS may be longer"
2024-10-08T20:15:14.1336085Z fi
2024-10-08T20:15:14.1336354Z 
2024-10-08T20:15:14.1336690Z echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-10-08T20:15:14.1343048Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:14.1343562Z env:
2024-10-08T20:15:14.1343819Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:14.1344192Z   DOCKER_BUILD_DIR: .ci/docker
2024-10-08T20:15:14.1344657Z   BASE_REVISION: 05ad01290ec4310464e5073140f6c94a10acf565
2024-10-08T20:15:14.1345781Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1346902Z   DOCKER_TAG: 46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:14.1347515Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.1348054Z ##[endgroup]
2024-10-08T20:15:14.1371042Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.1371716Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.1373491Z + aws ecr get-login-password --region us-east-1
2024-10-08T20:15:14.1374890Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:14.7319632Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-10-08T20:15:14.7321056Z Configure a credential helper to remove this warning. See
2024-10-08T20:15:14.7321971Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-10-08T20:15:14.7322553Z 
2024-10-08T20:15:14.7322665Z Login Succeeded
2024-10-08T20:15:14.7333465Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.0207588Z {
2024-10-08T20:15:15.0208092Z 	"schemaVersion": 2,
2024-10-08T20:15:15.0208862Z 	"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
2024-10-08T20:15:15.0209492Z 	"config": {
2024-10-08T20:15:15.0210068Z 		"mediaType": "application/vnd.docker.container.image.v1+json",
2024-10-08T20:15:15.0210981Z 		"size": 45984,
2024-10-08T20:15:15.0211934Z 		"digest": "sha256:8c834a349f9752a25b5f708c94dd15d6312989e62a0e3e6a3f4b2a91730a07f0"
2024-10-08T20:15:15.0213118Z 	},
2024-10-08T20:15:15.0213523Z 	"layers": [
2024-10-08T20:15:15.0213987Z 		{
2024-10-08T20:15:15.0215126Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0216189Z 			"size": 30439933,
2024-10-08T20:15:15.0217248Z 			"digest": "sha256:7478e0ac0f23f94b2f27848fbcdf804a670fbf8d4bab26df842d40a10cd33059"
2024-10-08T20:15:15.0218338Z 		},
2024-10-08T20:15:15.0218575Z 		{
2024-10-08T20:15:15.0219017Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0219588Z 			"size": 1822,
2024-10-08T20:15:15.0220173Z 			"digest": "sha256:aeab40a9053a1cf8f68de24ea6e8d08d84aac9eb81d54f70a5fca7a686ec1b28"
2024-10-08T20:15:15.0220843Z 		},
2024-10-08T20:15:15.0221078Z 		{
2024-10-08T20:15:15.0221508Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0222095Z 			"size": 313176632,
2024-10-08T20:15:15.0222682Z 			"digest": "sha256:d4486831345cf907a7639827ed85af1b289ee3ecdec22d52e917f1db0f931ba4"
2024-10-08T20:15:15.0223329Z 		},
2024-10-08T20:15:15.0223688Z 		{
2024-10-08T20:15:15.0224420Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0225028Z 			"size": 843,
2024-10-08T20:15:15.0225595Z 			"digest": "sha256:041cb9a31c7739fb64df0aedbee349702847a7e2c0d595091c9aef1dbafc7279"
2024-10-08T20:15:15.0226252Z 		},
2024-10-08T20:15:15.0226487Z 		{
2024-10-08T20:15:15.0226925Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0227491Z 			"size": 106,
2024-10-08T20:15:15.0228053Z 			"digest": "sha256:3d701f8691347ab3fb752b5e5c6adcbbd3e156c0d54675fd0400f60e2997e331"
2024-10-08T20:15:15.0228709Z 		},
2024-10-08T20:15:15.0228945Z 		{
2024-10-08T20:15:15.0229376Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0229955Z 			"size": 544,
2024-10-08T20:15:15.0230722Z 			"digest": "sha256:9309aa962cc863920c0b3345418206dc803a5cc4f5ca3364f38c058cf2839d6e"
2024-10-08T20:15:15.0231363Z 		},
2024-10-08T20:15:15.0231677Z 		{
2024-10-08T20:15:15.0232118Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0232707Z 			"size": 1220,
2024-10-08T20:15:15.0233257Z 			"digest": "sha256:be689962a1bec89b45411875db75837b7bef1038d14ef261bacd94264f411539"
2024-10-08T20:15:15.0233911Z 		},
2024-10-08T20:15:15.0234145Z 		{
2024-10-08T20:15:15.0234589Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0235150Z 			"size": 484,
2024-10-08T20:15:15.0235714Z 			"digest": "sha256:8c7b0ce86f796d0eed7763180eb9d15043243d9af26e37f56d5bf0c1f8ddff03"
2024-10-08T20:15:15.0236364Z 		},
2024-10-08T20:15:15.0236598Z 		{
2024-10-08T20:15:15.0237028Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0237613Z 			"size": 110322411,
2024-10-08T20:15:15.0238198Z 			"digest": "sha256:8c6851927b6ca7b337b5bd5bd41a5b2e61b4919ae2c3b88275c0370471ccc732"
2024-10-08T20:15:15.0238853Z 		},
2024-10-08T20:15:15.0239080Z 		{
2024-10-08T20:15:15.0239522Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0240232Z 			"size": 3930,
2024-10-08T20:15:15.0240782Z 			"digest": "sha256:fd59f13891baf7d414cd0195776299abaf6ca5530019d848a764c0d67012f15f"
2024-10-08T20:15:15.0241438Z 		},
2024-10-08T20:15:15.0241678Z 		{
2024-10-08T20:15:15.0242122Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0242692Z 			"size": 1959,
2024-10-08T20:15:15.0243248Z 			"digest": "sha256:97c1b41b63e74169d98a354b49e12b879e01883e1912cc6425ec8114fcb2066c"
2024-10-08T20:15:15.0243889Z 		},
2024-10-08T20:15:15.0244132Z 		{
2024-10-08T20:15:15.0244567Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0245154Z 			"size": 700,
2024-10-08T20:15:15.0245731Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0246384Z 		},
2024-10-08T20:15:15.0246638Z 		{
2024-10-08T20:15:15.0247084Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0247673Z 			"size": 2785871001,
2024-10-08T20:15:15.0248252Z 			"digest": "sha256:1fd2453d8064347c0f5158b4ce417c50afb0747ef31c0d43525a7b863545b36c"
2024-10-08T20:15:15.0248904Z 		},
2024-10-08T20:15:15.0249144Z 		{
2024-10-08T20:15:15.0249591Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0250165Z 			"size": 32,
2024-10-08T20:15:15.0250740Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0251408Z 		},
2024-10-08T20:15:15.0251646Z 		{
2024-10-08T20:15:15.0252092Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0252781Z 			"size": 381,
2024-10-08T20:15:15.0253352Z 			"digest": "sha256:30e9141805d5adeaa983a0d32f6e4cce1612fe83c156fcd343d3dfffe9d67e68"
2024-10-08T20:15:15.0253999Z 		},
2024-10-08T20:15:15.0254239Z 		{
2024-10-08T20:15:15.0254690Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0255269Z 			"size": 227659,
2024-10-08T20:15:15.0255822Z 			"digest": "sha256:e355280ca4959f6855abb25b3636b5c19e80900a2c0c0b2e13cee611d57cfa26"
2024-10-08T20:15:15.0256477Z 		},
2024-10-08T20:15:15.0256715Z 		{
2024-10-08T20:15:15.0257159Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0257723Z 			"size": 231,
2024-10-08T20:15:15.0258289Z 			"digest": "sha256:124d36bf67450ad338f670dd9eb733a2ae925e76e37cd4955ec0945ae9c8ff81"
2024-10-08T20:15:15.0258935Z 		},
2024-10-08T20:15:15.0259158Z 		{
2024-10-08T20:15:15.0259597Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0260179Z 			"size": 3232382,
2024-10-08T20:15:15.0260756Z 			"digest": "sha256:6e9e8e4788570dc6a324bbbb7f22fd0315ec7d0d49c33de41786640cb259ca2f"
2024-10-08T20:15:15.0261397Z 		},
2024-10-08T20:15:15.0261632Z 		{
2024-10-08T20:15:15.0262172Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0262754Z 			"size": 1836,
2024-10-08T20:15:15.0263312Z 			"digest": "sha256:91a703b7bb47116ef62c5fdb7042f2a1f8b3a8230ea33f1000447cfaf76af8db"
2024-10-08T20:15:15.0263980Z 		},
2024-10-08T20:15:15.0264222Z 		{
2024-10-08T20:15:15.0264653Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0265237Z 			"size": 105,
2024-10-08T20:15:15.0265794Z 			"digest": "sha256:7e47d022e4303cd4d36a458d0b10741bb66fae95df18172869ac6ac1a82bb550"
2024-10-08T20:15:15.0266443Z 		},
2024-10-08T20:15:15.0266668Z 		{
2024-10-08T20:15:15.0267108Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0267689Z 			"size": 565,
2024-10-08T20:15:15.0268250Z 			"digest": "sha256:6731cd6c1a8b649cb90fd5327dee592162c106b234d9b91d56a59e0821bd575d"
2024-10-08T20:15:15.0268891Z 		},
2024-10-08T20:15:15.0269129Z 		{
2024-10-08T20:15:15.0269571Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0270151Z 			"size": 32,
2024-10-08T20:15:15.0270711Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0271456Z 		},
2024-10-08T20:15:15.0271694Z 		{
2024-10-08T20:15:15.0272130Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0272716Z 			"size": 102,
2024-10-08T20:15:15.0273297Z 			"digest": "sha256:badcfd30f4ab5a198d20ea4b795d3b92cd1379c3232e82f237c09ed4a96fad76"
2024-10-08T20:15:15.0273968Z 		},
2024-10-08T20:15:15.0274225Z 		{
2024-10-08T20:15:15.0274669Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0275235Z 			"size": 504,
2024-10-08T20:15:15.0275810Z 			"digest": "sha256:7c478fa099b849aa59cba4eff1bb9f80c129ac21389f9f94640cdde699f86587"
2024-10-08T20:15:15.0276469Z 		},
2024-10-08T20:15:15.0276707Z 		{
2024-10-08T20:15:15.0277139Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0277720Z 			"size": 101109863,
2024-10-08T20:15:15.0278319Z 			"digest": "sha256:1fca2f347a8ca174fc00e64a861ba2215f62e77351ab0cc79e1345b627094e37"
2024-10-08T20:15:15.0278977Z 		},
2024-10-08T20:15:15.0279205Z 		{
2024-10-08T20:15:15.0279646Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0280227Z 			"size": 109,
2024-10-08T20:15:15.0280757Z 			"digest": "sha256:90e80f141d974041a2d40491b32ced999589b7ea8568e388c1d8426587e04949"
2024-10-08T20:15:15.0281387Z 		},
2024-10-08T20:15:15.0281624Z 		{
2024-10-08T20:15:15.0282066Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0282634Z 			"size": 489,
2024-10-08T20:15:15.0298982Z 			"digest": "sha256:2fa21a5a99038ada3bd05a46ac9e942371495dfe6792e186703622588fc8c95a"
2024-10-08T20:15:15.0299798Z 		},
2024-10-08T20:15:15.0300042Z 		{
2024-10-08T20:15:15.0300486Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0301075Z 			"size": 336,
2024-10-08T20:15:15.0301671Z 			"digest": "sha256:8daafb98cf75a9e9953ba4b751c14a20ea69a9a096af07863caab90e1d1ffbd4"
2024-10-08T20:15:15.0302330Z 		},
2024-10-08T20:15:15.0302570Z 		{
2024-10-08T20:15:15.0303013Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0303605Z 			"size": 103,
2024-10-08T20:15:15.0304138Z 			"digest": "sha256:25fe74fe196551904000908d86622c565dc717bc126368567daa02f78f73cb9c"
2024-10-08T20:15:15.0304772Z 		},
2024-10-08T20:15:15.0305005Z 		{
2024-10-08T20:15:15.0305449Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0306013Z 			"size": 1473,
2024-10-08T20:15:15.0306562Z 			"digest": "sha256:23f1488f7771b13116098fc954aedc08822680fc3971b8744b8d3b1b0300a4b3"
2024-10-08T20:15:15.0307195Z 		},
2024-10-08T20:15:15.0307428Z 		{
2024-10-08T20:15:15.0307856Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0308438Z 			"size": 616388730,
2024-10-08T20:15:15.0309260Z 			"digest": "sha256:efa31f26e3b77ea619f6f44022a4eb5152d817d924196ba514252dfc4aceef3b"
2024-10-08T20:15:15.0309906Z 		},
2024-10-08T20:15:15.0310142Z 		{
2024-10-08T20:15:15.0310581Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0311166Z 			"size": 164,
2024-10-08T20:15:15.0311722Z 			"digest": "sha256:30120af386eb2e5ccac3e8ddc34bf6975b0a6405e881942db8ed05af80e3e7c7"
2024-10-08T20:15:15.0312381Z 		},
2024-10-08T20:15:15.0312615Z 		{
2024-10-08T20:15:15.0313051Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0313616Z 			"size": 2210,
2024-10-08T20:15:15.0314178Z 			"digest": "sha256:7052567f0a8590523ceb02fb2e36cb05969fdf45abb0d97e7659c7dfcbbaa3e0"
2024-10-08T20:15:15.0314821Z 		},
2024-10-08T20:15:15.0315042Z 		{
2024-10-08T20:15:15.0315480Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0316062Z 			"size": 152,
2024-10-08T20:15:15.0316613Z 			"digest": "sha256:48c59746051fae63d3bf5a204c4b6a1a845061cb78bc2972f5b8c75950a0d90d"
2024-10-08T20:15:15.0317244Z 		},
2024-10-08T20:15:15.0317475Z 		{
2024-10-08T20:15:15.0317912Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0318682Z 			"size": 647,
2024-10-08T20:15:15.0319241Z 			"digest": "sha256:a97bb6751d5c23ff3d49002946dd5bcfdf8ccecbe980f30731c124d19dd5a5b2"
2024-10-08T20:15:15.0319910Z 		},
2024-10-08T20:15:15.0320151Z 		{
2024-10-08T20:15:15.0320593Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0321161Z 			"size": 32,
2024-10-08T20:15:15.0321722Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0322378Z 		},
2024-10-08T20:15:15.0322601Z 		{
2024-10-08T20:15:15.0323040Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0323619Z 			"size": 166,
2024-10-08T20:15:15.0324184Z 			"digest": "sha256:721ea279f1ece4dd551bf4852cc57507882bd9ad903ff0012c40749276cefd61"
2024-10-08T20:15:15.0324823Z 		},
2024-10-08T20:15:15.0325057Z 		{
2024-10-08T20:15:15.0325502Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0326081Z 			"size": 109,
2024-10-08T20:15:15.0326649Z 			"digest": "sha256:1dfa26f43437f1012b10acbf2da46bf6dd2c12c7ead31a08dfdb1303d720e6bf"
2024-10-08T20:15:15.0327317Z 		},
2024-10-08T20:15:15.0327554Z 		{
2024-10-08T20:15:15.0327984Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0328558Z 			"size": 102,
2024-10-08T20:15:15.0329127Z 			"digest": "sha256:063cba812af26aec5285710df2c4ebe969f0eaec4f9211549c4b672c9cbc8fca"
2024-10-08T20:15:15.0329790Z 		},
2024-10-08T20:15:15.0330014Z 		{
2024-10-08T20:15:15.0330452Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0331032Z 			"size": 422,
2024-10-08T20:15:15.0331577Z 			"digest": "sha256:04271b510e7725f02d8ef183fb7c50fa64e71775d8092320c0aa820280494e5e"
2024-10-08T20:15:15.0332203Z 		},
2024-10-08T20:15:15.0332440Z 		{
2024-10-08T20:15:15.0333004Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0333587Z 			"size": 32,
2024-10-08T20:15:15.0334136Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0334802Z 		},
2024-10-08T20:15:15.0335038Z 		{
2024-10-08T20:15:15.0335465Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0336043Z 			"size": 111,
2024-10-08T20:15:15.0336605Z 			"digest": "sha256:ab62990fb550e7d369d7089b2db37cf8f70e9312dbc247359dfc7bb488b5353c"
2024-10-08T20:15:15.0337258Z 		},
2024-10-08T20:15:15.0337482Z 		{
2024-10-08T20:15:15.0337920Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0338497Z 			"size": 474,
2024-10-08T20:15:15.0339064Z 			"digest": "sha256:ff4be702052dd21f1271fc1acd65657e66afa65a17d4451ad7279644e259bf56"
2024-10-08T20:15:15.0339708Z 		},
2024-10-08T20:15:15.0339945Z 		{
2024-10-08T20:15:15.0340480Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0341041Z 			"size": 32,
2024-10-08T20:15:15.0341601Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0342266Z 		},
2024-10-08T20:15:15.0342501Z 		{
2024-10-08T20:15:15.0342926Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0343507Z 			"size": 112,
2024-10-08T20:15:15.0344076Z 			"digest": "sha256:cd7099b12fa2b9b472e93bea41c27a0ed6557e86895c31a9bdd683cfc42a14ab"
2024-10-08T20:15:15.0344734Z 		},
2024-10-08T20:15:15.0344958Z 		{
2024-10-08T20:15:15.0345400Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0345979Z 			"size": 566,
2024-10-08T20:15:15.0346549Z 			"digest": "sha256:d3fc4fda5d34b60e749cec53996270afddc3e5902ad7ce26fc09f20ffb1d4d9c"
2024-10-08T20:15:15.0347202Z 		},
2024-10-08T20:15:15.0347436Z 		{
2024-10-08T20:15:15.0347872Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0348447Z 			"size": 43163739,
2024-10-08T20:15:15.0349031Z 			"digest": "sha256:2eb55b65a374bcf37de07c7e057ab5c2aa03e19284cef8a3a1d9d51a882a5b9e"
2024-10-08T20:15:15.0349687Z 		},
2024-10-08T20:15:15.0349991Z 		{
2024-10-08T20:15:15.0350416Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0350998Z 			"size": 106,
2024-10-08T20:15:15.0351563Z 			"digest": "sha256:5a1de3e09cb802c1b737ab4a5d60a96e1579f08674a2aace3c1135c2a76b2313"
2024-10-08T20:15:15.0352210Z 		},
2024-10-08T20:15:15.0352434Z 		{
2024-10-08T20:15:15.0352867Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0353444Z 			"size": 295,
2024-10-08T20:15:15.0353982Z 			"digest": "sha256:54f00623ecc4d711845afa04a3381687131d3d0ceb1ac0618dbc364b9426f148"
2024-10-08T20:15:15.0354620Z 		},
2024-10-08T20:15:15.0354856Z 		{
2024-10-08T20:15:15.0355288Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0355852Z 			"size": 32,
2024-10-08T20:15:15.0356420Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0357080Z 		},
2024-10-08T20:15:15.0357320Z 		{
2024-10-08T20:15:15.0357751Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0358326Z 			"size": 106,
2024-10-08T20:15:15.0358881Z 			"digest": "sha256:d5238b78eb78669bd9b1c2d8f286b9c303e86985328db8056a8a39d945708807"
2024-10-08T20:15:15.0359524Z 		},
2024-10-08T20:15:15.0359745Z 		{
2024-10-08T20:15:15.0360191Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0360770Z 			"size": 425,
2024-10-08T20:15:15.0361321Z 			"digest": "sha256:08a1ab806f6229919cba8cd2f2ada1310609d6d5dfca5f00e6003c8f3ffcaad1"
2024-10-08T20:15:15.0361976Z 		},
2024-10-08T20:15:15.0362209Z 		{
2024-10-08T20:15:15.0362646Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0363305Z 			"size": 19308702,
2024-10-08T20:15:15.0363888Z 			"digest": "sha256:fa004c48a469806583860a359faeb88f6b4316802909edd534eb3c25a843ea69"
2024-10-08T20:15:15.0364525Z 		},
2024-10-08T20:15:15.0364762Z 		{
2024-10-08T20:15:15.0365192Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0365777Z 			"size": 108,
2024-10-08T20:15:15.0366337Z 			"digest": "sha256:0ec870d0e31d0c729aa291c73fa0599d1d49bb36c01998923c982bd87f47b024"
2024-10-08T20:15:15.0366974Z 		},
2024-10-08T20:15:15.0367208Z 		{
2024-10-08T20:15:15.0367656Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0368234Z 			"size": 440,
2024-10-08T20:15:15.0368784Z 			"digest": "sha256:ee28aa8bac12d42802fc9a13e8f64f753418413b61e5f8b57ca163177c725be6"
2024-10-08T20:15:15.0369440Z 		},
2024-10-08T20:15:15.0369676Z 		{
2024-10-08T20:15:15.0370111Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0370678Z 			"size": 700,
2024-10-08T20:15:15.0371256Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0372026Z 		},
2024-10-08T20:15:15.0372262Z 		{
2024-10-08T20:15:15.0372787Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0373375Z 			"size": 141,
2024-10-08T20:15:15.0373939Z 			"digest": "sha256:87e7ed7d55045ee10885ba43d93e7ca443deee33bd0c302e2f4a435207e1088e"
2024-10-08T20:15:15.0374573Z 		},
2024-10-08T20:15:15.0374808Z 		{
2024-10-08T20:15:15.0375250Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0375825Z 			"size": 135,
2024-10-08T20:15:15.0376366Z 			"digest": "sha256:84c40208c87a8f9d08f3063acf460e46537c91291ff49d73e1a6f4bf2f774106"
2024-10-08T20:15:15.0377011Z 		},
2024-10-08T20:15:15.0377246Z 		{
2024-10-08T20:15:15.0377686Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0378245Z 			"size": 32,
2024-10-08T20:15:15.0378805Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0379462Z 		},
2024-10-08T20:15:15.0379692Z 		{
2024-10-08T20:15:15.0380132Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0380711Z 			"size": 195,
2024-10-08T20:15:15.0381356Z 			"digest": "sha256:cb6b59ddc5d9205bd63d10fdb7bcce3782420a80b611433739a2b6c882a544e8"
2024-10-08T20:15:15.0382004Z 		},
2024-10-08T20:15:15.0382242Z 		{
2024-10-08T20:15:15.0382686Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0383263Z 			"size": 1402,
2024-10-08T20:15:15.0383823Z 			"digest": "sha256:2a9c0ccedd86465eb59c1b7e4ad662227cf2c24a1a4974a5984d688210e84e5c"
2024-10-08T20:15:15.0384487Z 		},
2024-10-08T20:15:15.0384726Z 		{
2024-10-08T20:15:15.0385153Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0385734Z 			"size": 700,
2024-10-08T20:15:15.0386302Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0386959Z 		},
2024-10-08T20:15:15.0387182Z 		{
2024-10-08T20:15:15.0387626Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0388205Z 			"size": 136,
2024-10-08T20:15:15.0388995Z 			"digest": "sha256:06f2af43246c55af00e3c0a112e059ce482cb31843eb1adb1087abfa4ca2f14b"
2024-10-08T20:15:15.0389644Z 		},
2024-10-08T20:15:15.0389881Z 		{
2024-10-08T20:15:15.0390324Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0390908Z 			"size": 3676575640,
2024-10-08T20:15:15.0391487Z 			"digest": "sha256:edd2406f6f94d57a927d7dd0d734d95c2ff0040c6ca6a9726c223c401c388dbd"
2024-10-08T20:15:15.0392140Z 		},
2024-10-08T20:15:15.0392376Z 		{
2024-10-08T20:15:15.0392804Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0393385Z 			"size": 155,
2024-10-08T20:15:15.0393963Z 			"digest": "sha256:ad282c1cfc4ae459bb0808f71faecd10fe438ce6f41c896c16a04c2db99a8472"
2024-10-08T20:15:15.0394628Z 		},
2024-10-08T20:15:15.0394852Z 		{
2024-10-08T20:15:15.0395297Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0395883Z 			"size": 1402,
2024-10-08T20:15:15.0396454Z 			"digest": "sha256:2a9c0ccedd86465eb59c1b7e4ad662227cf2c24a1a4974a5984d688210e84e5c"
2024-10-08T20:15:15.0397103Z 		},
2024-10-08T20:15:15.0397339Z 		{
2024-10-08T20:15:15.0397780Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0398359Z 			"size": 700,
2024-10-08T20:15:15.0398916Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0399572Z 		},
2024-10-08T20:15:15.0399809Z 		{
2024-10-08T20:15:15.0400239Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0400818Z 			"size": 141,
2024-10-08T20:15:15.0401380Z 			"digest": "sha256:42ffc2d817b5b2aa664fcc543cefe53700cef1847fd55c17f867374c0138abba"
2024-10-08T20:15:15.0402039Z 		},
2024-10-08T20:15:15.0402263Z 		{
2024-10-08T20:15:15.0402699Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0403438Z 			"size": 32,
2024-10-08T20:15:15.0404011Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0404660Z 		},
2024-10-08T20:15:15.0404897Z 		{
2024-10-08T20:15:15.0405337Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0405902Z 			"size": 161,
2024-10-08T20:15:15.0406469Z 			"digest": "sha256:db05c397e8999343d9f2837d74ab0a1e8e3ce3cf51d111e17c2cb9ae4e5b496d"
2024-10-08T20:15:15.0407126Z 		},
2024-10-08T20:15:15.0407359Z 		{
2024-10-08T20:15:15.0407788Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0408365Z 			"size": 848,
2024-10-08T20:15:15.0408915Z 			"digest": "sha256:87f69c75532796ae7872a2820feee65bc9881b002f50d0c2b2527b1ecb91d8d8"
2024-10-08T20:15:15.0409557Z 		},
2024-10-08T20:15:15.0409781Z 		{
2024-10-08T20:15:15.0410219Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0410803Z 			"size": 700,
2024-10-08T20:15:15.0411374Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0412022Z 		},
2024-10-08T20:15:15.0412260Z 		{
2024-10-08T20:15:15.0412900Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0413463Z 			"size": 141,
2024-10-08T20:15:15.0414017Z 			"digest": "sha256:c4fa0960d4815a3f14342a444a38b037a9c6bd49747e438a0fc6d15aa171e30a"
2024-10-08T20:15:15.0414666Z 		},
2024-10-08T20:15:15.0414901Z 		{
2024-10-08T20:15:15.0415329Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0415908Z 			"size": 32,
2024-10-08T20:15:15.0416474Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0417130Z 		},
2024-10-08T20:15:15.0417351Z 		{
2024-10-08T20:15:15.0417840Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0418419Z 			"size": 159,
2024-10-08T20:15:15.0418977Z 			"digest": "sha256:ac10e2b22d84530381a7d5d2001cccac6e6c022029ada6f94cbf3a43d992af0f"
2024-10-08T20:15:15.0419634Z 		},
2024-10-08T20:15:15.0419870Z 		{
2024-10-08T20:15:15.0420312Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0420882Z 			"size": 907,
2024-10-08T20:15:15.0421467Z 			"digest": "sha256:7a9abc0bdacee1e33d0f771ebacb0d5acc2893990824cdfe9c26a00f367ff8c1"
2024-10-08T20:15:15.0422141Z 		},
2024-10-08T20:15:15.0422377Z 		{
2024-10-08T20:15:15.0422803Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0423381Z 			"size": 700,
2024-10-08T20:15:15.0423945Z 			"digest": "sha256:c2eab51c06ba0d0680c2d614a52fe81e662731f8f3cce39a0fa827ea331008c6"
2024-10-08T20:15:15.0424599Z 		},
2024-10-08T20:15:15.0424822Z 		{
2024-10-08T20:15:15.0425267Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0425845Z 			"size": 135,
2024-10-08T20:15:15.0426384Z 			"digest": "sha256:da0274fd9564191a801bf25a2d1510d39de83d89ae29941d454a677882ec4e11"
2024-10-08T20:15:15.0427030Z 		},
2024-10-08T20:15:15.0427265Z 		{
2024-10-08T20:15:15.0427704Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0428278Z 			"size": 32,
2024-10-08T20:15:15.0428838Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0429495Z 		},
2024-10-08T20:15:15.0429732Z 		{
2024-10-08T20:15:15.0430155Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0430730Z 			"size": 158,
2024-10-08T20:15:15.0431277Z 			"digest": "sha256:2252a0093000a80d02b7dd52035e4c779374f0d38347c66ad20ed0ed5283fe6a"
2024-10-08T20:15:15.0431910Z 		},
2024-10-08T20:15:15.0432134Z 		{
2024-10-08T20:15:15.0432575Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0433156Z 			"size": 1519,
2024-10-08T20:15:15.0433714Z 			"digest": "sha256:8d3f20cf4eb307cd0f0783a8e01e78119dadd550e51ef419c3d8a758c8e3cb37"
2024-10-08T20:15:15.0434366Z 		},
2024-10-08T20:15:15.0434698Z 		{
2024-10-08T20:15:15.0435142Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0435705Z 			"size": 32,
2024-10-08T20:15:15.0436278Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0436938Z 		},
2024-10-08T20:15:15.0437174Z 		{
2024-10-08T20:15:15.0437602Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0438181Z 			"size": 136,
2024-10-08T20:15:15.0438730Z 			"digest": "sha256:70176d530fec94570bf6b05c399610a09211a26f5f9100b09c48a62059b11fdf"
2024-10-08T20:15:15.0439347Z 		},
2024-10-08T20:15:15.0439581Z 		{
2024-10-08T20:15:15.0440022Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0440602Z 			"size": 379,
2024-10-08T20:15:15.0441162Z 			"digest": "sha256:70a6862ebeb0ea0e12faf771a75d2cdd8f472f990b863b2e97a3626b7b05d546"
2024-10-08T20:15:15.0441825Z 		},
2024-10-08T20:15:15.0442061Z 		{
2024-10-08T20:15:15.0442509Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0443075Z 			"size": 32,
2024-10-08T20:15:15.0443638Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0444389Z 		},
2024-10-08T20:15:15.0444613Z 		{
2024-10-08T20:15:15.0445057Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0445639Z 			"size": 104,
2024-10-08T20:15:15.0446205Z 			"digest": "sha256:ad3a30f38c12bba493391e94686d8f0e7655058dd4ae7d2ee6babe2972048750"
2024-10-08T20:15:15.0446851Z 		},
2024-10-08T20:15:15.0447088Z 		{
2024-10-08T20:15:15.0447524Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0448098Z 			"size": 1841,
2024-10-08T20:15:15.0448662Z 			"digest": "sha256:5784c31fa1c5dd7e6b66418d43a45cf13fc01bedf2d168ad3d9dab3d9adb7fb6"
2024-10-08T20:15:15.0449325Z 		},
2024-10-08T20:15:15.0449558Z 		{
2024-10-08T20:15:15.0450000Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0450566Z 			"size": 7529604,
2024-10-08T20:15:15.0451124Z 			"digest": "sha256:010303d9e03bb1b513874fd364f0dcf89781762ed66c209a804977031e073730"
2024-10-08T20:15:15.0451765Z 		},
2024-10-08T20:15:15.0451988Z 		{
2024-10-08T20:15:15.0452427Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0453114Z 			"size": 106,
2024-10-08T20:15:15.0453664Z 			"digest": "sha256:55c652d459ca343489801a604db4464c031655915fa23d44e3ff318abbebd713"
2024-10-08T20:15:15.0454284Z 		},
2024-10-08T20:15:15.0454520Z 		{
2024-10-08T20:15:15.0454963Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0455537Z 			"size": 164,
2024-10-08T20:15:15.0456086Z 			"digest": "sha256:10e4872f8f41bd264f5756594947d4bf503e8dfb8ad2a80ee2ae2d2d8673610b"
2024-10-08T20:15:15.0456731Z 		},
2024-10-08T20:15:15.0456973Z 		{
2024-10-08T20:15:15.0457399Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0457978Z 			"size": 7943,
2024-10-08T20:15:15.0458555Z 			"digest": "sha256:376abd9faba02b81fa5a254a011fd2f1472f9c0d521b55a41fb8c812d88a6f5f"
2024-10-08T20:15:15.0459220Z 		},
2024-10-08T20:15:15.0459446Z 		{
2024-10-08T20:15:15.0459884Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0460460Z 			"size": 8067,
2024-10-08T20:15:15.0461027Z 			"digest": "sha256:aca1780f31b189429c4838a89e00df89351b18ec2c1df1d8a598ba569d8ed454"
2024-10-08T20:15:15.0461664Z 		},
2024-10-08T20:15:15.0461895Z 		{
2024-10-08T20:15:15.0462334Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0462914Z 			"size": 301,
2024-10-08T20:15:15.0463457Z 			"digest": "sha256:7e29c9ae3d8c3824b07bc82f8526d08235c4386d25c0b21c3f0596007b3d14f4"
2024-10-08T20:15:15.0464103Z 		},
2024-10-08T20:15:15.0464337Z 		{
2024-10-08T20:15:15.0464766Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0465346Z 			"size": 32,
2024-10-08T20:15:15.0466007Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0466673Z 		},
2024-10-08T20:15:15.0466893Z 		{
2024-10-08T20:15:15.0467339Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0467925Z 			"size": 108,
2024-10-08T20:15:15.0468478Z 			"digest": "sha256:54723b6b8c0fb63275295f0306c16b037b920dd388d18a67ac8cfba72af5ac05"
2024-10-08T20:15:15.0469102Z 		},
2024-10-08T20:15:15.0469337Z 		{
2024-10-08T20:15:15.0469779Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0470344Z 			"size": 54145664,
2024-10-08T20:15:15.0470933Z 			"digest": "sha256:2af31c2959ac823acd2ee09ebf425371ad14e3b820362efeb096e94427f307a4"
2024-10-08T20:15:15.0471592Z 		},
2024-10-08T20:15:15.0471828Z 		{
2024-10-08T20:15:15.0472257Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-10-08T20:15:15.0472833Z 			"size": 32,
2024-10-08T20:15:15.0473401Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-10-08T20:15:15.0474050Z 		}
2024-10-08T20:15:15.0474268Z 	]
2024-10-08T20:15:15.0474497Z }
2024-10-08T20:15:15.0474844Z + exit 0
2024-10-08T20:15:15.0585351Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/}
2024-10-08T20:15:15.0585840Z tag=${ECR_DOCKER_IMAGE##*/}
2024-10-08T20:15:15.0586409Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}"
2024-10-08T20:15:15.0593694Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:15.0594195Z env:
2024-10-08T20:15:15.0594466Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:15.0595484Z   ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.0596543Z ##[endgroup]
2024-10-08T20:15:15.0623626Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.9-gcc11-46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.0679421Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main
2024-10-08T20:15:15.0680016Z with:
2024-10-08T20:15:15.0680931Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.0682143Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:15.0682666Z env:
2024-10-08T20:15:15.0682935Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:15.0683280Z ##[endgroup]
2024-10-08T20:15:15.0713306Z ##[group]Run set -x
2024-10-08T20:15:15.0713639Z set -x
2024-10-08T20:15:15.0713920Z set +e
2024-10-08T20:15:15.0714204Z 
2024-10-08T20:15:15.0714473Z login() {
2024-10-08T20:15:15.0715168Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-10-08T20:15:15.0715911Z }
2024-10-08T20:15:15.0716178Z 
2024-10-08T20:15:15.0716498Z retry () {
2024-10-08T20:15:15.0716873Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-10-08T20:15:15.0717330Z }
2024-10-08T20:15:15.0717596Z 
2024-10-08T20:15:15.0717893Z retry login "${DOCKER_REGISTRY}"
2024-10-08T20:15:15.0718325Z 
2024-10-08T20:15:15.0718589Z set -e
2024-10-08T20:15:15.0719071Z # ignore output since only exit code is used for conditional
2024-10-08T20:15:15.0719792Z # only pull docker image if it's not available locally
2024-10-08T20:15:15.0720595Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then
2024-10-08T20:15:15.0721330Z   retry docker pull "${DOCKER_IMAGE}"
2024-10-08T20:15:15.0721775Z fi
2024-10-08T20:15:15.0727660Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:15:15.0728180Z env:
2024-10-08T20:15:15.0728451Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:15:15.0729446Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.0730620Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:15.0731146Z ##[endgroup]
2024-10-08T20:15:15.0755457Z + set +e
2024-10-08T20:15:15.0756377Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:15.0757088Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:15.0758911Z + aws ecr get-login-password --region us-east-1
2024-10-08T20:15:15.0760120Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-10-08T20:15:15.6509669Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-10-08T20:15:15.6510648Z Configure a credential helper to remove this warning. See
2024-10-08T20:15:15.6511621Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-10-08T20:15:15.6512189Z 
2024-10-08T20:15:15.6512315Z Login Succeeded
2024-10-08T20:15:15.6522688Z + set -e
2024-10-08T20:15:15.6525012Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.6662099Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.6663996Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:15:15.8870080Z 46f3eb402e47f9fae93ec1dc1f6772950f4498aa: Pulling from pytorch/pytorch-linux-jammy-py3.9-gcc11
2024-10-08T20:15:15.8884309Z 7478e0ac0f23: Pulling fs layer
2024-10-08T20:15:15.8885562Z aeab40a9053a: Pulling fs layer
2024-10-08T20:15:15.8886564Z d4486831345c: Pulling fs layer
2024-10-08T20:15:15.8887523Z 041cb9a31c77: Pulling fs layer
2024-10-08T20:15:15.8888919Z 3d701f869134: Pulling fs layer
2024-10-08T20:15:15.8890077Z 9309aa962cc8: Pulling fs layer
2024-10-08T20:15:15.8890760Z be689962a1be: Pulling fs layer
2024-10-08T20:15:15.8891406Z 8c7b0ce86f79: Pulling fs layer
2024-10-08T20:15:15.8891975Z 8c6851927b6c: Pulling fs layer
2024-10-08T20:15:15.8892365Z fd59f13891ba: Pulling fs layer
2024-10-08T20:15:15.8892898Z 97c1b41b63e7: Pulling fs layer
2024-10-08T20:15:15.8893532Z c2eab51c06ba: Pulling fs layer
2024-10-08T20:15:15.8894144Z 3d701f869134: Waiting
2024-10-08T20:15:15.8894681Z 1fd2453d8064: Pulling fs layer
2024-10-08T20:15:15.8895317Z be689962a1be: Waiting
2024-10-08T20:15:15.8895831Z 4f4fb700ef54: Pulling fs layer
2024-10-08T20:15:15.8896419Z 9309aa962cc8: Waiting
2024-10-08T20:15:15.8896975Z 8c7b0ce86f79: Waiting
2024-10-08T20:15:15.8897560Z 30e9141805d5: Pulling fs layer
2024-10-08T20:15:15.8898119Z 8c6851927b6c: Waiting
2024-10-08T20:15:15.8898508Z e355280ca495: Pulling fs layer
2024-10-08T20:15:15.8898870Z 97c1b41b63e7: Waiting
2024-10-08T20:15:15.8899179Z fd59f13891ba: Waiting
2024-10-08T20:15:15.8899504Z 124d36bf6745: Pulling fs layer
2024-10-08T20:15:15.8899865Z c2eab51c06ba: Waiting
2024-10-08T20:15:15.8900193Z 6e9e8e478857: Pulling fs layer
2024-10-08T20:15:15.8900569Z 91a703b7bb47: Pulling fs layer
2024-10-08T20:15:15.8900927Z 7e47d022e430: Pulling fs layer
2024-10-08T20:15:15.8901298Z 1fd2453d8064: Waiting
2024-10-08T20:15:15.8901630Z 6731cd6c1a8b: Pulling fs layer
2024-10-08T20:15:15.8901974Z e355280ca495: Waiting
2024-10-08T20:15:15.8902280Z 124d36bf6745: Waiting
2024-10-08T20:15:15.8902593Z 4f4fb700ef54: Waiting
2024-10-08T20:15:15.8902923Z badcfd30f4ab: Pulling fs layer
2024-10-08T20:15:15.8903341Z 041cb9a31c77: Waiting
2024-10-08T20:15:15.8903651Z 30e9141805d5: Waiting
2024-10-08T20:15:15.8904034Z 7c478fa099b8: Pulling fs layer
2024-10-08T20:15:15.8904384Z 6e9e8e478857: Waiting
2024-10-08T20:15:15.8904744Z 6731cd6c1a8b: Waiting
2024-10-08T20:15:15.8905073Z 1fca2f347a8c: Pulling fs layer
2024-10-08T20:15:15.8905501Z badcfd30f4ab: Waiting
2024-10-08T20:15:15.8905801Z 7e47d022e430: Waiting
2024-10-08T20:15:15.8906130Z 90e80f141d97: Pulling fs layer
2024-10-08T20:15:15.8906585Z 2fa21a5a9903: Pulling fs layer
2024-10-08T20:15:15.8906967Z 8daafb98cf75: Pulling fs layer
2024-10-08T20:15:15.8907385Z 91a703b7bb47: Waiting
2024-10-08T20:15:15.8907711Z 25fe74fe1965: Pulling fs layer
2024-10-08T20:15:15.8908083Z 7c478fa099b8: Waiting
2024-10-08T20:15:15.8908379Z 90e80f141d97: Waiting
2024-10-08T20:15:15.8908701Z 23f1488f7771: Pulling fs layer
2024-10-08T20:15:15.8909061Z 2fa21a5a9903: Waiting
2024-10-08T20:15:15.8909396Z 8daafb98cf75: Waiting
2024-10-08T20:15:15.8909747Z efa31f26e3b7: Pulling fs layer
2024-10-08T20:15:15.8910160Z 25fe74fe1965: Waiting
2024-10-08T20:15:15.8910469Z 23f1488f7771: Waiting
2024-10-08T20:15:15.8910791Z 30120af386eb: Pulling fs layer
2024-10-08T20:15:15.8911147Z 7052567f0a85: Pulling fs layer
2024-10-08T20:15:15.8911580Z 48c59746051f: Pulling fs layer
2024-10-08T20:15:15.8911952Z a97bb6751d5c: Pulling fs layer
2024-10-08T20:15:15.8912313Z 721ea279f1ec: Pulling fs layer
2024-10-08T20:15:15.8912745Z 1dfa26f43437: Pulling fs layer
2024-10-08T20:15:15.8913118Z 063cba812af2: Pulling fs layer
2024-10-08T20:15:15.8913539Z 30120af386eb: Waiting
2024-10-08T20:15:15.8913855Z 04271b510e77: Pulling fs layer
2024-10-08T20:15:15.8914280Z 7052567f0a85: Waiting
2024-10-08T20:15:15.8914787Z 48c59746051f: Waiting
2024-10-08T20:15:15.8915115Z ab62990fb550: Pulling fs layer
2024-10-08T20:15:15.8915535Z ff4be702052d: Pulling fs layer
2024-10-08T20:15:15.8915892Z 063cba812af2: Waiting
2024-10-08T20:15:15.8916215Z cd7099b12fa2: Pulling fs layer
2024-10-08T20:15:15.8916561Z 04271b510e77: Waiting
2024-10-08T20:15:15.8916916Z a97bb6751d5c: Waiting
2024-10-08T20:15:15.8917268Z ab62990fb550: Waiting
2024-10-08T20:15:15.8917659Z d3fc4fda5d34: Pulling fs layer
2024-10-08T20:15:15.8918028Z 721ea279f1ec: Waiting
2024-10-08T20:15:15.8918345Z 2eb55b65a374: Pulling fs layer
2024-10-08T20:15:15.8918707Z ff4be702052d: Waiting
2024-10-08T20:15:15.8919024Z d3fc4fda5d34: Waiting
2024-10-08T20:15:15.8919343Z 5a1de3e09cb8: Pulling fs layer
2024-10-08T20:15:15.8919825Z cd7099b12fa2: Waiting
2024-10-08T20:15:15.8920141Z 5a1de3e09cb8: Waiting
2024-10-08T20:15:15.8920537Z 54f00623ecc4: Pulling fs layer
2024-10-08T20:15:15.8920889Z 2eb55b65a374: Waiting
2024-10-08T20:15:15.8921305Z 1fca2f347a8c: Waiting
2024-10-08T20:15:15.8921651Z d5238b78eb78: Pulling fs layer
2024-10-08T20:15:15.8922027Z 08a1ab806f62: Pulling fs layer
2024-10-08T20:15:15.8922392Z fa004c48a469: Pulling fs layer
2024-10-08T20:15:15.8922755Z 54f00623ecc4: Waiting
2024-10-08T20:15:15.8923080Z 0ec870d0e31d: Pulling fs layer
2024-10-08T20:15:15.8923441Z ee28aa8bac12: Pulling fs layer
2024-10-08T20:15:15.8923800Z fa004c48a469: Waiting
2024-10-08T20:15:15.8924105Z 08a1ab806f62: Waiting
2024-10-08T20:15:15.8924563Z 87e7ed7d5504: Pulling fs layer
2024-10-08T20:15:15.8925177Z 84c40208c87a: Pulling fs layer
2024-10-08T20:15:15.8925793Z ee28aa8bac12: Waiting
2024-10-08T20:15:15.8926295Z 0ec870d0e31d: Waiting
2024-10-08T20:15:15.8926802Z 87e7ed7d5504: Waiting
2024-10-08T20:15:15.8927363Z cb6b59ddc5d9: Pulling fs layer
2024-10-08T20:15:15.8927875Z 2a9c0ccedd86: Pulling fs layer
2024-10-08T20:15:15.8928313Z cb6b59ddc5d9: Waiting
2024-10-08T20:15:15.8928633Z 2a9c0ccedd86: Waiting
2024-10-08T20:15:15.8928959Z 06f2af43246c: Pulling fs layer
2024-10-08T20:15:15.8929360Z edd2406f6f94: Pulling fs layer
2024-10-08T20:15:15.8929740Z ad282c1cfc4a: Pulling fs layer
2024-10-08T20:15:15.8930108Z 42ffc2d817b5: Pulling fs layer
2024-10-08T20:15:15.8930483Z db05c397e899: Pulling fs layer
2024-10-08T20:15:15.8930844Z 06f2af43246c: Waiting
2024-10-08T20:15:15.8931166Z 87f69c755327: Pulling fs layer
2024-10-08T20:15:15.8931510Z 42ffc2d817b5: Waiting
2024-10-08T20:15:15.8931833Z edd2406f6f94: Waiting
2024-10-08T20:15:15.8932163Z c4fa0960d481: Pulling fs layer
2024-10-08T20:15:15.8932599Z 87f69c755327: Waiting
2024-10-08T20:15:15.8932989Z ac10e2b22d84: Pulling fs layer
2024-10-08T20:15:15.8933373Z 7a9abc0bdace: Pulling fs layer
2024-10-08T20:15:15.8933781Z db05c397e899: Waiting
2024-10-08T20:15:15.8934178Z da0274fd9564: Pulling fs layer
2024-10-08T20:15:15.8934576Z ac10e2b22d84: Waiting
2024-10-08T20:15:15.8934889Z 7a9abc0bdace: Waiting
2024-10-08T20:15:15.8935206Z 2252a0093000: Pulling fs layer
2024-10-08T20:15:15.8935583Z 8d3f20cf4eb3: Pulling fs layer
2024-10-08T20:15:15.8935953Z c4fa0960d481: Waiting
2024-10-08T20:15:15.8936265Z 8d3f20cf4eb3: Waiting
2024-10-08T20:15:15.8936579Z 70176d530fec: Pulling fs layer
2024-10-08T20:15:15.8936951Z 70a6862ebeb0: Pulling fs layer
2024-10-08T20:15:15.8937305Z 70176d530fec: Waiting
2024-10-08T20:15:15.8937629Z ad3a30f38c12: Pulling fs layer
2024-10-08T20:15:15.8937993Z 5784c31fa1c5: Pulling fs layer
2024-10-08T20:15:15.8938350Z 70a6862ebeb0: Waiting
2024-10-08T20:15:15.8938673Z 010303d9e03b: Pulling fs layer
2024-10-08T20:15:15.8939022Z 5784c31fa1c5: Waiting
2024-10-08T20:15:15.8939343Z 010303d9e03b: Waiting
2024-10-08T20:15:15.8939672Z ad3a30f38c12: Waiting
2024-10-08T20:15:15.8940012Z 55c652d459ca: Pulling fs layer
2024-10-08T20:15:15.8940404Z 10e4872f8f41: Pulling fs layer
2024-10-08T20:15:15.8940814Z 376abd9faba0: Pulling fs layer
2024-10-08T20:15:15.8941210Z aca1780f31b1: Pulling fs layer
2024-10-08T20:15:15.8941579Z 10e4872f8f41: Waiting
2024-10-08T20:15:15.8941898Z aca1780f31b1: Waiting
2024-10-08T20:15:15.8942398Z 7e29c9ae3d8c: Pulling fs layer
2024-10-08T20:15:15.8942774Z 7e29c9ae3d8c: Waiting
2024-10-08T20:15:15.8943088Z 54723b6b8c0f: Pulling fs layer
2024-10-08T20:15:15.8943464Z 2af31c2959ac: Pulling fs layer
2024-10-08T20:15:15.8943823Z 2af31c2959ac: Waiting
2024-10-08T20:15:15.8944136Z 54723b6b8c0f: Waiting
2024-10-08T20:15:15.8944431Z d5238b78eb78: Waiting
2024-10-08T20:15:15.9790839Z aeab40a9053a: Verifying Checksum
2024-10-08T20:15:15.9791578Z aeab40a9053a: Download complete
2024-10-08T20:15:16.0593416Z 041cb9a31c77: Verifying Checksum
2024-10-08T20:15:16.0593897Z 041cb9a31c77: Download complete
2024-10-08T20:15:16.1818998Z 3d701f869134: Verifying Checksum
2024-10-08T20:15:16.1819736Z 3d701f869134: Download complete
2024-10-08T20:15:16.2449204Z 9309aa962cc8: Verifying Checksum
2024-10-08T20:15:16.2450087Z 9309aa962cc8: Download complete
2024-10-08T20:15:16.2488188Z 7478e0ac0f23: Download complete
2024-10-08T20:15:16.3311033Z be689962a1be: Verifying Checksum
2024-10-08T20:15:16.3311580Z be689962a1be: Download complete
2024-10-08T20:15:16.3606988Z 8c7b0ce86f79: Verifying Checksum
2024-10-08T20:15:16.3607648Z 8c7b0ce86f79: Download complete
2024-10-08T20:15:16.4443249Z fd59f13891ba: Verifying Checksum
2024-10-08T20:15:16.4443975Z fd59f13891ba: Download complete
2024-10-08T20:15:16.5170375Z 97c1b41b63e7: Verifying Checksum
2024-10-08T20:15:16.5171216Z 97c1b41b63e7: Download complete
2024-10-08T20:15:16.5999398Z c2eab51c06ba: Verifying Checksum
2024-10-08T20:15:16.6000241Z c2eab51c06ba: Download complete
2024-10-08T20:15:17.2519694Z 7478e0ac0f23: Pull complete
2024-10-08T20:15:17.2694557Z aeab40a9053a: Pull complete
2024-10-08T20:15:17.4753195Z 8c6851927b6c: Verifying Checksum
2024-10-08T20:15:17.4753704Z 8c6851927b6c: Download complete
2024-10-08T20:15:17.4822032Z 4f4fb700ef54: Verifying Checksum
2024-10-08T20:15:17.4822528Z 4f4fb700ef54: Download complete
2024-10-08T20:15:17.5619098Z 30e9141805d5: Verifying Checksum
2024-10-08T20:15:17.5619638Z 30e9141805d5: Download complete
2024-10-08T20:15:17.6525237Z e355280ca495: Verifying Checksum
2024-10-08T20:15:17.7258084Z 124d36bf6745: Download complete
2024-10-08T20:15:17.8278102Z 6e9e8e478857: Verifying Checksum
2024-10-08T20:15:17.8278610Z 6e9e8e478857: Download complete
2024-10-08T20:15:17.9105370Z 91a703b7bb47: Verifying Checksum
2024-10-08T20:15:17.9106150Z 91a703b7bb47: Download complete
2024-10-08T20:15:17.9919745Z 7e47d022e430: Verifying Checksum
2024-10-08T20:15:17.9920294Z 7e47d022e430: Download complete
2024-10-08T20:15:18.0648102Z 6731cd6c1a8b: Verifying Checksum
2024-10-08T20:15:18.0648859Z 6731cd6c1a8b: Download complete
2024-10-08T20:15:18.1663430Z badcfd30f4ab: Verifying Checksum
2024-10-08T20:15:18.1664256Z badcfd30f4ab: Download complete
2024-10-08T20:15:18.2490001Z 7c478fa099b8: Verifying Checksum
2024-10-08T20:15:18.2490664Z 7c478fa099b8: Download complete
2024-10-08T20:15:19.1592271Z d4486831345c: Verifying Checksum
2024-10-08T20:15:19.1593120Z d4486831345c: Download complete
2024-10-08T20:15:19.2274477Z 90e80f141d97: Verifying Checksum
2024-10-08T20:15:19.2275314Z 90e80f141d97: Download complete
2024-10-08T20:15:19.3163811Z 2fa21a5a9903: Download complete
2024-10-08T20:15:19.3469787Z 1fca2f347a8c: Verifying Checksum
2024-10-08T20:15:19.3470421Z 1fca2f347a8c: Download complete
2024-10-08T20:15:19.4015854Z 8daafb98cf75: Verifying Checksum
2024-10-08T20:15:19.4016579Z 8daafb98cf75: Download complete
2024-10-08T20:15:19.4237488Z 25fe74fe1965: Verifying Checksum
2024-10-08T20:15:19.4238190Z 25fe74fe1965: Download complete
2024-10-08T20:15:19.4838513Z 23f1488f7771: Verifying Checksum
2024-10-08T20:15:19.4839273Z 23f1488f7771: Download complete
2024-10-08T20:15:19.5625435Z 30120af386eb: Verifying Checksum
2024-10-08T20:15:19.5626046Z 30120af386eb: Download complete
2024-10-08T20:15:19.6370381Z 7052567f0a85: Download complete
2024-10-08T20:15:19.7383772Z 48c59746051f: Download complete
2024-10-08T20:15:19.8235132Z a97bb6751d5c: Verifying Checksum
2024-10-08T20:15:19.8235988Z a97bb6751d5c: Download complete
2024-10-08T20:15:19.9070705Z 721ea279f1ec: Download complete
2024-10-08T20:15:19.9896755Z 1dfa26f43437: Verifying Checksum
2024-10-08T20:15:19.9897590Z 1dfa26f43437: Download complete
2024-10-08T20:15:20.0642764Z 063cba812af2: Download complete
2024-10-08T20:15:20.1263067Z 04271b510e77: Verifying Checksum
2024-10-08T20:15:20.1263888Z 04271b510e77: Download complete
2024-10-08T20:15:20.2050792Z ab62990fb550: Verifying Checksum
2024-10-08T20:15:20.2051605Z ab62990fb550: Download complete
2024-10-08T20:15:20.2885116Z ff4be702052d: Verifying Checksum
2024-10-08T20:15:20.2885797Z ff4be702052d: Download complete
2024-10-08T20:15:20.3667002Z cd7099b12fa2: Verifying Checksum
2024-10-08T20:15:20.3667782Z cd7099b12fa2: Download complete
2024-10-08T20:15:20.4441947Z d3fc4fda5d34: Verifying Checksum
2024-10-08T20:15:20.4443022Z d3fc4fda5d34: Download complete
2024-10-08T20:15:20.9490772Z 2eb55b65a374: Verifying Checksum
2024-10-08T20:15:20.9491595Z 2eb55b65a374: Download complete
2024-10-08T20:15:21.0447563Z 5a1de3e09cb8: Verifying Checksum
2024-10-08T20:15:21.0448750Z 5a1de3e09cb8: Download complete
2024-10-08T20:15:21.1268837Z 54f00623ecc4: Verifying Checksum
2024-10-08T20:15:21.1269747Z 54f00623ecc4: Download complete
2024-10-08T20:15:21.2051602Z d5238b78eb78: Download complete
2024-10-08T20:15:21.2856660Z 08a1ab806f62: Download complete
2024-10-08T20:15:21.6411559Z 0ec870d0e31d: Verifying Checksum
2024-10-08T20:15:21.6412344Z 0ec870d0e31d: Download complete
2024-10-08T20:15:21.7289791Z ee28aa8bac12: Verifying Checksum
2024-10-08T20:15:21.7290359Z ee28aa8bac12: Download complete
2024-10-08T20:15:21.8107360Z 87e7ed7d5504: Download complete
2024-10-08T20:15:21.8784428Z 84c40208c87a: Verifying Checksum
2024-10-08T20:15:21.8785172Z 84c40208c87a: Download complete
2024-10-08T20:15:21.9419319Z cb6b59ddc5d9: Verifying Checksum
2024-10-08T20:15:21.9420181Z cb6b59ddc5d9: Download complete
2024-10-08T20:15:22.0157566Z 2a9c0ccedd86: Verifying Checksum
2024-10-08T20:15:22.0158394Z 2a9c0ccedd86: Download complete
2024-10-08T20:15:22.0905206Z 06f2af43246c: Verifying Checksum
2024-10-08T20:15:22.0905823Z 06f2af43246c: Download complete
2024-10-08T20:15:25.6511132Z efa31f26e3b7: Verifying Checksum
2024-10-08T20:15:25.6511765Z efa31f26e3b7: Download complete
2024-10-08T20:15:25.7434234Z ad282c1cfc4a: Verifying Checksum
2024-10-08T20:15:25.7434787Z ad282c1cfc4a: Download complete
2024-10-08T20:15:25.8214156Z 42ffc2d817b5: Download complete
2024-10-08T20:15:25.9025590Z db05c397e899: Verifying Checksum
2024-10-08T20:15:25.9026522Z db05c397e899: Download complete
2024-10-08T20:15:25.9700616Z 87f69c755327: Verifying Checksum
2024-10-08T20:15:25.9701367Z 87f69c755327: Download complete
2024-10-08T20:15:26.0425565Z c4fa0960d481: Verifying Checksum
2024-10-08T20:15:26.0426264Z c4fa0960d481: Download complete
2024-10-08T20:15:26.1323491Z ac10e2b22d84: Download complete
2024-10-08T20:15:26.2200359Z 7a9abc0bdace: Download complete
2024-10-08T20:15:26.3019673Z da0274fd9564: Download complete
2024-10-08T20:15:26.3838400Z 2252a0093000: Verifying Checksum
2024-10-08T20:15:26.3839006Z 2252a0093000: Download complete
2024-10-08T20:15:26.4550178Z 8d3f20cf4eb3: Verifying Checksum
2024-10-08T20:15:26.4550839Z 8d3f20cf4eb3: Download complete
2024-10-08T20:15:26.5476407Z 70176d530fec: Verifying Checksum
2024-10-08T20:15:26.5477203Z 70176d530fec: Download complete
2024-10-08T20:15:26.6236091Z 70a6862ebeb0: Verifying Checksum
2024-10-08T20:15:26.6236791Z 70a6862ebeb0: Download complete
2024-10-08T20:15:26.6941355Z ad3a30f38c12: Download complete
2024-10-08T20:15:26.7735683Z 5784c31fa1c5: Download complete
2024-10-08T20:15:26.9124127Z 010303d9e03b: Verifying Checksum
2024-10-08T20:15:26.9124800Z 010303d9e03b: Download complete
2024-10-08T20:15:26.9888357Z 55c652d459ca: Verifying Checksum
2024-10-08T20:15:26.9889308Z 55c652d459ca: Download complete
2024-10-08T20:15:27.0728253Z 10e4872f8f41: Verifying Checksum
2024-10-08T20:15:27.0729077Z 10e4872f8f41: Download complete
2024-10-08T20:15:27.1611729Z 376abd9faba0: Download complete
2024-10-08T20:15:27.2464435Z aca1780f31b1: Download complete
2024-10-08T20:15:27.3210431Z 7e29c9ae3d8c: Verifying Checksum
2024-10-08T20:15:27.3211438Z 7e29c9ae3d8c: Download complete
2024-10-08T20:15:27.4071145Z 54723b6b8c0f: Verifying Checksum
2024-10-08T20:15:27.4071649Z 54723b6b8c0f: Download complete
2024-10-08T20:15:29.8831514Z 2af31c2959ac: Verifying Checksum
2024-10-08T20:15:29.8832020Z 2af31c2959ac: Download complete
2024-10-08T20:15:31.9661333Z d4486831345c: Pull complete
2024-10-08T20:15:32.1850645Z 041cb9a31c77: Pull complete
2024-10-08T20:15:32.4171513Z 3d701f869134: Pull complete
2024-10-08T20:15:32.6456222Z 9309aa962cc8: Pull complete
2024-10-08T20:15:32.8646142Z be689962a1be: Pull complete
2024-10-08T20:15:33.0825518Z 8c7b0ce86f79: Pull complete
2024-10-08T20:15:53.3719749Z 8c6851927b6c: Pull complete
2024-10-08T20:15:53.5892860Z fd59f13891ba: Pull complete
2024-10-08T20:15:53.8080684Z 97c1b41b63e7: Pull complete
2024-10-08T20:15:54.0214481Z c2eab51c06ba: Pull complete
2024-10-08T20:15:59.2508194Z 1fd2453d8064: Verifying Checksum
2024-10-08T20:15:59.2508691Z 1fd2453d8064: Download complete
2024-10-08T20:16:12.6926141Z edd2406f6f94: Verifying Checksum
2024-10-08T20:16:12.6926655Z edd2406f6f94: Download complete
2024-10-08T20:17:18.4966265Z 1fd2453d8064: Pull complete
2024-10-08T20:17:18.6829418Z 4f4fb700ef54: Pull complete
2024-10-08T20:17:18.7726034Z 30e9141805d5: Pull complete
2024-10-08T20:17:18.8418905Z e355280ca495: Pull complete
2024-10-08T20:17:18.8868319Z 124d36bf6745: Pull complete
2024-10-08T20:17:19.0216873Z 6e9e8e478857: Pull complete
2024-10-08T20:17:19.0721552Z 91a703b7bb47: Pull complete
2024-10-08T20:17:19.1596727Z 7e47d022e430: Pull complete
2024-10-08T20:17:19.2306369Z 6731cd6c1a8b: Pull complete
2024-10-08T20:17:19.3905040Z badcfd30f4ab: Pull complete
2024-10-08T20:17:19.4417751Z 7c478fa099b8: Pull complete
2024-10-08T20:17:22.6539262Z 1fca2f347a8c: Pull complete
2024-10-08T20:17:22.6674876Z 90e80f141d97: Pull complete
2024-10-08T20:17:22.6819965Z 2fa21a5a9903: Pull complete
2024-10-08T20:17:22.6961560Z 8daafb98cf75: Pull complete
2024-10-08T20:17:22.7092565Z 25fe74fe1965: Pull complete
2024-10-08T20:17:22.7232511Z 23f1488f7771: Pull complete
2024-10-08T20:17:31.2656465Z efa31f26e3b7: Pull complete
2024-10-08T20:17:31.2827887Z 30120af386eb: Pull complete
2024-10-08T20:17:31.3022422Z 7052567f0a85: Pull complete
2024-10-08T20:17:31.3178011Z 48c59746051f: Pull complete
2024-10-08T20:17:31.3350481Z a97bb6751d5c: Pull complete
2024-10-08T20:17:31.3678908Z 721ea279f1ec: Pull complete
2024-10-08T20:17:31.3843363Z 1dfa26f43437: Pull complete
2024-10-08T20:17:31.4003248Z 063cba812af2: Pull complete
2024-10-08T20:17:31.4208242Z 04271b510e77: Pull complete
2024-10-08T20:17:31.4545862Z ab62990fb550: Pull complete
2024-10-08T20:17:31.4745869Z ff4be702052d: Pull complete
2024-10-08T20:17:31.5103662Z cd7099b12fa2: Pull complete
2024-10-08T20:17:31.5279859Z d3fc4fda5d34: Pull complete
2024-10-08T20:17:33.4905259Z 2eb55b65a374: Pull complete
2024-10-08T20:17:33.5499053Z 5a1de3e09cb8: Pull complete
2024-10-08T20:17:33.6706023Z 54f00623ecc4: Pull complete
2024-10-08T20:17:34.0649115Z d5238b78eb78: Pull complete
2024-10-08T20:17:34.2370086Z 08a1ab806f62: Pull complete
2024-10-08T20:17:34.9231841Z fa004c48a469: Pull complete
2024-10-08T20:17:35.0129229Z 0ec870d0e31d: Pull complete
2024-10-08T20:17:35.0562721Z ee28aa8bac12: Pull complete
2024-10-08T20:17:35.1940442Z 87e7ed7d5504: Pull complete
2024-10-08T20:17:35.3397127Z 84c40208c87a: Pull complete
2024-10-08T20:17:35.7000812Z cb6b59ddc5d9: Pull complete
2024-10-08T20:17:35.7752008Z 2a9c0ccedd86: Pull complete
2024-10-08T20:17:36.1010480Z 06f2af43246c: Pull complete
2024-10-08T20:19:19.0104739Z edd2406f6f94: Pull complete
2024-10-08T20:19:19.1246352Z ad282c1cfc4a: Pull complete
2024-10-08T20:19:19.6355356Z 42ffc2d817b5: Pull complete
2024-10-08T20:19:19.8753429Z db05c397e899: Pull complete
2024-10-08T20:19:19.9472237Z 87f69c755327: Pull complete
2024-10-08T20:19:20.1215206Z c4fa0960d481: Pull complete
2024-10-08T20:19:20.3622249Z ac10e2b22d84: Pull complete
2024-10-08T20:19:20.5434419Z 7a9abc0bdace: Pull complete
2024-10-08T20:19:20.9650877Z da0274fd9564: Pull complete
2024-10-08T20:19:21.3473666Z 2252a0093000: Pull complete
2024-10-08T20:19:21.5237532Z 8d3f20cf4eb3: Pull complete
2024-10-08T20:19:21.9358042Z 70176d530fec: Pull complete
2024-10-08T20:19:22.1285259Z 70a6862ebeb0: Pull complete
2024-10-08T20:19:22.5358166Z ad3a30f38c12: Pull complete
2024-10-08T20:19:22.6300848Z 5784c31fa1c5: Pull complete
2024-10-08T20:19:23.0025315Z 010303d9e03b: Pull complete
2024-10-08T20:19:23.1749056Z 55c652d459ca: Pull complete
2024-10-08T20:19:23.3658199Z 10e4872f8f41: Pull complete
2024-10-08T20:19:23.5619527Z 376abd9faba0: Pull complete
2024-10-08T20:19:23.7576823Z aca1780f31b1: Pull complete
2024-10-08T20:19:23.9518953Z 7e29c9ae3d8c: Pull complete
2024-10-08T20:19:24.2515817Z 54723b6b8c0f: Pull complete
2024-10-08T20:19:26.7083260Z 2af31c2959ac: Pull complete
2024-10-08T20:19:27.0573673Z Digest: sha256:4e0393713933105b539fb30aab8d91040a357314b532348d6cb011314c8916a7
2024-10-08T20:19:27.0909241Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:19:27.1455531Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:19:27.1575928Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:19:27.1577434Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-10-08T20:19:27.1585293Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:27.1585814Z env:
2024-10-08T20:19:27.1586070Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:27.1586417Z ##[endgroup]
2024-10-08T20:19:27.1820279Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-10-08T20:19:27.1821092Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-10-08T20:19:27.1821832Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 &
2024-10-08T20:19:27.1822522Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}"
2024-10-08T20:19:27.1828736Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:27.1829250Z env:
2024-10-08T20:19:27.1829521Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:27.1829857Z ##[endgroup]
2024-10-08T20:19:27.8810624Z Defaulting to user installation because normal site-packages is not writeable
2024-10-08T20:19:27.9068076Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1)
2024-10-08T20:19:27.9074643Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84)
2024-10-08T20:19:28.0459329Z Prepare all required actions
2024-10-08T20:19:28.0459844Z Getting action download info
2024-10-08T20:19:28.1826205Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6)
2024-10-08T20:19:28.4018121Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a)
2024-10-08T20:19:28.5354871Z ##[group]Run ./.github/actions/download-build-artifacts
2024-10-08T20:19:28.5355387Z with:
2024-10-08T20:19:28.5355667Z   name: linux-jammy-py3.9-gcc11
2024-10-08T20:19:28.5356067Z   s3-bucket: gha-artifacts
2024-10-08T20:19:28.5356399Z env:
2024-10-08T20:19:28.5356665Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:28.5356990Z ##[endgroup]
2024-10-08T20:19:28.5448240Z ##[group]Run seemethere/download-artifact-s3@v4
2024-10-08T20:19:28.5448688Z with:
2024-10-08T20:19:28.5448980Z   name: linux-jammy-py3.9-gcc11
2024-10-08T20:19:28.5449376Z   s3-bucket: gha-artifacts
2024-10-08T20:19:28.5449767Z   region: us-east-1
2024-10-08T20:19:28.5450052Z env:
2024-10-08T20:19:28.5450317Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:28.5450661Z ##[endgroup]
2024-10-08T20:19:29.0465634Z (node:85980) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-10-08T20:19:29.0466673Z 
2024-10-08T20:19:29.0466942Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-10-08T20:19:29.0467717Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-10-08T20:19:29.0468636Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-10-08T20:19:29.1246394Z Found 1 objects with prefix pytorch/pytorch/11242664097/linux-jammy-py3.9-gcc11/
2024-10-08T20:19:29.1247534Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-10-08T20:19:33.0273477Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-10-08T20:19:33.0281737Z Artifact download has finished successfully
2024-10-08T20:19:33.0448512Z ##[group]Run unzip -o artifacts.zip
2024-10-08T20:19:33.0448967Z unzip -o artifacts.zip
2024-10-08T20:19:33.0455211Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:33.0455747Z env:
2024-10-08T20:19:33.0456004Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:33.0456352Z ##[endgroup]
2024-10-08T20:19:33.0514274Z Archive:  artifacts.zip
2024-10-08T20:19:33.0515392Z    creating: dist/
2024-10-08T20:19:34.0611222Z   inflating: dist/torch-2.6.0a0+git47952c0-cp39-cp39-linux_x86_64.whl  
2024-10-08T20:19:34.0611930Z    creating: build/custom_test_artifacts/
2024-10-08T20:19:34.0612619Z    creating: build/custom_test_artifacts/custom-op-build/
2024-10-08T20:19:34.0613394Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/
2024-10-08T20:19:34.0614289Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/
2024-10-08T20:19:34.0615780Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-10-08T20:19:34.0616820Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/
2024-10-08T20:19:34.0617860Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-10-08T20:19:34.0618966Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/
2024-10-08T20:19:34.0620026Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-10-08T20:19:34.0621252Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-10-08T20:19:34.0622494Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-10-08T20:19:34.0623595Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-10-08T20:19:34.0624684Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-10-08T20:19:34.0626237Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-10-08T20:19:34.0627547Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-10-08T20:19:34.0628828Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-10-08T20:19:34.0630103Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-10-08T20:19:34.0631396Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-10-08T20:19:34.0632690Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-10-08T20:19:34.0633778Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/
2024-10-08T20:19:34.0634787Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache  
2024-10-08T20:19:34.0635816Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/
2024-10-08T20:19:34.0636974Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts  
2024-10-08T20:19:34.0638368Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make  
2024-10-08T20:19:34.0639599Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make  
2024-10-08T20:19:34.0640880Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt  
2024-10-08T20:19:34.0642078Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake  
2024-10-08T20:19:34.0643265Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make  
2024-10-08T20:19:34.0644465Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake  
2024-10-08T20:19:34.0645672Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make  
2024-10-08T20:19:34.0646863Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make  
2024-10-08T20:19:34.0658012Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d  
2024-10-08T20:19:34.0794628Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o  
2024-10-08T20:19:34.0795741Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/
2024-10-08T20:19:34.0796968Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts  
2024-10-08T20:19:34.0798332Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make  
2024-10-08T20:19:34.0799631Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make  
2024-10-08T20:19:34.0800844Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt  
2024-10-08T20:19:34.0802102Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake  
2024-10-08T20:19:34.0803391Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make  
2024-10-08T20:19:34.0804662Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake  
2024-10-08T20:19:34.0805924Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make  
2024-10-08T20:19:34.0807156Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make  
2024-10-08T20:19:34.0821828Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d  
2024-10-08T20:19:34.0901394Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o  
2024-10-08T20:19:34.0902744Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-10-08T20:19:34.0903944Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt  
2024-10-08T20:19:34.0905024Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks  
2024-10-08T20:19:34.0906026Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2  
2024-10-08T20:19:34.0907006Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake  
2024-10-08T20:19:34.0907959Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt  
2024-10-08T20:19:34.0908807Z   inflating: build/custom_test_artifacts/custom-op-build/Makefile  
2024-10-08T20:19:34.0909675Z   inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake  
2024-10-08T20:19:34.1028189Z   inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so  
2024-10-08T20:19:34.1090828Z   inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops  
2024-10-08T20:19:34.1091619Z    creating: build/custom_test_artifacts/jit-hook-build/
2024-10-08T20:19:34.1092351Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/
2024-10-08T20:19:34.1093550Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/
2024-10-08T20:19:34.1095704Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-10-08T20:19:34.1096729Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/
2024-10-08T20:19:34.1097752Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-10-08T20:19:34.1098811Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/
2024-10-08T20:19:34.1099867Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-10-08T20:19:34.1101084Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-10-08T20:19:34.1102312Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-10-08T20:19:34.1103403Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-10-08T20:19:34.1104472Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-10-08T20:19:34.1105742Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-10-08T20:19:34.1107142Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-10-08T20:19:34.1108971Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-10-08T20:19:34.1110231Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-10-08T20:19:34.1111639Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-10-08T20:19:34.1112990Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-10-08T20:19:34.1114069Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/
2024-10-08T20:19:34.1115067Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache  
2024-10-08T20:19:34.1116107Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/
2024-10-08T20:19:34.1117269Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts  
2024-10-08T20:19:34.1118589Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make  
2024-10-08T20:19:34.1119856Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make  
2024-10-08T20:19:34.1121184Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt  
2024-10-08T20:19:34.1122417Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake  
2024-10-08T20:19:34.1123628Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make  
2024-10-08T20:19:34.1124863Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake  
2024-10-08T20:19:34.1126088Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make  
2024-10-08T20:19:34.1127292Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make  
2024-10-08T20:19:34.1141880Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d  
2024-10-08T20:19:34.1204629Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o  
2024-10-08T20:19:34.1205943Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-10-08T20:19:34.1207129Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt  
2024-10-08T20:19:34.1208357Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks  
2024-10-08T20:19:34.1209342Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2  
2024-10-08T20:19:34.1210294Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake  
2024-10-08T20:19:34.1211233Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt  
2024-10-08T20:19:34.1212068Z   inflating: build/custom_test_artifacts/jit-hook-build/Makefile  
2024-10-08T20:19:34.1213021Z   inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake  
2024-10-08T20:19:34.1262676Z   inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks  
2024-10-08T20:19:34.1263483Z    creating: build/custom_test_artifacts/custom-backend-build/
2024-10-08T20:19:34.1264308Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/
2024-10-08T20:19:34.1265277Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/
2024-10-08T20:19:34.1267302Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-10-08T20:19:34.1268390Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/
2024-10-08T20:19:34.1269479Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-10-08T20:19:34.1270643Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/
2024-10-08T20:19:34.1271779Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-10-08T20:19:34.1273080Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-10-08T20:19:34.1274377Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-10-08T20:19:34.1275557Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-10-08T20:19:34.1276739Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-10-08T20:19:34.1278095Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-10-08T20:19:34.1279456Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-10-08T20:19:34.1280969Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-10-08T20:19:34.1282305Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-10-08T20:19:34.1285056Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-10-08T20:19:34.1287776Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-10-08T20:19:34.1290241Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/
2024-10-08T20:19:34.1292346Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache  
2024-10-08T20:19:34.1294558Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/
2024-10-08T20:19:34.1296857Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts  
2024-10-08T20:19:34.1299479Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make  
2024-10-08T20:19:34.1302092Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make  
2024-10-08T20:19:34.1304444Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt  
2024-10-08T20:19:34.1306841Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake  
2024-10-08T20:19:34.1309474Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make  
2024-10-08T20:19:34.1311938Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake  
2024-10-08T20:19:34.1314364Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make  
2024-10-08T20:19:34.1316823Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make  
2024-10-08T20:19:34.1319405Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d  
2024-10-08T20:19:34.1423678Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o  
2024-10-08T20:19:34.1426226Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/
2024-10-08T20:19:34.1428802Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts  
2024-10-08T20:19:34.1431549Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make  
2024-10-08T20:19:34.1434134Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make  
2024-10-08T20:19:34.1436561Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt  
2024-10-08T20:19:34.1439030Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake  
2024-10-08T20:19:34.1441516Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make  
2024-10-08T20:19:34.1444029Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake  
2024-10-08T20:19:34.1446544Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make  
2024-10-08T20:19:34.1449038Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make  
2024-10-08T20:19:34.1454138Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d  
2024-10-08T20:19:34.1508907Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o  
2024-10-08T20:19:34.1511713Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-10-08T20:19:34.1514041Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt  
2024-10-08T20:19:34.1516395Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks  
2024-10-08T20:19:34.1518349Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2  
2024-10-08T20:19:34.1520346Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake  
2024-10-08T20:19:34.1522166Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt  
2024-10-08T20:19:34.1523884Z   inflating: build/custom_test_artifacts/custom-backend-build/Makefile  
2024-10-08T20:19:34.1525680Z   inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake  
2024-10-08T20:19:34.1620122Z   inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so  
2024-10-08T20:19:34.1663527Z   inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend  
2024-10-08T20:19:34.1664779Z    creating: build/lib/
2024-10-08T20:19:34.1665442Z   inflating: build/lib/libclog.a     
2024-10-08T20:19:34.1675179Z   inflating: build/lib/libpthreadpool.a  
2024-10-08T20:19:34.1742195Z   inflating: build/lib/libgtest.a    
2024-10-08T20:19:34.1751033Z   inflating: build/lib/libcpuinfo.a  
2024-10-08T20:19:34.1759503Z   inflating: build/lib/libcpuinfo_internals.a  
2024-10-08T20:19:34.1767639Z   inflating: build/lib/libittnotify.a  
2024-10-08T20:19:34.1851240Z   inflating: build/lib/libprotobuf-lite.a  
2024-10-08T20:19:34.1925018Z   inflating: build/lib/libbenchmark.a  
2024-10-08T20:19:34.1953329Z   inflating: build/lib/libtensorpipe_uv.a  
2024-10-08T20:19:34.2018038Z   inflating: build/lib/libasmjit.a   
2024-10-08T20:19:34.2131634Z   inflating: build/lib/libgloo.a     
2024-10-08T20:19:34.2575682Z   inflating: build/lib/libprotobuf.a  
2024-10-08T20:19:34.2596959Z   inflating: build/lib/libfmt.a      
2024-10-08T20:19:34.2697523Z   inflating: build/lib/libc10.so     
2024-10-08T20:19:34.2699014Z   inflating: build/lib/libtorch_global_deps.so  
2024-10-08T20:19:34.2719032Z   inflating: build/lib/libpytorch_qnnpack.a  
2024-10-08T20:19:34.2721782Z   inflating: build/lib/libnnpack_reference_layers.a  
2024-10-08T20:19:34.2739904Z   inflating: build/lib/libgmock.a    
2024-10-08T20:19:34.2740738Z   inflating: build/lib/libgtest_main.a  
2024-10-08T20:19:34.2741770Z   inflating: build/lib/libbenchmark_main.a  
2024-10-08T20:19:34.3239572Z   inflating: build/lib/libprotoc.a   
2024-10-08T20:19:34.3257793Z   inflating: build/lib/libnnpack.a   
2024-10-08T20:19:34.3808068Z   inflating: build/lib/libtensorpipe.a  
2024-10-08T20:19:34.4840424Z   inflating: build/lib/libfbgemm.a   
2024-10-08T20:19:34.4841313Z   inflating: build/lib/libgmock_main.a  
2024-10-08T20:19:34.5128884Z   inflating: build/lib/libkineto.a   
2024-10-08T20:19:34.5169839Z   inflating: build/lib/libonnx_proto.a  
2024-10-08T20:19:34.5368585Z   inflating: build/lib/libXNNPACK.a  
2024-10-08T20:19:34.6059101Z   inflating: build/lib/libonnx.a     
2024-10-08T20:19:35.5909636Z   inflating: build/lib/libdnnl.a     
2024-10-08T20:19:37.9876523Z   inflating: build/lib/libtorch_cpu.so  
2024-10-08T20:19:37.9877423Z   inflating: build/lib/libtorch.so   
2024-10-08T20:19:37.9882736Z   inflating: build/lib/libunbox_lib.a  
2024-10-08T20:19:37.9886428Z   inflating: build/lib/libshm.so     
2024-10-08T20:19:37.9906356Z   inflating: build/lib/libjitbackend_test.so  
2024-10-08T20:19:37.9979429Z   inflating: build/lib/libtorchbind_test.so  
2024-10-08T20:19:38.0004903Z   inflating: build/lib/libbackend_with_compiler.so  
2024-10-08T20:19:38.0029612Z   inflating: build/lib/libaoti_custom_ops.so  
2024-10-08T20:19:38.1971816Z   inflating: build/lib/libtorch_python.so  
2024-10-08T20:19:38.2007407Z   inflating: build/lib/libnnapi_backend.so  
2024-10-08T20:19:38.2008267Z    creating: build/bin/
2024-10-08T20:19:38.2008950Z    creating: build/bin/CMakeFiles/
2024-10-08T20:19:38.2010055Z   inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-10-08T20:19:38.2011397Z  extracting: build/bin/CMakeFiles/progress.marks  
2024-10-08T20:19:38.2012694Z   inflating: build/bin/Makefile      
2024-10-08T20:19:38.2030307Z   inflating: build/bin/cmake_install.cmake  
2024-10-08T20:19:38.2031274Z   inflating: build/bin/CTestTestfile.cmake  
2024-10-08T20:19:38.2070192Z   inflating: build/bin/c10_CompileTimeFunctionPointer_test  
2024-10-08T20:19:38.2125623Z   inflating: build/bin/c10_DeviceGuard_test  
2024-10-08T20:19:38.2181058Z   inflating: build/bin/c10_Device_test  
2024-10-08T20:19:38.2244409Z   inflating: build/bin/c10_DispatchKeySet_test  
2024-10-08T20:19:38.2302227Z   inflating: build/bin/c10_Scalar_test  
2024-10-08T20:19:38.2354644Z   inflating: build/bin/c10_StreamGuard_test  
2024-10-08T20:19:38.2409456Z   inflating: build/bin/c10_SymInt_test  
2024-10-08T20:19:38.2467453Z   inflating: build/bin/c10_InlineDeviceGuard_test  
2024-10-08T20:19:38.2527272Z   inflating: build/bin/c10_InlineStreamGuard_test  
2024-10-08T20:19:38.2586241Z   inflating: build/bin/c10_SizesAndStrides_test  
2024-10-08T20:19:38.2661204Z   inflating: build/bin/c10_cow_test  
2024-10-08T20:19:38.2718001Z   inflating: build/bin/c10_Bitset_test  
2024-10-08T20:19:38.2770392Z   inflating: build/bin/c10_ConstexprCrc_test  
2024-10-08T20:19:38.2824254Z   inflating: build/bin/c10_DeadlockDetection_test  
2024-10-08T20:19:38.2878289Z   inflating: build/bin/c10_Half_test  
2024-10-08T20:19:38.2937987Z   inflating: build/bin/c10_LeftRight_test  
2024-10-08T20:19:38.2997242Z   inflating: build/bin/c10_Metaprogramming_test  
2024-10-08T20:19:38.3053988Z   inflating: build/bin/c10_NetworkFlow_test  
2024-10-08T20:19:38.3107648Z   inflating: build/bin/c10_Synchronized_test  
2024-10-08T20:19:38.3166811Z   inflating: build/bin/c10_ThreadLocal_test  
2024-10-08T20:19:38.3222000Z   inflating: build/bin/c10_TypeIndex_test  
2024-10-08T20:19:38.3276534Z   inflating: build/bin/c10_TypeList_test  
2024-10-08T20:19:38.3328757Z   inflating: build/bin/c10_TypeTraits_test  
2024-10-08T20:19:38.3384186Z   inflating: build/bin/c10_accumulate_test  
2024-10-08T20:19:38.3443247Z   inflating: build/bin/c10_bfloat16_test  
2024-10-08T20:19:38.3497171Z   inflating: build/bin/c10_bit_cast_test  
2024-10-08T20:19:38.3557576Z   inflating: build/bin/c10_complex_math_test  
2024-10-08T20:19:38.3613664Z   inflating: build/bin/c10_exception_test  
2024-10-08T20:19:38.3672106Z   inflating: build/bin/c10_complex_test  
2024-10-08T20:19:38.3726309Z   inflating: build/bin/c10_flags_test  
2024-10-08T20:19:38.3779754Z   inflating: build/bin/c10_generic_math_test  
2024-10-08T20:19:38.3947282Z   inflating: build/bin/c10_intrusive_ptr_test  
2024-10-08T20:19:38.4002331Z   inflating: build/bin/c10_irange_test  
2024-10-08T20:19:38.4059372Z   inflating: build/bin/c10_lazy_test  
2024-10-08T20:19:38.4119900Z   inflating: build/bin/c10_logging_test  
2024-10-08T20:19:38.4198879Z   inflating: build/bin/c10_optional_test  
2024-10-08T20:19:38.4264548Z   inflating: build/bin/c10_ordered_preserving_dict_test  
2024-10-08T20:19:38.4321295Z   inflating: build/bin/c10_registry_test  
2024-10-08T20:19:38.4476467Z   inflating: build/bin/c10_small_vector_test  
2024-10-08T20:19:38.4531793Z   inflating: build/bin/c10_ssize_test  
2024-10-08T20:19:38.4587161Z   inflating: build/bin/c10_string_util_test  
2024-10-08T20:19:38.4641398Z   inflating: build/bin/c10_tempfile_test  
2024-10-08T20:19:38.4701548Z   inflating: build/bin/c10_typeid_test  
2024-10-08T20:19:38.4763571Z   inflating: build/bin/c10_string_view_test  
2024-10-08T20:19:38.4814178Z   inflating: build/bin/c10_intrusive_ptr_benchmark  
2024-10-08T20:19:38.5278717Z   inflating: build/bin/protoc-3.13.0.0  
2024-10-08T20:19:38.5744737Z   inflating: build/bin/protoc        
2024-10-08T20:19:38.6123247Z   inflating: build/bin/vec_test_all_types_DEFAULT  
2024-10-08T20:19:38.6519245Z   inflating: build/bin/vec_test_all_types_AVX512  
2024-10-08T20:19:38.6926233Z   inflating: build/bin/vec_test_all_types_AVX2  
2024-10-08T20:19:38.6985504Z   inflating: build/bin/TCPStoreTest  
2024-10-08T20:19:38.7042237Z   inflating: build/bin/FileStoreTest  
2024-10-08T20:19:38.7098644Z   inflating: build/bin/BackoffTest   
2024-10-08T20:19:38.7155591Z   inflating: build/bin/HashStoreTest  
2024-10-08T20:19:38.7224961Z   inflating: build/bin/ProcessGroupGlooTest  
2024-10-08T20:19:38.7228121Z   inflating: build/bin/example_allreduce  
2024-10-08T20:19:38.7285923Z   inflating: build/bin/test_dist_autograd  
2024-10-08T20:19:38.7289139Z   inflating: build/bin/parallel_benchmark  
2024-10-08T20:19:38.7299133Z   inflating: build/bin/aot_model_compiler_test  
2024-10-08T20:19:38.7368680Z   inflating: build/bin/test_mobile_nnc  
2024-10-08T20:19:38.7440977Z   inflating: build/bin/test_cpp_rpc  
2024-10-08T20:19:38.7502394Z   inflating: build/bin/static_runtime_bench  
2024-10-08T20:19:38.7848951Z   inflating: build/bin/test_lazy     
2024-10-08T20:19:38.7905413Z   inflating: build/bin/Dimname_test  
2024-10-08T20:19:38.7982601Z   inflating: build/bin/Dict_test     
2024-10-08T20:19:38.8238782Z   inflating: build/bin/static_runtime_test  
2024-10-08T20:19:38.8307507Z   inflating: build/bin/MaybeOwned_test  
2024-10-08T20:19:38.8367975Z   inflating: build/bin/NamedTensor_test  
2024-10-08T20:19:38.8430586Z   inflating: build/bin/apply_utils_test  
2024-10-08T20:19:38.8492776Z   inflating: build/bin/atest         
2024-10-08T20:19:38.8551591Z   inflating: build/bin/broadcast_test  
2024-10-08T20:19:38.8618795Z   inflating: build/bin/basic         
2024-10-08T20:19:38.8673100Z   inflating: build/bin/cpu_allocator_test  
2024-10-08T20:19:38.8730117Z   inflating: build/bin/cpu_profiling_allocator_test  
2024-10-08T20:19:38.8791937Z   inflating: build/bin/cpu_generator_test  
2024-10-08T20:19:38.8845222Z   inflating: build/bin/dispatch_key_set_test  
2024-10-08T20:19:38.8942191Z   inflating: build/bin/cpu_rng_test  
2024-10-08T20:19:38.8995816Z   inflating: build/bin/dlconvertor_test  
2024-10-08T20:19:38.9057146Z   inflating: build/bin/extension_backend_test  
2024-10-08T20:19:38.9115959Z   inflating: build/bin/half_test     
2024-10-08T20:19:38.9215240Z   inflating: build/bin/ivalue_test   
2024-10-08T20:19:38.9268590Z   inflating: build/bin/lazy_tensor_test  
2024-10-08T20:19:38.9325567Z   inflating: build/bin/math_kernel_test  
2024-10-08T20:19:38.9382418Z   inflating: build/bin/memory_format_test  
2024-10-08T20:19:38.9439283Z   inflating: build/bin/memory_overlapping_test  
2024-10-08T20:19:38.9493991Z   inflating: build/bin/operator_name_test  
2024-10-08T20:19:38.9550678Z   inflating: build/bin/mobile_memory_cleanup  
2024-10-08T20:19:38.9610193Z   inflating: build/bin/native_test   
2024-10-08T20:19:38.9665974Z   inflating: build/bin/packedtensoraccessor_test  
2024-10-08T20:19:38.9720619Z   inflating: build/bin/operators_test  
2024-10-08T20:19:38.9791468Z   inflating: build/bin/pow_test      
2024-10-08T20:19:38.9852140Z   inflating: build/bin/quantized_test  
2024-10-08T20:19:38.9905887Z   inflating: build/bin/reduce_ops_test  
2024-10-08T20:19:38.9961007Z   inflating: build/bin/reportMemoryUsage_test  
2024-10-08T20:19:39.0021559Z   inflating: build/bin/scalar_tensor_test  
2024-10-08T20:19:39.0082871Z   inflating: build/bin/scalar_test   
2024-10-08T20:19:39.0138688Z   inflating: build/bin/StorageUtils_test  
2024-10-08T20:19:39.0194765Z   inflating: build/bin/stride_properties_test  
2024-10-08T20:19:39.0253179Z   inflating: build/bin/type_ptr_test  
2024-10-08T20:19:39.0335815Z   inflating: build/bin/tensor_iterator_test  
2024-10-08T20:19:39.0339076Z   inflating: build/bin/thread_init_test  
2024-10-08T20:19:39.0396437Z   inflating: build/bin/test_parallel  
2024-10-08T20:19:39.0459936Z   inflating: build/bin/type_test     
2024-10-08T20:19:39.0461705Z   inflating: build/bin/verify_api_visibility  
2024-10-08T20:19:39.0518781Z   inflating: build/bin/undefined_tensor_test  
2024-10-08T20:19:39.0591920Z   inflating: build/bin/legacy_vmap_test  
2024-10-08T20:19:39.0646822Z   inflating: build/bin/weakref_test  
2024-10-08T20:19:39.0710045Z   inflating: build/bin/IListRef_test  
2024-10-08T20:19:39.0764815Z   inflating: build/bin/wrapdim_test  
2024-10-08T20:19:39.0876312Z   inflating: build/bin/List_test     
2024-10-08T20:19:39.0932737Z   inflating: build/bin/xla_tensor_test  
2024-10-08T20:19:39.1058802Z   inflating: build/bin/kernel_function_legacy_test  
2024-10-08T20:19:39.1166593Z   inflating: build/bin/kernel_lambda_test  
2024-10-08T20:19:39.1237030Z   inflating: build/bin/KernelFunction_test  
2024-10-08T20:19:39.1368950Z   inflating: build/bin/kernel_lambda_legacy_test  
2024-10-08T20:19:39.1471153Z   inflating: build/bin/kernel_function_test  
2024-10-08T20:19:39.1523920Z   inflating: build/bin/op_allowlist_test  
2024-10-08T20:19:39.1588840Z   inflating: build/bin/kernel_stackbased_test  
2024-10-08T20:19:39.1643550Z   inflating: build/bin/CppSignature_test  
2024-10-08T20:19:39.1744148Z   inflating: build/bin/make_boxed_from_unboxed_functor_test  
2024-10-08T20:19:39.1804077Z   inflating: build/bin/backend_fallback_test  
2024-10-08T20:19:39.1871099Z   inflating: build/bin/inline_container_test  
2024-10-08T20:19:39.2191658Z   inflating: build/bin/op_registration_test  
2024-10-08T20:19:39.2248288Z   inflating: build/bin/test_edge_op_registration  
2024-10-08T20:19:39.2253077Z   inflating: build/bin/torch_shm_manager  
2024-10-08T20:19:39.2267262Z   inflating: build/bin/tutorial_tensorexpr  
2024-10-08T20:19:39.3084849Z   inflating: build/bin/test_tensorexpr  
2024-10-08T20:19:39.4251191Z   inflating: build/bin/test_api      
2024-10-08T20:19:39.4844077Z   inflating: build/bin/test_jit      
2024-10-08T20:19:39.4844961Z    creating: .additional_ci_files/
2024-10-08T20:19:39.4925763Z   inflating: .additional_ci_files/test-times.json  
2024-10-08T20:19:39.5247462Z   inflating: .additional_ci_files/test-class-times.json  
2024-10-08T20:19:39.5315324Z ##[group]Run rm artifacts.zip
2024-10-08T20:19:39.5315719Z rm artifacts.zip
2024-10-08T20:19:39.5321729Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:39.5322250Z env:
2024-10-08T20:19:39.5322531Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:39.5322962Z ##[endgroup]
2024-10-08T20:19:39.5725740Z ##[group]Run df -H
2024-10-08T20:19:39.5726046Z df -H
2024-10-08T20:19:39.5731823Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:39.5732341Z env:
2024-10-08T20:19:39.5732726Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:39.5733068Z ##[endgroup]
2024-10-08T20:19:39.5788193Z Filesystem        Size  Used Avail Use% Mounted on
2024-10-08T20:19:39.5789206Z devtmpfs          4.2M     0  4.2M   0% /dev
2024-10-08T20:19:39.5789713Z tmpfs             8.2G  6.0M  8.2G   1% /dev/shm
2024-10-08T20:19:39.5790200Z tmpfs             3.3G  488k  3.3G   1% /run
2024-10-08T20:19:39.5790916Z /dev/nvme0n1p1    161G   33G  129G  20% /
2024-10-08T20:19:39.5791478Z tmpfs             8.2G   13k  8.2G   1% /tmp
2024-10-08T20:19:39.5791985Z /dev/nvme0n1p128   11M  1.4M  9.2M  13% /boot/efi
2024-10-08T20:19:39.5844763Z Prepare all required actions
2024-10-08T20:19:39.5845213Z Getting action download info
2024-10-08T20:19:39.7619008Z ##[group]Run ./.github/actions/download-td-artifacts
2024-10-08T20:19:39.7619847Z with:
2024-10-08T20:19:39.7620299Z env:
2024-10-08T20:19:39.7620770Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:39.7621388Z ##[endgroup]
2024-10-08T20:19:39.7710147Z ##[group]Run seemethere/download-artifact-s3@v4
2024-10-08T20:19:39.7710907Z with:
2024-10-08T20:19:39.7711359Z   name: td_results
2024-10-08T20:19:39.7711940Z   s3-bucket: gha-artifacts
2024-10-08T20:19:39.7712559Z   region: us-east-1
2024-10-08T20:19:39.7713077Z env:
2024-10-08T20:19:39.7713536Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:39.7714135Z ##[endgroup]
2024-10-08T20:19:40.2702244Z (node:86002) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-10-08T20:19:40.2703006Z 
2024-10-08T20:19:40.2703371Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-10-08T20:19:40.2704395Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-10-08T20:19:40.2705892Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-10-08T20:19:40.3420748Z Found 1 objects with prefix pytorch/pytorch/11242664097/td_results/
2024-10-08T20:19:40.3421965Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-10-08T20:19:40.3967760Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-10-08T20:19:40.3974016Z Artifact download has finished successfully
2024-10-08T20:19:40.4166235Z ##[group]Run mkdir -p .additional_ci_files
2024-10-08T20:19:40.4166740Z mkdir -p .additional_ci_files
2024-10-08T20:19:40.4167322Z mv td_results.json .additional_ci_files/td_results.json
2024-10-08T20:19:40.4174786Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:40.4175307Z env:
2024-10-08T20:19:40.4175593Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:40.4175940Z ##[endgroup]
2024-10-08T20:19:40.4634353Z ##[group]Run .github/scripts/parse_ref.py
2024-10-08T20:19:40.4634848Z .github/scripts/parse_ref.py
2024-10-08T20:19:40.4640898Z shell: /usr/bin/bash -e {0}
2024-10-08T20:19:40.4641238Z env:
2024-10-08T20:19:40.4641506Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:40.4641848Z ##[endgroup]
2024-10-08T20:19:40.5109559Z Prepare all required actions
2024-10-08T20:19:40.5206177Z ##[group]Run ./.github/actions/get-workflow-job-id
2024-10-08T20:19:40.5206802Z with:
2024-10-08T20:19:40.5207439Z   github-token: ***
2024-10-08T20:19:40.5207745Z env:
2024-10-08T20:19:40.5208002Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:40.5208351Z ##[endgroup]
2024-10-08T20:19:40.5392216Z ##[group]Run set -eux
2024-10-08T20:19:40.5392564Z set -eux
2024-10-08T20:19:40.5393185Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2024-10-08T20:19:40.5399614Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:40.5400118Z env:
2024-10-08T20:19:40.5400388Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:40.5400958Z   GITHUB_TOKEN: ***
2024-10-08T20:19:40.5401270Z ##[endgroup]
2024-10-08T20:19:40.5426829Z + python3 .github/scripts/get_workflow_job_id.py 11242664097 i-05d4cdd6accd1587b
2024-10-08T20:19:42.5196741Z setting job-id=31257778946
2024-10-08T20:19:42.5197644Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:42.5445302Z Prepare all required actions
2024-10-08T20:19:42.5445803Z Getting action download info
2024-10-08T20:19:42.6701344Z ##[group]Run ./.github/actions/filter-test-configs
2024-10-08T20:19:42.6701834Z with:
2024-10-08T20:19:42.6702300Z   github-token: ***
2024-10-08T20:19:42.6705682Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}
2024-10-08T20:19:42.6709366Z   job-name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:42.6709994Z env:
2024-10-08T20:19:42.6710249Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:42.6710594Z ##[endgroup]
2024-10-08T20:19:42.7245898Z ##[group]Run nick-fields/retry@v3.0.0
2024-10-08T20:19:42.7246303Z with:
2024-10-08T20:19:42.7246695Z   shell: bash
2024-10-08T20:19:42.7246990Z   timeout_minutes: 10
2024-10-08T20:19:42.7247319Z   max_attempts: 5
2024-10-08T20:19:42.7247615Z   retry_wait_seconds: 30
2024-10-08T20:19:42.7248825Z   command: set -eux
# PyYAML 6.0 doesn't work with MacOS x86 anymore
# This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2
python3 -m pip install requests==2.27.1 pyyaml==6.0.1

2024-10-08T20:19:42.7250092Z   polling_interval_seconds: 1
2024-10-08T20:19:42.7250465Z   warning_on_retry: true
2024-10-08T20:19:42.7250800Z   continue_on_error: false
2024-10-08T20:19:42.7251131Z env:
2024-10-08T20:19:42.7251406Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:42.7251971Z   GITHUB_TOKEN: ***
2024-10-08T20:19:42.7252266Z ##[endgroup]
2024-10-08T20:19:42.8353268Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1
2024-10-08T20:19:43.0877472Z Defaulting to user installation because normal site-packages is not writeable
2024-10-08T20:19:43.1043213Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1)
2024-10-08T20:19:43.1048288Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1)
2024-10-08T20:19:43.1174398Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12)
2024-10-08T20:19:43.1179923Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.8.30)
2024-10-08T20:19:43.1190830Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10)
2024-10-08T20:19:43.1198498Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10)
2024-10-08T20:19:43.8036360Z Command completed after 1 attempt(s).
2024-10-08T20:19:43.8097419Z ##[group]Run set -x
2024-10-08T20:19:43.8097749Z set -x
2024-10-08T20:19:43.8098038Z 
2024-10-08T20:19:43.8098762Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-10-08T20:19:43.8099469Z # in runner workspace
2024-10-08T20:19:43.8100007Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py"
2024-10-08T20:19:43.8106772Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:43.8107288Z env:
2024-10-08T20:19:43.8107560Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:43.8107906Z ##[endgroup]
2024-10-08T20:19:43.8133805Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py
2024-10-08T20:19:43.8382203Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}"
2024-10-08T20:19:43.8383146Z echo "Workflow: ${GITHUB_WORKFLOW}"
2024-10-08T20:19:43.8383608Z echo "Job name: ${JOB_NAME}"
2024-10-08T20:19:43.8384015Z 
2024-10-08T20:19:43.8384578Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-10-08T20:19:43.8385282Z # in runner workspace
2024-10-08T20:19:43.8385866Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \
2024-10-08T20:19:43.8386541Z   --workflow "${GITHUB_WORKFLOW}" \
2024-10-08T20:19:43.8387001Z   --job-name "${JOB_NAME}" \
2024-10-08T20:19:43.8390803Z   --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}" \
2024-10-08T20:19:43.8394340Z   --selected-test-configs "" \
2024-10-08T20:19:43.8394803Z   --pr-number "${PR_NUMBER}" \
2024-10-08T20:19:43.8395227Z   --tag "${TAG}" \
2024-10-08T20:19:43.8395608Z   --event-name "${EVENT_NAME}" \
2024-10-08T20:19:43.8396065Z   --schedule "${SCHEDULE}" \
2024-10-08T20:19:43.8396498Z   --branch "${HEAD_BRANCH}"
2024-10-08T20:19:43.8402583Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:43.8403088Z env:
2024-10-08T20:19:43.8403372Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:43.8403935Z   GITHUB_TOKEN: ***
2024-10-08T20:19:43.8404481Z   JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:43.8405108Z   PR_NUMBER: 134247
2024-10-08T20:19:43.8405410Z   TAG: 
2024-10-08T20:19:43.8405680Z   EVENT_NAME: pull_request
2024-10-08T20:19:43.8406022Z   SCHEDULE: 
2024-10-08T20:19:43.8406287Z   HEAD_BRANCH: 
2024-10-08T20:19:43.8406573Z ##[endgroup]
2024-10-08T20:19:43.8431422Z Workflow: pull
2024-10-08T20:19:43.8432197Z Job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:44.0971706Z INFO:root:Found no test-config label on the PR, so all test configs are included
2024-10-08T20:19:44.2929884Z ##[group]Run echo "Filtered matrix:"
2024-10-08T20:19:44.2930456Z echo "Filtered matrix:"
2024-10-08T20:19:44.2934009Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}"
2024-10-08T20:19:44.2937612Z 
2024-10-08T20:19:44.2937879Z echo
2024-10-08T20:19:44.2938242Z echo "Is the current job unstable? False"
2024-10-08T20:19:44.2938713Z 
2024-10-08T20:19:44.2938972Z echo
2024-10-08T20:19:44.2939327Z echo "Is keep-going label set? False"
2024-10-08T20:19:44.2939881Z 
2024-10-08T20:19:44.2940147Z echo
2024-10-08T20:19:44.2940456Z echo "Renabled issues? "
2024-10-08T20:19:44.2946522Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:44.2947024Z env:
2024-10-08T20:19:44.2947301Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:44.2947645Z ##[endgroup]
2024-10-08T20:19:44.2972096Z Filtered matrix:
2024-10-08T20:19:44.2977480Z {include: [{config: default, shard: 1, num_shards: 4, runner: linux.2xlarge}, {config: default, shard: 2, num_shards: 4, runner: linux.2xlarge}, {config: default, shard: 3, num_shards: 4, runner: linux.2xlarge}, {config: default, shard: 4, num_shards: 4, runner: linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: linux.2xlarge}]}
2024-10-08T20:19:44.2980683Z 
2024-10-08T20:19:44.2980846Z Is the current job unstable? False
2024-10-08T20:19:44.2981130Z 
2024-10-08T20:19:44.2981461Z Is keep-going label set? False
2024-10-08T20:19:44.2981719Z 
2024-10-08T20:19:44.2981831Z Renabled issues? 
2024-10-08T20:19:44.3027730Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-10-08T20:19:44.3028469Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-10-08T20:19:44.3034375Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T20:19:44.3034874Z env:
2024-10-08T20:19:44.3035146Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:44.3035496Z   JOB_TIMEOUT: 240
2024-10-08T20:19:44.3035793Z ##[endgroup]
2024-10-08T20:19:44.3125872Z ##[group]Run set -x
2024-10-08T20:19:44.3126277Z set -x
2024-10-08T20:19:44.3126559Z 
2024-10-08T20:19:44.3126912Z if [[ $TEST_CONFIG == 'multigpu' ]]; then
2024-10-08T20:19:44.3127484Z   TEST_COMMAND=.ci/pytorch/multigpu-test.sh
2024-10-08T20:19:44.3128082Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then
2024-10-08T20:19:44.3128597Z   TEST_COMMAND=.ci/onnx/test.sh
2024-10-08T20:19:44.3129013Z else
2024-10-08T20:19:44.3129354Z   TEST_COMMAND=.ci/pytorch/test.sh
2024-10-08T20:19:44.3129783Z fi
2024-10-08T20:19:44.3130036Z 
2024-10-08T20:19:44.3130517Z # detached container should get cleaned up by teardown_ec2_linux
2024-10-08T20:19:44.3131325Z # TODO: Stop building test binaries as part of the build phase
2024-10-08T20:19:44.3132035Z # Used for GPU_FLAG since that doesn't play nice
2024-10-08T20:19:44.3132764Z # shellcheck disable=SC2086,SC2090
2024-10-08T20:19:44.3133246Z container_name=$(docker run \
2024-10-08T20:19:44.3133664Z   ${GPU_FLAG:-} \
2024-10-08T20:19:44.3134094Z   ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \
2024-10-08T20:19:44.3134589Z   -e BUILD_ENVIRONMENT \
2024-10-08T20:19:44.3135138Z   -e PR_NUMBER \
2024-10-08T20:19:44.3135511Z   -e GITHUB_ACTIONS \
2024-10-08T20:19:44.3135913Z   -e GITHUB_REPOSITORY \
2024-10-08T20:19:44.3136332Z   -e GITHUB_WORKFLOW \
2024-10-08T20:19:44.3136711Z   -e GITHUB_JOB \
2024-10-08T20:19:44.3137079Z   -e GITHUB_RUN_ID \
2024-10-08T20:19:44.3137471Z   -e GITHUB_RUN_NUMBER \
2024-10-08T20:19:44.3137880Z   -e GITHUB_RUN_ATTEMPT \
2024-10-08T20:19:44.3138271Z   -e JOB_ID \
2024-10-08T20:19:44.3138613Z   -e JOB_NAME \
2024-10-08T20:19:44.3138962Z   -e BASE_SHA \
2024-10-08T20:19:44.3139314Z   -e BRANCH \
2024-10-08T20:19:44.3139642Z   -e SHA1 \
2024-10-08T20:19:44.3139988Z   -e AWS_DEFAULT_REGION \
2024-10-08T20:19:44.3140400Z   -e IN_WHEEL_TEST \
2024-10-08T20:19:44.3140771Z   -e SHARD_NUMBER \
2024-10-08T20:19:44.3141145Z   -e TEST_CONFIG \
2024-10-08T20:19:44.3141523Z   -e NUM_TEST_SHARDS \
2024-10-08T20:19:44.3141926Z   -e REENABLED_ISSUES \
2024-10-08T20:19:44.3142332Z   -e CONTINUE_THROUGH_ERROR \
2024-10-08T20:19:44.3142767Z   -e VERBOSE_TEST_LOGS \
2024-10-08T20:19:44.3143175Z   -e TEST_SHOWLOCALS \
2024-10-08T20:19:44.3143574Z   -e NO_TEST_TIMEOUT \
2024-10-08T20:19:44.3143939Z   -e NO_TD \
2024-10-08T20:19:44.3144283Z   -e TD_DISTRIBUTED \
2024-10-08T20:19:44.3144665Z   -e PR_LABELS \
2024-10-08T20:19:44.3145080Z   -e MAX_JOBS="$(nproc --ignore=2)" \
2024-10-08T20:19:44.3145541Z   -e SCCACHE_BUCKET \
2024-10-08T20:19:44.3145936Z   -e SCCACHE_REGION \
2024-10-08T20:19:44.3146341Z   -e SCCACHE_S3_KEY_PREFIX \
2024-10-08T20:19:44.3146763Z   -e XLA_CUDA \
2024-10-08T20:19:44.3147154Z   -e XLA_CLANG_CACHE_S3_BUCKET_NAME \
2024-10-08T20:19:44.3147680Z   -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \
2024-10-08T20:19:44.3148228Z   -e PYTORCH_TEST_RERUN_DISABLED_TESTS \
2024-10-08T20:19:44.3148763Z   -e SKIP_SCCACHE_INITIALIZATION=1 \
2024-10-08T20:19:44.3149234Z   -e HUGGING_FACE_HUB_TOKEN \
2024-10-08T20:19:44.3149698Z   -e SCRIBE_GRAPHQL_ACCESS_TOKEN \
2024-10-08T20:19:44.3150150Z   -e DASHBOARD_TAG \
2024-10-08T20:19:44.3150542Z   -e IS_A100_RUNNER \
2024-10-08T20:19:44.3151019Z   --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \
2024-10-08T20:19:44.3151599Z   --security-opt seccomp=unconfined \
2024-10-08T20:19:44.3152082Z   --cap-add=SYS_PTRACE \
2024-10-08T20:19:44.3152480Z   --ipc=host \
2024-10-08T20:19:44.3152932Z   --shm-size="${SHM_SIZE}" \
2024-10-08T20:19:44.3153344Z   --tty \
2024-10-08T20:19:44.3153661Z   --detach \
2024-10-08T20:19:44.3154009Z   --name="${container_name}" \
2024-10-08T20:19:44.3154441Z   --user jenkins \
2024-10-08T20:19:44.3154952Z   -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \
2024-10-08T20:19:44.3155536Z   -w /var/lib/jenkins/workspace \
2024-10-08T20:19:44.3155971Z   "${DOCKER_IMAGE}"
2024-10-08T20:19:44.3156323Z )
2024-10-08T20:19:44.3156736Z # Propagate download.pytorch.org IP to container
2024-10-08T20:19:44.3157733Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts"
2024-10-08T20:19:44.3158761Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}"
2024-10-08T20:19:44.3159744Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}"
2024-10-08T20:19:44.3165743Z shell: /usr/bin/bash -e {0}
2024-10-08T20:19:44.3166100Z env:
2024-10-08T20:19:44.3166374Z   GIT_DEFAULT_BRANCH: main
2024-10-08T20:19:44.3166782Z   BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11
2024-10-08T20:19:44.3167248Z   PR_NUMBER: 134247
2024-10-08T20:19:44.3167675Z   GITHUB_REPOSITORY: pytorch/pytorch
2024-10-08T20:19:44.3168088Z   GITHUB_WORKFLOW: pull
2024-10-08T20:19:44.3168427Z   GITHUB_JOB: test
2024-10-08T20:19:44.3168743Z   GITHUB_RUN_ID: 11242664097
2024-10-08T20:19:44.3169111Z   GITHUB_RUN_NUMBER: 252617
2024-10-08T20:19:44.3169463Z   GITHUB_RUN_ATTEMPT: 1
2024-10-08T20:19:44.3169795Z   JOB_ID: 31257778946
2024-10-08T20:19:44.3170343Z   JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:44.3170986Z   BRANCH: pull/134247
2024-10-08T20:19:44.3171359Z   SHA1: 47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:19:44.3171888Z   BASE_SHA: 05ad01290ec4310464e5073140f6c94a10acf565
2024-10-08T20:19:44.3172377Z   TEST_CONFIG: distributed
2024-10-08T20:19:44.3172838Z   SHARD_NUMBER: 2
2024-10-08T20:19:44.3173131Z   NUM_TEST_SHARDS: 2
2024-10-08T20:19:44.3173455Z   REENABLED_ISSUES: 
2024-10-08T20:19:44.3173793Z   CONTINUE_THROUGH_ERROR: False
2024-10-08T20:19:44.3174174Z   VERBOSE_TEST_LOGS: False
2024-10-08T20:19:44.3174543Z   TEST_SHOWLOCALS: False
2024-10-08T20:19:44.3174890Z   NO_TEST_TIMEOUT: False
2024-10-08T20:19:44.3175221Z   NO_TD: False
2024-10-08T20:19:44.3175504Z   TD_DISTRIBUTED: False
2024-10-08T20:19:44.3175927Z   SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2
2024-10-08T20:19:44.3176431Z   SCCACHE_REGION: us-east-1
2024-10-08T20:19:44.3176802Z   SCCACHE_S3_KEY_PREFIX: pull
2024-10-08T20:19:44.3177148Z   SHM_SIZE: 1g
2024-10-08T20:19:44.3178071Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:19:44.3179101Z   XLA_CUDA: 
2024-10-08T20:19:44.3179603Z   XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla
2024-10-08T20:19:44.3180237Z   PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0
2024-10-08T20:19:44.3180680Z   PYTORCH_TEST_RERUN_DISABLED_TESTS: 0
2024-10-08T20:19:44.3181096Z   DASHBOARD_TAG: 
2024-10-08T20:19:44.3181632Z   HUGGING_FACE_HUB_TOKEN: ***
2024-10-08T20:19:44.3182014Z   SCRIBE_GRAPHQL_ACCESS_TOKEN: 
2024-10-08T20:19:44.3182397Z   IS_A100_RUNNER: 0
2024-10-08T20:19:44.3182703Z ##[endgroup]
2024-10-08T20:19:44.3207415Z + [[ distributed == \m\u\l\t\i\g\p\u ]]
2024-10-08T20:19:44.3208415Z + [[ linux-jammy-py3.9-gcc11 == *onnx* ]]
2024-10-08T20:19:44.3208885Z + TEST_COMMAND=.ci/pytorch/test.sh
2024-10-08T20:19:44.3216187Z +++ nproc --ignore=2
2024-10-08T20:19:44.3238161Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER --env-file=/tmp/github_env_11242664097 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T20:19:47.9711444Z + container_name=37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T20:19:47.9713286Z + grep download.pytorch.org /etc/hosts
2024-10-08T20:19:47.9715664Z + docker exec -i 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5 sudo bash -c '/bin/cat >> /etc/hosts'
2024-10-08T20:19:48.1496441Z + echo DOCKER_CONTAINER_ID=37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T20:19:48.1499092Z ++ echo dist/torch-2.6.0a0+git47952c0-cp39-cp39-linux_x86_64.whl
2024-10-08T20:19:48.1501551Z + docker exec -t 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5 sh -c 'pip install dist/torch-2.6.0a0+git47952c0-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh'
2024-10-08T20:19:49.0634285Z Processing ./dist/torch-2.6.0a0+git47952c0-cp39-cp39-linux_x86_64.whl (from torch==2.6.0a0+git47952c0)
2024-10-08T20:19:49.5382773Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (3.13.1)
2024-10-08T20:19:49.5387002Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (4.12.2)
2024-10-08T20:19:49.5390597Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (2.8.8)
2024-10-08T20:19:49.5394385Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (3.1.4)
2024-10-08T20:19:49.5398133Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (2024.6.1)
2024-10-08T20:19:49.5404289Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (1.13.1)
2024-10-08T20:19:49.5427283Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy==1.13.1->torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (1.3.0)
2024-10-08T20:19:49.5441462Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (3.3.0)
2024-10-08T20:19:49.5465621Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (1.21.2)
2024-10-08T20:19:49.5870202Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.6.0a0+git47952c0->torch==2.6.0a0+git47952c0) (2.1.5)
2024-10-08T20:19:50.1483459Z Installing collected packages: torch
2024-10-08T20:19:58.3585186Z Successfully installed torch-2.6.0a0+git47952c0
2024-10-08T20:19:58.4307438Z + export TERM=vt100
2024-10-08T20:19:58.4308025Z + TERM=vt100
2024-10-08T20:19:58.4310162Z ++ dirname .ci/pytorch/test.sh
2024-10-08T20:19:58.4327762Z + source .ci/pytorch/common.sh
2024-10-08T20:19:58.4337913Z +++ dirname .ci/pytorch/common.sh
2024-10-08T20:19:58.4344929Z ++ source .ci/pytorch/common_utils.sh
2024-10-08T20:19:58.4350817Z +++ declare -f -t trap_add
2024-10-08T20:19:58.4354635Z ++ set -ex
2024-10-08T20:19:58.4355381Z ++ [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-10-08T20:19:58.4356244Z ++ BUILD_TEST_LIBTORCH=0
2024-10-08T20:19:58.4357010Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]]
2024-10-08T20:19:58.4358865Z ++ stat -c %u /var/lib/jenkins/workspace
2024-10-08T20:19:58.4385198Z + WORKSPACE_ORIGINAL_OWNER_ID=1000
2024-10-08T20:19:58.4386026Z + trap_add cleanup_workspace EXIT
2024-10-08T20:19:58.4386816Z + trap_add_cmd=cleanup_workspace
2024-10-08T20:19:58.4387488Z + shift
2024-10-08T20:19:58.4388002Z + for trap_add_name in "$@"
2024-10-08T20:19:58.4392084Z +++ trap -p EXIT
2024-10-08T20:19:58.4395018Z ++ eval 'extract_trap_cmd '
2024-10-08T20:19:58.4395514Z +++ extract_trap_cmd
2024-10-08T20:19:58.4395884Z +++ printf '%s\n' ''
2024-10-08T20:19:58.4396366Z ++ printf '%s\n' cleanup_workspace
2024-10-08T20:19:58.4397458Z + trap -- '
2024-10-08T20:19:58.4398050Z cleanup_workspace' EXIT
2024-10-08T20:19:58.4398596Z + sudo chown -R jenkins /var/lib/jenkins/workspace
2024-10-08T20:19:58.8916538Z + git config --global --add safe.directory /var/lib/jenkins/workspace
2024-10-08T20:19:58.9122521Z + echo 'Environment variables:'
2024-10-08T20:19:58.9123014Z Environment variables:
2024-10-08T20:19:58.9123337Z + env
2024-10-08T20:19:58.9141999Z INSTALLED_DB=yes
2024-10-08T20:19:58.9142939Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T20:19:58.9143969Z CONTINUE_THROUGH_ERROR=False
2024-10-08T20:19:58.9144650Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11
2024-10-08T20:19:58.9145335Z HOSTNAME=37d41d4bda7e
2024-10-08T20:19:58.9146963Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9148327Z GITHUB_ACTION=__self
2024-10-08T20:19:58.9148711Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-10-08T20:19:58.9149350Z GITHUB_RUN_NUMBER=252617
2024-10-08T20:19:58.9149923Z TEST_CONFIG=distributed
2024-10-08T20:19:58.9150568Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-10-08T20:19:58.9151475Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-10-08T20:19:58.9152211Z IS_A100_RUNNER=0
2024-10-08T20:19:58.9152686Z SCRIBE_GRAPHQL_ACCESS_TOKEN=
2024-10-08T20:19:58.9153394Z GITHUB_TRIGGERING_ACTOR=kwen2501
2024-10-08T20:19:58.9154109Z GITHUB_REF_TYPE=branch
2024-10-08T20:19:58.9154531Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-10-08T20:19:58.9154997Z BASE_SHA=05ad01290ec4310464e5073140f6c94a10acf565
2024-10-08T20:19:58.9155720Z XLA_CUDA=
2024-10-08T20:19:58.9156621Z HUGGING_FACE_HUB_TOKEN=***
2024-10-08T20:19:58.9157596Z ***
2024-10-08T20:19:58.9157979Z GITHUB_REPOSITORY_ID=65600975
2024-10-08T20:19:58.9158600Z GITHUB_ACTIONS=true
2024-10-08T20:19:58.9159233Z SHA1=47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:19:58.9160254Z GITHUB_SHA=cbe39ffc96498585a83508a23de66f3eecb751d5
2024-10-08T20:19:58.9161899Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/134247/merge
2024-10-08T20:19:58.9163419Z UCC_HOME=/usr
2024-10-08T20:19:58.9164067Z VERBOSE_TEST_LOGS=False
2024-10-08T20:19:58.9164853Z GITHUB_REF=refs/pull/134247/merge
2024-10-08T20:19:58.9165616Z SHARD_NUMBER=2
2024-10-08T20:19:58.9166172Z GITHUB_REF_PROTECTED=false
2024-10-08T20:19:58.9166528Z HOME=/var/lib/jenkins
2024-10-08T20:19:58.9166894Z GITHUB_API_URL=https://api.github.com
2024-10-08T20:19:58.9167327Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-10-08T20:19:58.9167719Z UCX_COMMIT=
2024-10-08T20:19:58.9168003Z SCCACHE_S3_KEY_PREFIX=pull
2024-10-08T20:19:58.9168338Z NUM_TEST_SHARDS=2
2024-10-08T20:19:58.9168633Z UCX_HOME=/usr
2024-10-08T20:19:58.9169591Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9170778Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:58.9172203Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9173524Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-10-08T20:19:58.9174231Z GITHUB_EVENT_NAME=pull_request
2024-10-08T20:19:58.9174606Z DASHBOARD_TAG=
2024-10-08T20:19:58.9174890Z GITHUB_RUN_ID=11242664097
2024-10-08T20:19:58.9175895Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9176824Z GITHUB_ACTOR=kwen2501
2024-10-08T20:19:58.9177146Z PR_NUMBER=134247
2024-10-08T20:19:58.9177432Z DESIRED_CUDA=
2024-10-08T20:19:58.9177722Z GITHUB_RUN_ATTEMPT=1
2024-10-08T20:19:58.9178054Z ANACONDA_PYTHON_VERSION=3.9
2024-10-08T20:19:58.9178503Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-10-08T20:19:58.9178963Z TERM=vt100
2024-10-08T20:19:58.9179235Z INSTALLED_VISION=yes
2024-10-08T20:19:58.9179549Z BRANCH=pull/134247
2024-10-08T20:19:58.9179911Z SCCACHE_REGION=us-east-1
2024-10-08T20:19:58.9180281Z OPENSSL_ROOT_DIR=/opt/openssl
2024-10-08T20:19:58.9180654Z CUDA_PATH=/usr/local/cuda
2024-10-08T20:19:58.9181461Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-10-08T20:19:58.9182393Z GITHUB_SERVER_URL=https://github.com
2024-10-08T20:19:58.9182782Z UCC_COMMIT=
2024-10-08T20:19:58.9183056Z REENABLED_ISSUES=
2024-10-08T20:19:58.9183347Z DOCS=yes
2024-10-08T20:19:58.9183599Z INSTALLED_ANDROID=
2024-10-08T20:19:58.9183892Z SHLVL=1
2024-10-08T20:19:58.9184140Z MAX_JOBS=6
2024-10-08T20:19:58.9184413Z GITHUB_ACTOR_ID=6676466
2024-10-08T20:19:58.9184864Z GITHUB_WORKFLOW_SHA=cbe39ffc96498585a83508a23de66f3eecb751d5
2024-10-08T20:19:58.9185398Z GITHUB_REF_NAME=134247/merge
2024-10-08T20:19:58.9186036Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-10-08T20:19:58.9186636Z GITHUB_JOB=test
2024-10-08T20:19:58.9186918Z NO_TEST_TIMEOUT=False
2024-10-08T20:19:58.9187245Z TD_DISTRIBUTED=False
2024-10-08T20:19:58.9187587Z GITHUB_REPOSITORY=pytorch/pytorch
2024-10-08T20:19:58.9187971Z GITHUB_RETENTION_DAYS=90
2024-10-08T20:19:58.9188315Z OPENSSL_DIR=/opt/openssl
2024-10-08T20:19:58.9189024Z GITHUB_ACTION_REPOSITORY=
2024-10-08T20:19:58.9190800Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-10-08T20:19:58.9192731Z GITHUB_BASE_REF=gh/kwen2501/47/base
2024-10-08T20:19:58.9193371Z INSTALLED_ACL=
2024-10-08T20:19:58.9193818Z CI=true
2024-10-08T20:19:58.9194243Z GITHUB_REPOSITORY_OWNER=pytorch
2024-10-08T20:19:58.9194608Z JOB_ID=31257778946
2024-10-08T20:19:58.9194915Z INSTALLED_PROTOBUF=yes
2024-10-08T20:19:58.9195266Z GITHUB_HEAD_REF=gh/kwen2501/47/head
2024-10-08T20:19:58.9195657Z GITHUB_ACTION_REF=
2024-10-08T20:19:58.9196132Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-10-08T20:19:58.9196614Z TEST_SHOWLOCALS=False
2024-10-08T20:19:58.9196951Z GITHUB_WORKFLOW=pull
2024-10-08T20:19:58.9197280Z DEBIAN_FRONTEND=noninteractive
2024-10-08T20:19:58.9198271Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9199140Z NO_TD=False
2024-10-08T20:19:58.9199445Z SKIP_SCCACHE_INITIALIZATION=1
2024-10-08T20:19:58.9199797Z _=/usr/bin/env
2024-10-08T20:19:58.9200291Z ++ python -c 'import site; print(site.getsitepackages()[0])'
2024-10-08T20:19:58.9414245Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch
2024-10-08T20:19:58.9415363Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin
2024-10-08T20:19:58.9416278Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib
2024-10-08T20:19:58.9417217Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test
2024-10-08T20:19:58.9417848Z + BUILD_DIR=build
2024-10-08T20:19:58.9418328Z + BUILD_RENAMED_DIR=build_renamed
2024-10-08T20:19:58.9419096Z + BUILD_BIN_DIR=build/bin
2024-10-08T20:19:58.9419446Z + SHARD_NUMBER=2
2024-10-08T20:19:58.9419751Z + NUM_TEST_SHARDS=2
2024-10-08T20:19:58.9420067Z + export VALGRIND=ON
2024-10-08T20:19:58.9420371Z + VALGRIND=ON
2024-10-08T20:19:58.9420783Z + [[ linux-jammy-py3.9-gcc11 == *clang9* ]]
2024-10-08T20:19:58.9421229Z + [[ 0 == \1 ]]
2024-10-08T20:19:58.9421503Z + [[ False == \1 ]]
2024-10-08T20:19:58.9421909Z + [[ linux-jammy-py3.9-gcc11 != *bazel* ]]
2024-10-08T20:19:58.9422385Z ++ realpath build/custom_test_artifacts
2024-10-08T20:19:58.9439279Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts
2024-10-08T20:19:58.9440151Z + [[ -n '' ]]
2024-10-08T20:19:58.9440578Z + echo 'Environment variables'
2024-10-08T20:19:58.9440962Z Environment variables
2024-10-08T20:19:58.9441358Z + env
2024-10-08T20:19:58.9447206Z INSTALLED_DB=yes
2024-10-08T20:19:58.9448903Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T20:19:58.9450194Z CONTINUE_THROUGH_ERROR=False
2024-10-08T20:19:58.9450707Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11
2024-10-08T20:19:58.9451444Z HOSTNAME=37d41d4bda7e
2024-10-08T20:19:58.9452508Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9453695Z GITHUB_ACTION=__self
2024-10-08T20:19:58.9454046Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-10-08T20:19:58.9454447Z GITHUB_RUN_NUMBER=252617
2024-10-08T20:19:58.9454783Z TEST_CONFIG=distributed
2024-10-08T20:19:58.9455139Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-10-08T20:19:58.9455636Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-10-08T20:19:58.9456036Z IS_A100_RUNNER=0
2024-10-08T20:19:58.9456349Z SCRIBE_GRAPHQL_ACCESS_TOKEN=
2024-10-08T20:19:58.9456730Z GITHUB_TRIGGERING_ACTOR=kwen2501
2024-10-08T20:19:58.9457120Z GITHUB_REF_TYPE=branch
2024-10-08T20:19:58.9457445Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-10-08T20:19:58.9457861Z BASE_SHA=05ad01290ec4310464e5073140f6c94a10acf565
2024-10-08T20:19:58.9458321Z XLA_CUDA=
2024-10-08T20:19:58.9458846Z HUGGING_FACE_HUB_TOKEN=***
2024-10-08T20:19:58.9459229Z ***
2024-10-08T20:19:58.9459501Z GITHUB_REPOSITORY_ID=65600975
2024-10-08T20:19:58.9459868Z GITHUB_ACTIONS=true
2024-10-08T20:19:58.9460232Z SHA1=47952c0a8001fd60c9ffe52b121d022d440bef8b
2024-10-08T20:19:58.9460750Z GITHUB_SHA=cbe39ffc96498585a83508a23de66f3eecb751d5
2024-10-08T20:19:58.9461497Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/134247/merge
2024-10-08T20:19:58.9462160Z UCC_HOME=/usr
2024-10-08T20:19:58.9462450Z VERBOSE_TEST_LOGS=False
2024-10-08T20:19:58.9462786Z GITHUB_REF=refs/pull/134247/merge
2024-10-08T20:19:58.9463162Z SHARD_NUMBER=2
2024-10-08T20:19:58.9463472Z GITHUB_REF_PROTECTED=false
2024-10-08T20:19:58.9463806Z HOME=/var/lib/jenkins
2024-10-08T20:19:58.9464169Z GITHUB_API_URL=https://api.github.com
2024-10-08T20:19:58.9464616Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-10-08T20:19:58.9465011Z UCX_COMMIT=
2024-10-08T20:19:58.9465295Z SCCACHE_S3_KEY_PREFIX=pull
2024-10-08T20:19:58.9465641Z NUM_TEST_SHARDS=2
2024-10-08T20:19:58.9465941Z UCX_HOME=/usr
2024-10-08T20:19:58.9466863Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9468035Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-10-08T20:19:58.9469247Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9470474Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-10-08T20:19:58.9471180Z GITHUB_EVENT_NAME=pull_request
2024-10-08T20:19:58.9471546Z DASHBOARD_TAG=
2024-10-08T20:19:58.9471842Z GITHUB_RUN_ID=11242664097
2024-10-08T20:19:58.9472853Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9473776Z GITHUB_ACTOR=kwen2501
2024-10-08T20:19:58.9474199Z PR_NUMBER=134247
2024-10-08T20:19:58.9474496Z DESIRED_CUDA=
2024-10-08T20:19:58.9474786Z GITHUB_RUN_ATTEMPT=1
2024-10-08T20:19:58.9475089Z VALGRIND=ON
2024-10-08T20:19:58.9475378Z ANACONDA_PYTHON_VERSION=3.9
2024-10-08T20:19:58.9475828Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-10-08T20:19:58.9476308Z TERM=vt100
2024-10-08T20:19:58.9476575Z INSTALLED_VISION=yes
2024-10-08T20:19:58.9476893Z BRANCH=pull/134247
2024-10-08T20:19:58.9477258Z SCCACHE_REGION=us-east-1
2024-10-08T20:19:58.9477615Z OPENSSL_ROOT_DIR=/opt/openssl
2024-10-08T20:19:58.9477975Z CUDA_PATH=/usr/local/cuda
2024-10-08T20:19:58.9478790Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-10-08T20:19:58.9479595Z GITHUB_SERVER_URL=https://github.com
2024-10-08T20:19:58.9479984Z UCC_COMMIT=
2024-10-08T20:19:58.9480263Z REENABLED_ISSUES=
2024-10-08T20:19:58.9480553Z DOCS=yes
2024-10-08T20:19:58.9480826Z INSTALLED_ANDROID=
2024-10-08T20:19:58.9481157Z SHLVL=1
2024-10-08T20:19:58.9481401Z MAX_JOBS=6
2024-10-08T20:19:58.9481676Z GITHUB_ACTOR_ID=6676466
2024-10-08T20:19:58.9482147Z GITHUB_WORKFLOW_SHA=cbe39ffc96498585a83508a23de66f3eecb751d5
2024-10-08T20:19:58.9482677Z GITHUB_REF_NAME=134247/merge
2024-10-08T20:19:58.9483335Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-10-08T20:19:58.9484028Z GITHUB_JOB=test
2024-10-08T20:19:58.9484329Z NO_TEST_TIMEOUT=False
2024-10-08T20:19:58.9484641Z TD_DISTRIBUTED=False
2024-10-08T20:19:58.9484990Z GITHUB_REPOSITORY=pytorch/pytorch
2024-10-08T20:19:58.9485394Z GITHUB_RETENTION_DAYS=90
2024-10-08T20:19:58.9485732Z OPENSSL_DIR=/opt/openssl
2024-10-08T20:19:58.9486082Z GITHUB_ACTION_REPOSITORY=
2024-10-08T20:19:58.9487215Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-10-08T20:19:58.9488413Z GITHUB_BASE_REF=gh/kwen2501/47/base
2024-10-08T20:19:58.9489550Z INSTALLED_ACL=
2024-10-08T20:19:58.9489844Z CI=true
2024-10-08T20:19:58.9490128Z GITHUB_REPOSITORY_OWNER=pytorch
2024-10-08T20:19:58.9490509Z JOB_ID=31257778946
2024-10-08T20:19:58.9490807Z INSTALLED_PROTOBUF=yes
2024-10-08T20:19:58.9491157Z GITHUB_HEAD_REF=gh/kwen2501/47/head
2024-10-08T20:19:58.9491553Z GITHUB_ACTION_REF=
2024-10-08T20:19:58.9492056Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-10-08T20:19:58.9492526Z TEST_SHOWLOCALS=False
2024-10-08T20:19:58.9492951Z GITHUB_WORKFLOW=pull
2024-10-08T20:19:58.9493290Z DEBIAN_FRONTEND=noninteractive
2024-10-08T20:19:58.9494268Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_9127f5c4-d3a9-4019-a023-67270bb598cb
2024-10-08T20:19:58.9495143Z NO_TD=False
2024-10-08T20:19:58.9495441Z SKIP_SCCACHE_INITIALIZATION=1
2024-10-08T20:19:58.9495806Z _=/usr/bin/env
2024-10-08T20:19:58.9496134Z + echo 'Testing pytorch'
2024-10-08T20:19:58.9496472Z Testing pytorch
2024-10-08T20:19:58.9496790Z + export LANG=C.UTF-8
2024-10-08T20:19:58.9497125Z + LANG=C.UTF-8
2024-10-08T20:19:58.9500721Z + PR_NUMBER=134247
2024-10-08T20:19:58.9501303Z + [[ distributed == \d\e\f\a\u\l\t ]]
2024-10-08T20:19:58.9502049Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]]
2024-10-08T20:19:58.9503049Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-10-08T20:19:58.9503803Z + [[ distributed == \s\l\o\w ]]
2024-10-08T20:19:58.9504477Z + [[ linux-jammy-py3.9-gcc11 == *slow-gradcheck* ]]
2024-10-08T20:19:58.9505053Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]]
2024-10-08T20:19:58.9505570Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-10-08T20:19:58.9506072Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]]
2024-10-08T20:19:58.9506530Z + [[ distributed == *crossref* ]]
2024-10-08T20:19:58.9507010Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-10-08T20:19:58.9507517Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]]
2024-10-08T20:19:58.9508030Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]]
2024-10-08T20:19:58.9508540Z + pip_install --user ninja==1.10.2
2024-10-08T20:19:58.9509274Z + pip install --progress-bar off --user ninja==1.10.2
2024-10-08T20:19:59.3858803Z Collecting ninja==1.10.2
2024-10-08T20:19:59.3970732Z   Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB)
2024-10-08T20:19:59.4188996Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB)
2024-10-08T20:19:59.8721739Z Installing collected packages: ninja
2024-10-08T20:19:59.8813129Z   WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH.
2024-10-08T20:19:59.8814530Z   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
2024-10-08T20:20:00.0954875Z Successfully installed ninja-1.10.2
2024-10-08T20:20:00.1745565Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-10-08T20:20:00.1748059Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-10-08T20:20:00.1749676Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]]
2024-10-08T20:20:00.1750134Z + install_tlparse
2024-10-08T20:20:00.1750775Z + pip_install --user tlparse==0.3.25
2024-10-08T20:20:00.1751355Z + pip install --progress-bar off --user tlparse==0.3.25
2024-10-08T20:20:00.6182183Z Collecting tlparse==0.3.25
2024-10-08T20:20:00.6296349Z   Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB)
2024-10-08T20:20:00.6834352Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB)
2024-10-08T20:20:01.2168552Z Installing collected packages: tlparse
2024-10-08T20:20:01.2928771Z Successfully installed tlparse-0.3.25
2024-10-08T20:20:01.3775841Z ++ python -m site --user-base
2024-10-08T20:20:01.4189594Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-10-08T20:20:01.4192783Z + [[ linux-jammy-py3.9-gcc11 == *asan* ]]
2024-10-08T20:20:01.4193615Z + [[ linux-jammy-py3.9-gcc11 == *-debug* ]]
2024-10-08T20:20:01.4194530Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]]
2024-10-08T20:20:01.4195698Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass'
2024-10-08T20:20:01.4196757Z We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass
2024-10-08T20:20:01.4197387Z + cd test
2024-10-08T20:20:01.4197945Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)'
2024-10-08T20:20:03.9498698Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]]
2024-10-08T20:20:03.9499340Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]]
2024-10-08T20:20:03.9500575Z + DYNAMO_BENCHMARK_FLAGS=()
2024-10-08T20:20:03.9501807Z + [[ distributed == *pr_time_benchmarks* ]]
2024-10-08T20:20:03.9502647Z + [[ distributed == *dynamo_eager* ]]
2024-10-08T20:20:03.9503192Z + [[ distributed == *aot_eager* ]]
2024-10-08T20:20:03.9503609Z + [[ distributed == *aot_inductor* ]]
2024-10-08T20:20:03.9504025Z + [[ distributed == *inductor* ]]
2024-10-08T20:20:03.9504451Z + [[ distributed == *dynamic* ]]
2024-10-08T20:20:03.9504852Z + [[ distributed == *cpu* ]]
2024-10-08T20:20:03.9505465Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda)
2024-10-08T20:20:03.9525043Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]]
2024-10-08T20:20:03.9525825Z + [[ linux-jammy-py3.9-gcc11 == *-bazel-* ]]
2024-10-08T20:20:03.9528448Z + cd test
2024-10-08T20:20:03.9529275Z + python -c 'import torch; print(torch.__config__.show())'
2024-10-08T20:20:05.2448769Z PyTorch built with:
2024-10-08T20:20:05.2449611Z   - GCC 11.4
2024-10-08T20:20:05.2449954Z   - C++ Version: 201703
2024-10-08T20:20:05.2451205Z   - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-10-08T20:20:05.2452386Z   - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-10-08T20:20:05.2453208Z   - OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-10-08T20:20:05.2453749Z   - LAPACK is enabled (usually provided by MKL)
2024-10-08T20:20:05.2454250Z   - NNPACK is enabled
2024-10-08T20:20:05.2454650Z   - CPU capability usage: AVX512
2024-10-08T20:20:05.2462753Z   - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 
2024-10-08T20:20:05.2472377Z 
2024-10-08T20:20:05.4931812Z + cd test
2024-10-08T20:20:05.4932747Z + python -c 'import torch; print(torch.__config__.parallel_info())'
2024-10-08T20:20:06.7888477Z ATen/Parallel:
2024-10-08T20:20:06.7889288Z 	at::get_num_threads() : 4
2024-10-08T20:20:06.7889833Z 	at::get_num_interop_threads() : 4
2024-10-08T20:20:06.7890277Z OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-10-08T20:20:06.7902505Z 	omp_get_max_threads() : 4
2024-10-08T20:20:06.7903927Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-10-08T20:20:06.7904869Z 	mkl_get_max_threads() : 4
2024-10-08T20:20:06.7905618Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-10-08T20:20:06.7906394Z std::thread::hardware_concurrency() : 8
2024-10-08T20:20:06.7906899Z Environment variables:
2024-10-08T20:20:06.7907235Z 	OMP_NUM_THREADS : [not set]
2024-10-08T20:20:06.7907679Z 	MKL_NUM_THREADS : [not set]
2024-10-08T20:20:06.7908060Z ATen parallel backend: OpenMP
2024-10-08T20:20:06.7908388Z 
2024-10-08T20:20:07.0408911Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]]
2024-10-08T20:20:07.0409446Z + [[ distributed == *backward* ]]
2024-10-08T20:20:07.0409856Z + [[ distributed == *xla* ]]
2024-10-08T20:20:07.0410259Z + [[ distributed == *executorch* ]]
2024-10-08T20:20:07.0410709Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]]
2024-10-08T20:20:07.0411285Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]]
2024-10-08T20:20:07.0411762Z + [[ distributed == distributed ]]
2024-10-08T20:20:07.0412156Z + test_distributed
2024-10-08T20:20:07.0412657Z + echo 'Testing distributed python tests'
2024-10-08T20:20:07.0413105Z Testing distributed python tests
2024-10-08T20:20:07.0413767Z + python test/run_test.py --distributed-tests --shard 2 2 --verbose
2024-10-08T20:20:07.1643266Z /var/lib/jenkins/workspace/test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
2024-10-08T20:20:07.1644618Z   import pkg_resources
2024-10-08T20:20:11.5107103Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json
2024-10-08T20:20:11.5641172Z Ignoring disabled issues:  ['']
2024-10-08T20:20:11.5787419Z Found test times from artifacts
2024-10-08T20:20:11.6423999Z Found test times from artifacts
2024-10-08T20:20:11.6447755Z Running all tests
2024-10-08T20:20:11.6576877Z Running parallel tests on 3 processes
2024-10-08T20:20:11.6581557Z Name: tests to run (est. time: 68.71min)
2024-10-08T20:20:11.6582355Z   Serial tests (80):
2024-10-08T20:20:11.6583038Z     distributed/_tensor/test_dtensor_compile 1/1
2024-10-08T20:20:11.6583893Z     distributed/test_fake_pg 1/1
2024-10-08T20:20:11.6584654Z     distributed/tensor/parallel/test_tp_examples 1/1
2024-10-08T20:20:11.6585569Z     distributed/_tensor/test_embedding_ops 1/1
2024-10-08T20:20:11.6586528Z     distributed/checkpoint/test_dedup_tensors 1/1
2024-10-08T20:20:11.6587438Z     distributed/_tensor/test_tensor_ops 1/1
2024-10-08T20:20:11.6588474Z     distributed/_tensor/experimental/test_register_sharding 1/1
2024-10-08T20:20:11.6589464Z     distributed/_tensor/test_experimental_ops 1/1
2024-10-08T20:20:11.6589991Z     distributed/_tensor/test_redistribute 1/1
2024-10-08T20:20:11.6590467Z     distributed/_tensor/test_init 1/1
2024-10-08T20:20:11.6590993Z     distributed/_tensor/experimental/test_tp_transform 1/1
2024-10-08T20:20:11.6591529Z     distributed/_tensor/test_api 1/1
2024-10-08T20:20:11.6592029Z     distributed/checkpoint/test_dtensor_resharding 1/1
2024-10-08T20:20:11.6592567Z     distributed/_tensor/test_random_ops 1/1
2024-10-08T20:20:11.6593038Z     distributed/_tools/test_mod_tracker 1/1
2024-10-08T20:20:11.6593784Z     distributed/_tensor/debug/test_comm_mode_features 1/1
2024-10-08T20:20:11.6594351Z     distributed/_tensor/test_convolution_ops 1/1
2024-10-08T20:20:11.6594911Z     distributed/_tensor/experimental/test_local_map 1/1
2024-10-08T20:20:11.6595429Z     distributed/_tensor/test_math_ops 1/1
2024-10-08T20:20:11.6595894Z     distributed/_tensor/test_matrix_ops 1/1
2024-10-08T20:20:11.6596421Z     distributed/fsdp/test_fsdp_dtensor_state_dict 1/1
2024-10-08T20:20:11.6596967Z     distributed/checkpoint/e2e/test_fsdp_ep 1/1
2024-10-08T20:20:11.6597466Z     distributed/_composable/test_contract 1/1
2024-10-08T20:20:11.6597956Z     distributed/_tools/test_mem_tracker 1/1
2024-10-08T20:20:11.6598478Z     distributed/checkpoint/test_save_load_api 1/1
2024-10-08T20:20:11.6598971Z     distributed/pipelining/test_pipe 1/1
2024-10-08T20:20:11.6599459Z     distributed/test_c10d_functional_native 1/1
2024-10-08T20:20:11.6599938Z     distributed/fsdp/test_fsdp_fx 1/1
2024-10-08T20:20:11.6600475Z     distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1
2024-10-08T20:20:11.6601106Z     distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1
2024-10-08T20:20:11.6601720Z     distributed/checkpoint/test_fsdp_optim_state 1/1
2024-10-08T20:20:11.6602298Z     distributed/_shard/sharded_tensor/ops/test_init 1/1
2024-10-08T20:20:11.6602820Z     distributed/test_data_parallel 1/1
2024-10-08T20:20:11.6603340Z     distributed/_composable/fsdp/test_fully_shard_state 1/1
2024-10-08T20:20:11.6603977Z     distributed/_shard/sharded_tensor/ops/test_embedding 1/1
2024-10-08T20:20:11.6604633Z     distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1
2024-10-08T20:20:11.6605242Z     distributed/pipelining/test_microbatch 1/1
2024-10-08T20:20:11.6605762Z     distributed/rpc/cuda/test_tensorpipe_agent 1/1
2024-10-08T20:20:11.6606393Z     distributed/_composable/fsdp/test_fully_shard_logging 1/1
2024-10-08T20:20:11.6606975Z     distributed/rpc/test_tensorpipe_agent 2/4
2024-10-08T20:20:11.6607482Z     distributed/rpc/test_tensorpipe_agent 4/4
2024-10-08T20:20:11.6607989Z     distributed/optim/test_named_optimizer 1/1
2024-10-08T20:20:11.6608485Z     distributed/_composable/test_compose 1/1
2024-10-08T20:20:11.6608949Z     distributed/test_nccl 1/1
2024-10-08T20:20:11.6609376Z     distributed/checkpoint/test_checkpoint 1/1
2024-10-08T20:20:11.6609942Z     distributed/_composable/fsdp/test_fully_shard_compile 1/1
2024-10-08T20:20:11.6610555Z     distributed/fsdp/test_fsdp_backward_prefetch 1/1
2024-10-08T20:20:11.6611084Z     distributed/fsdp/test_fsdp_overlap 1/1
2024-10-08T20:20:11.6611574Z     distributed/fsdp/test_fsdp_pure_fp16 1/1
2024-10-08T20:20:11.6612256Z     distributed/_composable/fsdp/test_fully_shard_autograd 1/1
2024-10-08T20:20:11.6613007Z     distributed/_composable/fsdp/test_fully_shard_frozen 1/1
2024-10-08T20:20:11.6613591Z     distributed/fsdp/test_fsdp_optim_state 1/1
2024-10-08T20:20:11.6614115Z     distributed/fsdp/test_fsdp_flatten_params 1/1
2024-10-08T20:20:11.6614609Z     distributed/rpc/test_share_memory 1/1
2024-10-08T20:20:11.6615062Z     distributed/test_c10d_logger 1/1
2024-10-08T20:20:11.6615535Z     distributed/fsdp/test_fsdp_tp_integration 1/1
2024-10-08T20:20:11.6616046Z     distributed/fsdp/test_fsdp_traversal 1/1
2024-10-08T20:20:11.6616529Z     distributed/fsdp/test_fsdp_state_dict 1/1
2024-10-08T20:20:11.6617009Z     distributed/fsdp/test_fsdp_input 1/1
2024-10-08T20:20:11.6617485Z     distributed/fsdp/test_fsdp_exec_order 1/1
2024-10-08T20:20:11.6617962Z     distributed/fsdp/test_fsdp_uneven 1/1
2024-10-08T20:20:11.6618464Z     distributed/fsdp/test_fsdp_multiple_wrapping 1/1
2024-10-08T20:20:11.6618996Z     distributed/test_distributed_spawn 1/3
2024-10-08T20:20:11.6619476Z     distributed/test_distributed_spawn 3/3
2024-10-08T20:20:11.6619935Z     distributed/fsdp/test_utils 1/1
2024-10-08T20:20:11.6620418Z     distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1
2024-10-08T20:20:11.6620960Z     distributed/fsdp/test_fsdp_fine_tune 1/1
2024-10-08T20:20:11.6621561Z     distributed/fsdp/test_fsdp_multiple_forward 1/1
2024-10-08T20:20:11.6622069Z     distributed/test_multi_threaded_pg 1/1
2024-10-08T20:20:11.6622565Z     distributed/fsdp/test_fsdp_hybrid_shard 1/1
2024-10-08T20:20:11.6623060Z     distributed/algorithms/test_join 1/1
2024-10-08T20:20:11.6623702Z     distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint 1/1
2024-10-08T20:20:11.6624336Z     distributed/fsdp/test_fsdp_misc 1/1
2024-10-08T20:20:11.6624786Z     distributed/fsdp/test_fsdp_comm 1/1
2024-10-08T20:20:11.6625264Z     distributed/checkpoint/test_state_dict 1/1
2024-10-08T20:20:11.6625750Z     distributed/rpc/test_faulty_agent 1/1
2024-10-08T20:20:11.6626237Z     distributed/fsdp/test_fsdp_use_orig_params 1/1
2024-10-08T20:20:11.6626728Z     distributed/test_c10d_ucc 1/1
2024-10-08T20:20:11.6627132Z     distributed/test_launcher 1/1
2024-10-08T20:20:11.6627529Z     distributed/test_c10d_gloo 1/1
2024-10-08T20:20:11.6627909Z   Parallel tests (0):
2024-10-08T20:20:11.6628258Z Name: excluded (est. time: 0.0min)
2024-10-08T20:20:11.6628650Z   Serial tests (0):
2024-10-08T20:20:11.6628973Z   Parallel tests (0):
2024-10-08T20:20:11.6851154Z Running distributed/_tensor/test_dtensor_compile 1/1 ... [2024-10-08 20:20:11.684543]
2024-10-08T20:20:11.6852605Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:20:11.6859496Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:20:11.685376]
2024-10-08T20:20:49.6584394Z 
2024-10-08T20:20:49.6587175Z distributed/_tensor/test_dtensor_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_compile_1.1_34d4f3154b868528_.log
2024-10-08T20:20:49.6611281Z Running 28 items in this shard: test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_device_mesh_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_attribute_access_on_intermediate, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_constructor_w_dynamo_disable, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_constructor_w_graph_break, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_contiguous_dtensor_noncontiguous_local_as_tangent, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_different_gradient_placement, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dont_recompile_on_same_placement_devicemesh, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dynamic, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dynamo_device_mesh_attrs, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_noncontiguous_output, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_partial_placement_graph_output, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_partial_placement_redistribute_unbalanced_correct_strides, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local_dynamic_shapes, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local_redistribute, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_recompile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_to_local_kwargs, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_to_local_kwargs_forward_hook, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_fakify_dtensor, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_graph_input_is_async, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_placement_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_tp_compile_comm_reordering, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_2d_fsdp_tp_ac_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_2d_fsdp_tp_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_compile_dtensor_redistribute_backward, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_tp_compile_fullgraph_is_seq_parallel_False, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_tp_compile_fullgraph_is_seq_parallel_True
2024-10-08T20:20:49.6630664Z 
2024-10-08T20:20:49.6631288Z Running distributed/test_fake_pg 1/1 ... [2024-10-08 20:20:49.659820]
2024-10-08T20:20:49.6632006Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:20:49.6634019Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_fake_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:20:49.660694]
2024-10-08T20:20:52.9899576Z 
2024-10-08T20:20:52.9901633Z distributed/test_fake_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_fake_pg_1.1_e8d73f74afb378e3_.log
2024-10-08T20:20:52.9907693Z Running 13 items in this shard: test/distributed/test_fake_pg.py::TestFakePG::test_all_reduce, test/distributed/test_fake_pg.py::TestFakePG::test_allgather, test/distributed/test_fake_pg.py::TestFakePG::test_alltoall, test/distributed/test_fake_pg.py::TestFakePG::test_alltoall_base, test/distributed/test_fake_pg.py::TestFakePG::test_broadcast, test/distributed/test_fake_pg.py::TestFakePG::test_construct_fsdp, test/distributed/test_fake_pg.py::TestFakePG::test_fake_pg_tracing, test/distributed/test_fake_pg.py::TestFakePG::test_fsdp_fake_e2e, test/distributed/test_fake_pg.py::TestFakePG::test_fsdp_tp_fake_e2e, test/distributed/test_fake_pg.py::TestFakePG::test_recv, test/distributed/test_fake_pg.py::TestFakePG::test_reduce_scatter, test/distributed/test_fake_pg.py::TestFakePG::test_scatter, test/distributed/test_fake_pg.py::TestFakePG::test_send
2024-10-08T20:20:52.9913121Z 
2024-10-08T20:20:52.9913679Z Running distributed/tensor/parallel/test_tp_examples 1/1 ... [2024-10-08 20:20:52.990451]
2024-10-08T20:20:52.9914421Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:20:52.9916645Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_examples.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:20:52.990919]
2024-10-08T20:21:51.2971718Z 
2024-10-08T20:21:51.2974690Z distributed/tensor/parallel/test_tp_examples 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_4224de170011c592_.log
2024-10-08T20:21:51.2993360Z Running 16 items in this shard: test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_loss_parallel, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_inference, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_False_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_True_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_float64_thaw_all, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_all, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_layers_0_attention_wv__layers_0_feed_forward_w1__layers_1_feed_forward_w2__layers_1_ffn_norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_layers_1_ffn_norm__norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_norm__output, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_norm__output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_req_grad_seq_parallel_float32_thaw_output__tok_embeddings, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_False_float32, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_False_float64, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_True_float32, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_True_float64, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_weight_tying
2024-10-08T20:21:51.3007727Z 
2024-10-08T20:21:51.3008327Z Running distributed/_tensor/test_embedding_ops 1/1 ... [2024-10-08 20:21:51.297421]
2024-10-08T20:21:51.3009008Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:21:51.3010933Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_embedding_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:21:51.297943]
2024-10-08T20:22:08.7663490Z 
2024-10-08T20:22:08.7665740Z distributed/_tensor/test_embedding_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_embedding_ops_1.1_56f5ca79c9adf99f_.log
2024-10-08T20:22:08.7670072Z Running 4 items in this shard: test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_multiple_embeddings_rowwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise_max_norm_errors, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_rowwise
2024-10-08T20:22:08.7672653Z 
2024-10-08T20:22:08.7673199Z Running distributed/checkpoint/test_dedup_tensors 1/1 ... [2024-10-08 20:22:08.766965]
2024-10-08T20:22:08.7673940Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:22:08.7677262Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dedup_tensors.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:22:08.767432]
2024-10-08T20:22:11.9933133Z 
2024-10-08T20:22:11.9935145Z distributed/checkpoint/test_dedup_tensors 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_717cf2dfb4f988cd_.log
2024-10-08T20:22:11.9937062Z Running 1 items in this shard: test/distributed/checkpoint/test_dedup_tensors.py::TestDedupTensor::test_dedup_shards
2024-10-08T20:22:11.9937828Z 
2024-10-08T20:22:11.9941526Z Running distributed/_tensor/test_tensor_ops 1/1 ... [2024-10-08 20:22:11.993857]
2024-10-08T20:22:11.9942669Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:22:11.9948746Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:22:11.994435]
2024-10-08T20:23:46.5534782Z 
2024-10-08T20:23:46.5536889Z distributed/_tensor/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_tensor_ops_1.1_9b1ef687ca9c6974_.log
2024-10-08T20:23:46.5549963Z Running 25 items in this shard: test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_aten_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_clone, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_detach, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_dtensor_dtype_conversion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_empty_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_equal, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_full_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_gather, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_index, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_inplace_op, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_empty_strided, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_full, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_op_out_variant, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_scatter, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_slice, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_stack, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_where_type_promotion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zero_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like_partial_sum
2024-10-08T20:23:46.5562907Z 
2024-10-08T20:23:46.5563957Z Running distributed/_tensor/experimental/test_register_sharding 1/1 ... [2024-10-08 20:23:46.554589]
2024-10-08T20:23:46.5564846Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:23:46.5567123Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_register_sharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:23:46.555090]
2024-10-08T20:23:56.8987350Z 
2024-10-08T20:23:56.8990164Z distributed/_tensor/experimental/test_register_sharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_b9a19624aef61b9b_.log
2024-10-08T20:23:56.8992830Z Running 2 items in this shard: test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_argmax, test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_softmax_fwd
2024-10-08T20:23:56.8994349Z 
2024-10-08T20:23:56.8999107Z Running distributed/_tensor/test_experimental_ops 1/1 ... [2024-10-08 20:23:56.899584]
2024-10-08T20:23:56.8999823Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:23:56.9004862Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_experimental_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:23:56.900146]
2024-10-08T20:24:09.6403711Z 
2024-10-08T20:24:09.6406065Z distributed/_tensor/test_experimental_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_experimental_ops_1.1_64a4edc6098e5717_.log
2024-10-08T20:24:09.6409336Z Running 3 items in this shard: test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_bernoulli, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_nll, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_slice
2024-10-08T20:24:09.6411376Z 
2024-10-08T20:24:09.6412218Z Running distributed/_tensor/test_redistribute 1/1 ... [2024-10-08 20:24:09.640969]
2024-10-08T20:24:09.6413003Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:24:09.6417781Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_redistribute.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:24:09.641476]
2024-10-08T20:25:01.3251684Z 
2024-10-08T20:25:01.3253633Z distributed/_tensor/test_redistribute 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_redistribute_1.1_654c9507853cbe25_.log
2024-10-08T20:25:01.3264174Z Running 13 items in this shard: test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_shard, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_negative_shard_dim, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_shard_dim_change, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_uneven_sharding, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_local_partial_grad, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_partial, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_shard_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_dim_alltoall, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_multi_dim_mesh, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_redistribute_shard_dim_multi_dim_mesh
2024-10-08T20:25:01.3272228Z 
2024-10-08T20:25:01.3272699Z Running distributed/_tensor/test_init 1/1 ... [2024-10-08 20:25:01.326802]
2024-10-08T20:25:01.3273350Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:25:01.3275712Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:25:01.327270]
2024-10-08T20:25:27.8546873Z 
2024-10-08T20:25:27.8548987Z distributed/_tensor/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_init_1.1_5ede6bac2995f9b5_.log
2024-10-08T20:25:27.8553766Z Running 7 items in this shard: test/distributed/_tensor/test_init.py::DTensorInitOpsTest::test_init_ops, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_empty, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_full, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_ones, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_full_mesh, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_submesh
2024-10-08T20:25:27.8557348Z 
2024-10-08T20:25:27.8558048Z Running distributed/_tensor/experimental/test_tp_transform 1/1 ... [2024-10-08 20:25:27.855207]
2024-10-08T20:25:27.8558929Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:25:27.8561182Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_tp_transform.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:25:27.855695]
2024-10-08T20:25:42.9570290Z 
2024-10-08T20:25:42.9572791Z distributed/_tensor/experimental/test_tp_transform 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_tp_transform_1.1_bf64847ebd557f52_.log
2024-10-08T20:25:42.9576153Z Running 3 items in this shard: test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_e2e, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_no_bias, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_with_uncovered_op
2024-10-08T20:25:42.9578539Z 
2024-10-08T20:25:42.9578963Z Running distributed/_tensor/test_api 1/1 ... [2024-10-08 20:25:42.957615]
2024-10-08T20:25:42.9579601Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:25:42.9584549Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:25:42.958135]
2024-10-08T20:26:12.6931099Z 
2024-10-08T20:26:12.6933444Z distributed/_tensor/test_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_api_1.1_8955a434bb83a3f8_.log
2024-10-08T20:26:12.6940601Z Running 8 items in this shard: test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_casting, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn_warning, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_meta, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_errors, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_uneven_sharding
2024-10-08T20:26:12.6945146Z 
2024-10-08T20:26:12.6945868Z Running distributed/checkpoint/test_dtensor_resharding 1/1 ... [2024-10-08 20:26:12.693878]
2024-10-08T20:26:12.6946706Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:26:12.6948691Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_resharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:26:12.694410]
2024-10-08T20:26:32.6599453Z 
2024-10-08T20:26:32.6602533Z distributed/checkpoint/test_dtensor_resharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_5f0e5f3da71350b9_.log
2024-10-08T20:26:32.6611359Z Running 5 items in this shard: test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_1d_to_1d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_2d_to_2d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_1d_to_2d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_2d_to_1d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_dtensor_checkpoint_resharding_with_empty_shard
2024-10-08T20:26:32.6618347Z 
2024-10-08T20:26:32.6619148Z Running distributed/_tensor/test_random_ops 1/1 ... [2024-10-08 20:26:32.660442]
2024-10-08T20:26:32.6620230Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:26:32.6623109Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_random_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:26:32.661126]
2024-10-08T20:26:58.9406028Z 
2024-10-08T20:26:58.9408033Z distributed/_tensor/test_random_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_random_ops_1.1_209a8a636636303a_.log
2024-10-08T20:26:58.9413313Z Running 7 items in this shard: test/distributed/_tensor/test_random_ops.py::DistTensorRandomInitTest::test_init_ops, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_dropout_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_rand_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_uniform_2d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_manual_seed, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_meta_tensor_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_rng_tracker_init
2024-10-08T20:26:58.9417390Z 
2024-10-08T20:26:58.9418005Z Running distributed/_tools/test_mod_tracker 1/1 ... [2024-10-08 20:26:58.941173]
2024-10-08T20:26:58.9418916Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:26:58.9420796Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_mod_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:26:58.941699]
2024-10-08T20:27:02.3180507Z 
2024-10-08T20:27:02.3182554Z distributed/_tools/test_mod_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mod_tracker_1.1_a08fc9be0eda4f47_.log
2024-10-08T20:27:02.3185949Z Running 4 items in this shard: test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_ac, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_bw_detection, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_module_hierarchy, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_user_hooks
2024-10-08T20:27:02.3188413Z 
2024-10-08T20:27:02.3189284Z Running distributed/_tensor/debug/test_comm_mode_features 1/1 ... [2024-10-08 20:27:02.318478]
2024-10-08T20:27:02.3190058Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:27:02.3193838Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode_features.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:27:02.319019]
2024-10-08T20:27:19.0760351Z 
2024-10-08T20:27:19.0763175Z distributed/_tensor/debug/test_comm_mode_features 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_84c3b4bf95ebaa5d_.log
2024-10-08T20:27:19.0767922Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLPStacked_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_module_tracing, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_transformer_module_tracing
2024-10-08T20:27:19.0771279Z 
2024-10-08T20:27:19.0772000Z Running distributed/_tensor/test_convolution_ops 1/1 ... [2024-10-08 20:27:19.076540]
2024-10-08T20:27:19.0772809Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:27:19.0774753Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_convolution_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:27:19.077032]
2024-10-08T20:27:46.0584144Z 
2024-10-08T20:27:46.0586885Z distributed/_tensor/test_convolution_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_convolution_ops_1.1_e2151f48303494f8_.log
2024-10-08T20:27:46.0589556Z Running 2 items in this shard: test/distributed/_tensor/test_convolution_ops.py::DistConvolutionOpsTest::test_depthwise_convolution, test/distributed/_tensor/test_convolution_ops.py::DistConvolutionOpsTest::test_downsampling_convolution
2024-10-08T20:27:46.0591008Z 
2024-10-08T20:27:46.0597065Z Running distributed/_tensor/experimental/test_local_map 1/1 ... [2024-10-08 20:27:46.059396]
2024-10-08T20:27:46.0597914Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:27:46.0604532Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_local_map.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:27:46.060109]
2024-10-08T20:28:02.2095928Z 
2024-10-08T20:28:02.2098117Z distributed/_tensor/experimental/test_local_map 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_local_map_1.1_06a31230a89c1c98_.log
2024-10-08T20:28:02.2102169Z Running 4 items in this shard: test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_correctness, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_in_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_out_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_redistribute
2024-10-08T20:28:02.2104771Z 
2024-10-08T20:28:02.2105267Z Running distributed/_tensor/test_math_ops 1/1 ... [2024-10-08 20:28:02.210045]
2024-10-08T20:28:02.2105998Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:28:02.2108731Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_math_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:28:02.210506]
2024-10-08T20:28:59.4147400Z 
2024-10-08T20:28:59.4149600Z distributed/_tensor/test_math_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_math_ops_1.1_fddb3806e368da1c_.log
2024-10-08T20:28:59.4157520Z Running 14 items in this shard: test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_foreach_norm, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd_req_grad, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linalg_eigh, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linear_op_reductions, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_mean, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_nll_loss_and_cross_entropy, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard0_svd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard_math_ops, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_with_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_topk, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_upsampling
2024-10-08T20:28:59.4164712Z 
2024-10-08T20:28:59.4165216Z Running distributed/_tensor/test_matrix_ops 1/1 ... [2024-10-08 20:28:59.415467]
2024-10-08T20:28:59.4165886Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:28:59.4167781Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_matrix_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:28:59.415982]
2024-10-08T20:29:32.8228468Z 
2024-10-08T20:29:32.8231091Z distributed/_tensor/test_matrix_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_matrix_ops_1.1_d7a31da06d38a311_.log
2024-10-08T20:29:32.8240691Z Running 9 items in this shard: test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_auto_redistribute, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_empty_operand, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_baddbmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_bmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_mm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_scaled_dot_product_attention, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t_partial
2024-10-08T20:29:32.8247996Z 
2024-10-08T20:29:32.8248874Z Running distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 ... [2024-10-08 20:29:32.823714]
2024-10-08T20:29:32.8249970Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:29:32.8252958Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:29:32.824348]
2024-10-08T20:30:26.0172575Z 
2024-10-08T20:30:26.0174875Z distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_dtensor_state_dict_1.1_b6ca11434c749e61_.log
2024-10-08T20:30:26.0191508Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_False_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_False_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_True_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_True_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_False_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_False_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_True_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_True_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_False_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_False_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_True_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_True_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_fsdp_init_with_device_mesh_is_even_sharded_model_False, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_fsdp_init_with_device_mesh_is_even_sharded_model_True, test/distributed/fsdp/test_fsdp_dtensor_state_dict.py::TestFSDPWithDeviceMeshAndDTensor::test_raises_warning_or_errors
2024-10-08T20:30:26.0206287Z 
2024-10-08T20:30:26.0206864Z Running distributed/checkpoint/e2e/test_fsdp_ep 1/1 ... [2024-10-08 20:30:26.017659]
2024-10-08T20:30:26.0207585Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:26.0209504Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fsdp_ep.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:26.018146]
2024-10-08T20:30:29.3443568Z 
2024-10-08T20:30:29.3445498Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_2c60db45a1070353_.log
2024-10-08T20:30:29.3447309Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fsdp_ep.py::TestFSDPWithEP::test_e2e
2024-10-08T20:30:29.3448024Z 
2024-10-08T20:30:29.3451346Z Running distributed/_composable/test_contract 1/1 ... [2024-10-08 20:30:29.344890]
2024-10-08T20:30:29.3452133Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:29.3457203Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_contract.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:29.345402]
2024-10-08T20:30:32.6241255Z 
2024-10-08T20:30:32.6243324Z distributed/_composable/test_contract 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_contract_1.1_0c4fb2b9f0e24eb1_.log
2024-10-08T20:30:32.6247351Z Running 5 items in this shard: test/distributed/_composable/test_contract.py::TestContract::test_add_hooks, test/distributed/_composable/test_contract.py::TestContract::test_modify_fqn, test/distributed/_composable/test_contract.py::TestContract::test_multi_module_api, test/distributed/_composable/test_contract.py::TestContract::test_registry, test/distributed/_composable/test_contract.py::TestContract::test_state
2024-10-08T20:30:32.6249977Z 
2024-10-08T20:30:32.6250461Z Running distributed/_tools/test_mem_tracker 1/1 ... [2024-10-08 20:30:32.624653]
2024-10-08T20:30:32.6251135Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:32.6254724Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:32.625122]
2024-10-08T20:30:35.9534269Z 
2024-10-08T20:30:35.9536986Z distributed/_tools/test_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mem_tracker_1.1_24c86bdfbfe00902_.log
2024-10-08T20:30:35.9542461Z Running 3 items in this shard: test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_cuda_tracker_equivalence, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_attribution, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_with_activation_checkpointing
2024-10-08T20:30:35.9545666Z 
2024-10-08T20:30:35.9546559Z Running distributed/checkpoint/test_save_load_api 1/1 ... [2024-10-08 20:30:35.954257]
2024-10-08T20:30:35.9547795Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:35.9553756Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_save_load_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:35.954908]
2024-10-08T20:30:42.3870673Z 
2024-10-08T20:30:42.3872873Z distributed/checkpoint/test_save_load_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_save_load_api_1.1_9a276b20f29f1294_.log
2024-10-08T20:30:42.3874915Z Running 1 items in this shard: test/distributed/checkpoint/test_save_load_api.py::TestSaveAndLoadAPI::test_auto_detect
2024-10-08T20:30:42.3875888Z 
2024-10-08T20:30:42.3876349Z Running distributed/pipelining/test_pipe 1/1 ... [2024-10-08 20:30:42.387355]
2024-10-08T20:30:42.3877110Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:42.3881647Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_pipe.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:42.387819]
2024-10-08T20:30:46.4650904Z 
2024-10-08T20:30:46.4653096Z distributed/pipelining/test_pipe 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_pipe_1.1_208d0e514afda35d_.log
2024-10-08T20:30:46.4655802Z Running 3 items in this shard: test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass0, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass1, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass2
2024-10-08T20:30:46.4657766Z 
2024-10-08T20:30:46.4658641Z Running distributed/test_c10d_functional_native 1/1 ... [2024-10-08 20:30:46.465590]
2024-10-08T20:30:46.4659439Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:46.4664316Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_functional_native.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:46.466088]
2024-10-08T20:30:49.6922072Z 
2024-10-08T20:30:49.6924957Z distributed/test_c10d_functional_native 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_functional_native_1.1_59a257b2bd2d78c3_.log
2024-10-08T20:30:49.6949365Z Running 26 items in this shard: test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_to_all_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_broadcast, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_inductor_dtypeview_memory_leak, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_py_work, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_threading, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_unwaited, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_non_contig_input, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_to_all_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_broadcast, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_inplace_op_on_view, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reuse_buffer_after_inplace_collective, test/distributed/test_c10d_functional_native.py::CompileTest::test_ranks_and_tag
2024-10-08T20:30:49.6970891Z 
2024-10-08T20:30:49.6971777Z Running distributed/fsdp/test_fsdp_fx 1/1 ... [2024-10-08 20:30:49.693060]
2024-10-08T20:30:49.6972919Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:49.6975692Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fx.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:49.693684]
2024-10-08T20:30:53.0212589Z 
2024-10-08T20:30:53.0214792Z distributed/fsdp/test_fsdp_fx 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_6015929831e677ef_.log
2024-10-08T20:30:53.0216555Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_fx.py::TestSymbolicTracing::test_symbolic_tracing_outputs
2024-10-08T20:30:53.0217342Z 
2024-10-08T20:30:53.0220342Z Running distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 ... [2024-10-08 20:30:53.021735]
2024-10-08T20:30:53.0221377Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:53.0225500Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:53.022187]
2024-10-08T20:30:56.0978979Z 
2024-10-08T20:30:56.0981358Z distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_tensor_ops_1.1_bd90584a6cf58d44_.log
2024-10-08T20:30:56.0986031Z Running 5 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_clone, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_deep_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_detach, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_inplace_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_set_requires_grad
2024-10-08T20:30:56.0989501Z 
2024-10-08T20:30:56.0990147Z Running distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 ... [2024-10-08 20:30:56.098223]
2024-10-08T20:30:56.0991209Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:56.0993214Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_binary_cmp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:56.098716]
2024-10-08T20:30:59.1743729Z 
2024-10-08T20:30:59.1745988Z distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_4fa950eca7840859_.log
2024-10-08T20:30:59.1750298Z Running 4 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose_tensor_specs, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal_tensor_specs
2024-10-08T20:30:59.1753587Z 
2024-10-08T20:30:59.1754284Z Running distributed/checkpoint/test_fsdp_optim_state 1/1 ... [2024-10-08 20:30:59.174857]
2024-10-08T20:30:59.1755100Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:30:59.1757059Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:30:59.175311]
2024-10-08T20:31:09.0669244Z 
2024-10-08T20:31:09.0672671Z distributed/checkpoint/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_36bf166802c47c16_.log
2024-10-08T20:31:09.0677861Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_False, test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_True
2024-10-08T20:31:09.0681017Z 
2024-10-08T20:31:09.0681989Z Running distributed/_shard/sharded_tensor/ops/test_init 1/1 ... [2024-10-08 20:31:09.067428]
2024-10-08T20:31:09.0683308Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:09.0686664Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:09.068063]
2024-10-08T20:31:12.1443879Z 
2024-10-08T20:31:12.1445810Z distributed/_shard/sharded_tensor/ops/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_dcb0a5e1a9bd40dc_.log
2024-10-08T20:31:12.1449383Z Running 3 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_kaiming_uniform, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_normal, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_uniform
2024-10-08T20:31:12.1451840Z 
2024-10-08T20:31:12.1452383Z Running distributed/test_data_parallel 1/1 ... [2024-10-08 20:31:12.144845]
2024-10-08T20:31:12.1453053Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:12.1456548Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_data_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:12.145332]
2024-10-08T20:31:15.5716409Z 
2024-10-08T20:31:15.5718448Z distributed/test_data_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_data_parallel_1.1_eb43ce41334a5aae_.log
2024-10-08T20:31:15.5746934Z Running 46 items in this shard: test/distributed/test_data_parallel.py::TestDataParallel::test_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_buffers_requiring_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_complex, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_device_args, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_function_deletion, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_lazy_linear, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_device, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_no_refcycles, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_module_zero_inputs, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_multiple_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_output, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_no_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_rnn, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_small_back, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_sparse, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_different_len_dicts, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_passes_exception, test/distributed/test_data_parallel.py::TestDataParallel::test_parameter_list_dict_replica, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate_buffers, test/distributed/test_data_parallel.py::TestDataParallel::test_save_replica_module, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_strided_grad_layout, test/distributed/test_data_parallel.py::TestDataParallel::test_zero_grad, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float64
2024-10-08T20:31:15.5773153Z 
2024-10-08T20:31:15.5773831Z Running distributed/_composable/fsdp/test_fully_shard_state 1/1 ... [2024-10-08 20:31:15.572230]
2024-10-08T20:31:15.5774605Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:15.5776616Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:15.572736]
2024-10-08T20:31:18.7991781Z 
2024-10-08T20:31:18.7994034Z distributed/_composable/fsdp/test_fully_shard_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_e13eb09289f43181_.log
2024-10-08T20:31:18.7998639Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_cls, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_deepcopy, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_reapply, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_state, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_unsupported_module_cls
2024-10-08T20:31:18.8002004Z 
2024-10-08T20:31:18.8002764Z Running distributed/_shard/sharded_tensor/ops/test_embedding 1/1 ... [2024-10-08 20:31:18.799710]
2024-10-08T20:31:18.8003579Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:18.8005838Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:18.800185]
2024-10-08T20:31:21.8761924Z 
2024-10-08T20:31:21.8764224Z distributed/_shard/sharded_tensor/ops/test_embedding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_1.1_29627d8e7267b742_.log
2024-10-08T20:31:21.8767040Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_rowwise
2024-10-08T20:31:21.8769080Z 
2024-10-08T20:31:21.8769684Z Running distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 ... [2024-10-08 20:31:21.876669]
2024-10-08T20:31:21.8770480Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:21.8775058Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding_bag.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:21.877161]
2024-10-08T20:31:25.0031539Z 
2024-10-08T20:31:25.0033673Z distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_bag_1.1_12b4df839146b52d_.log
2024-10-08T20:31:25.0036911Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_rowwise
2024-10-08T20:31:25.0038693Z 
2024-10-08T20:31:25.0039775Z Running distributed/pipelining/test_microbatch 1/1 ... [2024-10-08 20:31:25.003680]
2024-10-08T20:31:25.0040482Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:25.0056639Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_microbatch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:25.004198]
2024-10-08T20:31:28.6309506Z 
2024-10-08T20:31:28.6311564Z distributed/pipelining/test_microbatch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_microbatch_1.1_7607654d8d18a8c0_.log
2024-10-08T20:31:28.6313880Z Running 2 items in this shard: test/distributed/pipelining/test_microbatch.py::MicrobatchTests::test_chunk_spec, test/distributed/pipelining/test_microbatch.py::MicrobatchTests::test_split_and_merge
2024-10-08T20:31:28.6315135Z 
2024-10-08T20:31:28.6317400Z Running distributed/rpc/cuda/test_tensorpipe_agent 1/1 ... [2024-10-08 20:31:28.631501]
2024-10-08T20:31:28.6318142Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:31:28.6323707Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/cuda/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:31:28.631970]
2024-10-08T20:43:43.6879041Z 
2024-10-08T20:43:43.6882132Z distributed/rpc/cuda/test_tensorpipe_agent 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_f31772ee159d7dbe_.log
2024-10-08T20:43:43.7007694Z Running 99 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams, test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations
2024-10-08T20:43:43.7082599Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRpcTest::test_profiler_remote_cuda
2024-10-08T20:43:43.7084164Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_simple
2024-10-08T20:43:43.7085903Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation
2024-10-08T20:43:43.7087662Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDistAutogradTest::test_gpu_to_cpu_continuation_gpu_root
2024-10-08T20:43:43.7089746Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device
2024-10-08T20:43:43.7091495Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_input_moved_to_cuda_device_script
2024-10-08T20:43:43.7093284Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_invalid_devices
2024-10-08T20:43:43.7094865Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaRemoteModuleTest::test_valid_device
2024-10-08T20:43:43.7096593Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeCudaDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote_gpu
2024-10-08T20:43:43.7098513Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_nested_with_cuda_future
2024-10-08T20:43:43.7100570Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_async_execution_with_cuda_future
2024-10-08T20:43:43.7102471Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_callback_changes_devices
2024-10-08T20:43:43.7104427Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_sparse_tensor
2024-10-08T20:43:43.7106380Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_cuda_tensor
2024-10-08T20:43:43.7108431Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_sparse_tensor
2024-10-08T20:43:43.7110574Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_custom_class_with_cuda_tensor
2024-10-08T20:43:43.7112646Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_sparse_tensor
2024-10-08T20:43:43.7114698Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_can_extract_list_with_cuda_tensor
2024-10-08T20:43:43.7116624Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_device
2024-10-08T20:43:43.7118447Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_int
2024-10-08T20:43:43.7120258Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_as_str
2024-10-08T20:43:43.7122070Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_device_not_cuda
2024-10-08T20:43:43.7123909Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_modify_tensor_inplace
2024-10-08T20:43:43.7125760Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_replace_tensor
2024-10-08T20:43:43.7127691Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_cuda_future_value_on_bad_device
2024-10-08T20:43:43.7129468Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream
2024-10-08T20:43:43.7131199Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_multi
2024-10-08T20:43:43.7133028Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested
2024-10-08T20:43:43.7134816Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_custom_stream_nested_multi
2024-10-08T20:43:43.7136576Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu
2024-10-08T20:43:43.7138348Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_default
2024-10-08T20:43:43.7140219Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_cpu_to_gpu_non_default
2024-10-08T20:43:43.7142121Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default
2024-10-08T20:43:43.7143952Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_default_to_non_default
2024-10-08T20:43:43.7145798Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_1
2024-10-08T20:43:43.7147575Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_2
2024-10-08T20:43:43.7149345Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_3
2024-10-08T20:43:43.7151127Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_4
2024-10-08T20:43:43.7152883Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_5
2024-10-08T20:43:43.7154643Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_6
2024-10-08T20:43:43.7156415Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_7
2024-10-08T20:43:43.7158195Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_8
2024-10-08T20:43:43.7159997Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_1
2024-10-08T20:43:43.7161815Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_2
2024-10-08T20:43:43.7163632Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_3
2024-10-08T20:43:43.7165453Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_4
2024-10-08T20:43:43.7167326Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_5
2024-10-08T20:43:43.7169143Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_6
2024-10-08T20:43:43.7170957Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_7
2024-10-08T20:43:43.7172829Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_mixed_self_8
2024-10-08T20:43:43.7174647Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default
2024-10-08T20:43:43.7176529Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_non_default_to_default
2024-10-08T20:43:43.7178422Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_default
2024-10-08T20:43:43.7180283Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_map_gpu_to_cpu_non_default
2024-10-08T20:43:43.7182124Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_gpu
2024-10-08T20:43:43.7183861Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_in_options
2024-10-08T20:43:43.7185705Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_local_device
2024-10-08T20:43:43.7187630Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_max_remote_device
2024-10-08T20:43:43.7189801Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_invalid_min_device
2024-10-08T20:43:43.7191627Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_many_to_one
2024-10-08T20:43:43.7193420Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config
2024-10-08T20:43:43.7195262Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_loop
2024-10-08T20:43:43.7197166Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_not_timeout
2024-10-08T20:43:43.7199078Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote
2024-10-08T20:43:43.7201019Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_remote_response
2024-10-08T20:43:43.7202957Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response
2024-10-08T20:43:43.7204891Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_missing_config_response_loop
2024-10-08T20:43:43.7206742Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu
2024-10-08T20:43:43.7208656Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_multi_gpu_self
2024-10-08T20:43:43.7210463Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_one_to_many
2024-10-08T20:43:43.7212223Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_remote
2024-10-08T20:43:43.7214071Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu
2024-10-08T20:43:43.7215902Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_return_to_gpu_self
2024-10-08T20:43:43.7217754Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_maps_wrong_worker_name
2024-10-08T20:43:43.7219533Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_device_mismatch
2024-10-08T20:43:43.7221277Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch
2024-10-08T20:43:43.7223091Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_devices_option_mismatch_reverse
2024-10-08T20:43:43.7225569Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization1
2024-10-08T20:43:43.7227484Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization2
2024-10-08T20:43:43.7229391Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization3
2024-10-08T20:43:43.7231295Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_owner_rref_forward_synchronization4
2024-10-08T20:43:43.7233161Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization1
2024-10-08T20:43:43.7234991Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization2
2024-10-08T20:43:43.7236822Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization3
2024-10-08T20:43:43.7238650Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization4
2024-10-08T20:43:43.7240485Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_as_arg_synchronization5
2024-10-08T20:43:43.7242336Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization1
2024-10-08T20:43:43.7244175Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization2
2024-10-08T20:43:43.7246029Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization3
2024-10-08T20:43:43.7247873Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_forward_synchronization4
2024-10-08T20:43:43.7249729Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization1
2024-10-08T20:43:43.7251674Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization2
2024-10-08T20:43:43.7253671Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization3
2024-10-08T20:43:43.7255505Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_to_here_synchronization4
2024-10-08T20:43:43.7257371Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_rref_with_unpickleable_attributes
2024-10-08T20:43:43.7259228Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentCudaRpcTest::test_tensor_view_as_return_value
2024-10-08T20:43:43.7261081Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_device_maps_backward_pass
2024-10-08T20:43:43.7262952Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_dist_autograd_sync_streams
2024-10-08T20:43:43.7264827Z Running 1 items in this shard: test/distributed/rpc/cuda/test_tensorpipe_agent.py::TensorPipeTensorPipeCudaDistAutogradTest::test_gradients_synchronizations
2024-10-08T20:43:43.7265918Z 
2024-10-08T20:43:43.7266670Z Running distributed/_composable/fsdp/test_fully_shard_logging 1/1 ... [2024-10-08 20:43:43.693707]
2024-10-08T20:43:43.7267443Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:43:43.7269439Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_logging.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:43:43.694306]
2024-10-08T20:43:46.8216509Z 
2024-10-08T20:43:46.8219825Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_129d189c9c2b358d_.log
2024-10-08T20:43:46.8222572Z Running 0 items in this shard:
2024-10-08T20:43:46.8223083Z 
2024-10-08T20:43:46.8227302Z Running distributed/rpc/test_tensorpipe_agent 2/4 ... [2024-10-08 20:43:46.822450]
2024-10-08T20:43:46.8228021Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T20:43:46.8233310Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=2', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 20:43:46.822965]
2024-10-08T21:00:20.7112153Z 
2024-10-08T21:00:20.7114194Z distributed/rpc/test_tensorpipe_agent 2/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_f53706c9710425f2_.log
2024-10-08T21:00:20.7217653Z Running 122 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse
2024-10-08T21:00:20.7290017Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add
2024-10-08T21:00:20.7291506Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote
2024-10-08T21:00:20.7293154Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async
2024-10-08T21:00:20.7294715Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote
2024-10-08T21:00:20.7296364Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_async
2024-10-08T21:00:20.7297829Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote
2024-10-08T21:00:20.7299378Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async
2024-10-08T21:00:20.7300877Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method
2024-10-08T21:00:20.7302304Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote
2024-10-08T21:00:20.7303725Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self
2024-10-08T21:00:20.7305066Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_simple
2024-10-08T21:00:20.7306518Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options
2024-10-08T21:00:20.7307983Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used
2024-10-08T21:00:20.7309426Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name
2024-10-08T21:00:20.7310742Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src
2024-10-08T21:00:20.7312032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done
2024-10-08T21:00:20.7313388Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_done_exception
2024-10-08T21:00:20.7314766Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_get_worker_infos
2024-10-08T21:00:20.7316121Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc
2024-10-08T21:00:20.7317452Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names
2024-10-08T21:00:20.7318764Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown
2024-10-08T21:00:20.7320145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_builtin_remote_ret
2024-10-08T21:00:20.7321505Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc
2024-10-08T21:00:20.7322825Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress
2024-10-08T21:00:20.7324186Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_rref_backward
2024-10-08T21:00:20.7325564Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init
2024-10-08T21:00:20.7326907Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future
2024-10-08T21:00:20.7328275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace
2024-10-08T21:00:20.7329739Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled
2024-10-08T21:00:20.7331168Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory
2024-10-08T21:00:20.7332662Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes
2024-10-08T21:00:20.7334325Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded
2024-10-08T21:00:20.7336012Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin_single_threaded
2024-10-08T21:00:20.7337587Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf
2024-10-08T21:00:20.7339134Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded
2024-10-08T21:00:20.7340596Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in
2024-10-08T21:00:20.7341917Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method
2024-10-08T21:00:20.7343291Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception
2024-10-08T21:00:20.7344679Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_nested_pickle
2024-10-08T21:00:20.7346038Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result
2024-10-08T21:00:20.7347483Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func
2024-10-08T21:00:20.7348834Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args
2024-10-08T21:00:20.7350197Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container
2024-10-08T21:00:20.7351648Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call
2024-10-08T21:00:20.7352992Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_reinit
2024-10-08T21:00:20.7354271Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future
2024-10-08T21:00:20.7355621Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async
2024-10-08T21:00:20.7357019Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote
2024-10-08T21:00:20.7358413Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs
2024-10-08T21:00:20.7359823Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function
2024-10-08T21:00:20.7361393Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded
2024-10-08T21:00:20.7362872Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts
2024-10-08T21:00:20.7364272Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported
2024-10-08T21:00:20.7365734Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking
2024-10-08T21:00:20.7367286Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking
2024-10-08T21:00:20.7368676Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_scalar_add
2024-10-08T21:00:20.7369961Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_add
2024-10-08T21:00:20.7371372Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg
2024-10-08T21:00:20.7372960Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_send_to_rank
2024-10-08T21:00:20.7374374Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler
2024-10-08T21:00:20.7375877Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout
2024-10-08T21:00:20.7377315Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc
2024-10-08T21:00:20.7378662Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc
2024-10-08T21:00:20.7380009Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward
2024-10-08T21:00:20.7381423Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_user_func
2024-10-08T21:00:20.7382810Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout
2024-10-08T21:00:20.7384188Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_dense
2024-10-08T21:00:20.7385684Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout
2024-10-08T21:00:20.7387202Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf
2024-10-08T21:00:20.7389097Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors
2024-10-08T21:00:20.7390637Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref
2024-10-08T21:00:20.7392138Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors
2024-10-08T21:00:20.7393619Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info
2024-10-08T21:00:20.7395104Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_dist_autograd_profiling
2024-10-08T21:00:20.7396653Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call
2024-10-08T21:00:20.7398218Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_remote_call
2024-10-08T21:00:20.7399831Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors
2024-10-08T21:00:20.7401364Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_context
2024-10-08T21:00:20.7402983Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote
2024-10-08T21:00:20.7404625Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args
2024-10-08T21:00:20.7406206Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions
2024-10-08T21:00:20.7407737Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim
2024-10-08T21:00:20.7409263Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote
2024-10-08T21:00:20.7410910Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf
2024-10-08T21:00:20.7412410Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults
2024-10-08T21:00:20.7414127Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_jit_end_callbacks_with_fork
2024-10-08T21:00:20.7415777Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async
2024-10-08T21:00:20.7417283Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf
2024-10-08T21:00:20.7418711Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled
2024-10-08T21:00:20.7420163Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_as_arg_and_return
2024-10-08T21:00:20.7421573Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner
2024-10-08T21:00:20.7422998Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported
2024-10-08T21:00:20.7425022Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate
2024-10-08T21:00:20.7426400Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value
2024-10-08T21:00:20.7427895Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_functions_not_supported
2024-10-08T21:00:20.7429404Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed
2024-10-08T21:00:20.7430868Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_dist_backward
2024-10-08T21:00:20.7432409Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_jit_fork_within_context
2024-10-08T21:00:20.7433926Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync
2024-10-08T21:00:20.7435380Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref
2024-10-08T21:00:20.7436959Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported
2024-10-08T21:00:20.7438839Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire_script_not_supported
2024-10-08T21:00:20.7440681Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside
2024-10-08T21:00:20.7442402Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs
2024-10-08T21:00:20.7444096Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_no_ddp
2024-10-08T21:00:20.7445784Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together
2024-10-08T21:00:20.7447471Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc
2024-10-08T21:00:20.7449152Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_init_rpc_without_rank
2024-10-08T21:00:20.7450892Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args
2024-10-08T21:00:20.7452608Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rpc_rref_args_sparse
2024-10-08T21:00:20.7454240Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_sparse
2024-10-08T21:00:20.7455895Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container
2024-10-08T21:00:20.7457634Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse
2024-10-08T21:00:20.7459370Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_set_and_get_num_worker_threads
2024-10-08T21:00:20.7461146Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse
2024-10-08T21:00:20.7462963Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_self_sparse
2024-10-08T21:00:20.7464899Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse
2024-10-08T21:00:20.7466774Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_call_sparse
2024-10-08T21:00:20.7468776Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse
2024-10-08T21:00:20.7470698Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse
2024-10-08T21:00:20.7472650Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_sparse
2024-10-08T21:00:20.7474535Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse
2024-10-08T21:00:20.7475504Z 
2024-10-08T21:00:20.7476124Z Running distributed/rpc/test_tensorpipe_agent 4/4 ... [2024-10-08 21:00:20.718470]
2024-10-08T21:00:20.7476810Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:00:20.7478798Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=4', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:00:20.719000]
2024-10-08T21:15:49.0544340Z 
2024-10-08T21:15:49.0546434Z distributed/rpc/test_tensorpipe_agent 4/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_a08159938d7e396b_.log
2024-10-08T21:15:49.0647558Z Running 112 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse
2024-10-08T21:15:49.0716308Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather
2024-10-08T21:15:49.0717676Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout
2024-10-08T21:15:49.0719051Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method
2024-10-08T21:15:49.0720469Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote
2024-10-08T21:15:49.0721964Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote
2024-10-08T21:15:49.0723447Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested
2024-10-08T21:15:49.0724895Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote
2024-10-08T21:15:49.0726337Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise
2024-10-08T21:15:49.0727954Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote
2024-10-08T21:15:49.0729546Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_remote
2024-10-08T21:15:49.0731186Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks
2024-10-08T21:15:49.0732823Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy
2024-10-08T21:15:49.0734276Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num
2024-10-08T21:15:49.0735703Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type
2024-10-08T21:15:49.0737131Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_function_not_on_callee
2024-10-08T21:15:49.0738626Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload
2024-10-08T21:15:49.0740137Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions
2024-10-08T21:15:49.0741634Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_twice
2024-10-08T21:15:49.0743029Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner
2024-10-08T21:15:49.0744414Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice
2024-10-08T21:15:49.0745735Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc
2024-10-08T21:15:49.0747033Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref
2024-10-08T21:15:49.0748360Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors
2024-10-08T21:15:49.0749696Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality
2024-10-08T21:15:49.0751024Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs
2024-10-08T21:15:49.0752523Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded
2024-10-08T21:15:49.0754090Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin
2024-10-08T21:15:49.0755593Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc
2024-10-08T21:15:49.0757186Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded
2024-10-08T21:15:49.0758783Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str
2024-10-08T21:15:49.0760214Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined
2024-10-08T21:15:49.0761544Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw
2024-10-08T21:15:49.0762903Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception
2024-10-08T21:15:49.0764275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all
2024-10-08T21:15:49.0765726Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded
2024-10-08T21:15:49.0767143Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset
2024-10-08T21:15:49.0768543Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_context_debug_info
2024-10-08T21:15:49.0769894Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak
2024-10-08T21:15:49.0771231Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self
2024-10-08T21:15:49.0772678Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse
2024-10-08T21:15:49.0774030Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor
2024-10-08T21:15:49.0775426Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self
2024-10-08T21:15:49.0776764Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str
2024-10-08T21:15:49.0778041Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout
2024-10-08T21:15:49.0779426Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking
2024-10-08T21:15:49.0780867Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg
2024-10-08T21:15:49.0782379Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg
2024-10-08T21:15:49.0783819Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors
2024-10-08T21:15:49.0785224Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_followed_by_rpc
2024-10-08T21:15:49.0786602Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler
2024-10-08T21:15:49.0787999Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rref_after_shutdown
2024-10-08T21:15:49.0789728Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python
2024-10-08T21:15:49.0791178Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call
2024-10-08T21:15:49.0792531Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id
2024-10-08T21:15:49.0793847Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_info_pickle
2024-10-08T21:15:49.0795392Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server
2024-10-08T21:15:49.0797097Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd
2024-10-08T21:15:49.0798611Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi
2024-10-08T21:15:49.0800100Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple
2024-10-08T21:15:49.0801576Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_self
2024-10-08T21:15:49.0803098Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc
2024-10-08T21:15:49.0804786Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors
2024-10-08T21:15:49.0806373Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value
2024-10-08T21:15:49.0807990Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself
2024-10-08T21:15:49.0809708Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward
2024-10-08T21:15:49.0821372Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded
2024-10-08T21:15:49.0823099Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_none_grads
2024-10-08T21:15:49.0824630Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote
2024-10-08T21:15:49.0826171Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order
2024-10-08T21:15:49.0827707Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw
2024-10-08T21:15:49.0829576Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported
2024-10-08T21:15:49.0831419Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_not_exists_remotely_from_script
2024-10-08T21:15:49.0833243Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script
2024-10-08T21:15:49.0834851Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_chain
2024-10-08T21:15:49.0836313Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote
2024-10-08T21:15:49.0837898Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit
2024-10-08T21:15:49.0839512Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified
2024-10-08T21:15:49.0841121Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref
2024-10-08T21:15:49.0842703Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function
2024-10-08T21:15:49.0844271Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception
2024-10-08T21:15:49.0845774Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_get_gradients
2024-10-08T21:15:49.0847270Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync_script
2024-10-08T21:15:49.0848782Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs
2024-10-08T21:15:49.0850454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script
2024-10-08T21:15:49.0852090Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters
2024-10-08T21:15:49.0853926Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_send_remote_module_over_the_wire
2024-10-08T21:15:49.0855658Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_inside
2024-10-08T21:15:49.0857303Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs
2024-10-08T21:15:49.0858973Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_local_vs_remote
2024-10-08T21:15:49.0860667Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads
2024-10-08T21:15:49.0862527Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda
2024-10-08T21:15:49.0864549Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank
2024-10-08T21:15:49.0866393Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_my_parameter_server_sparse
2024-10-08T21:15:49.0868112Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_remote_sparse
2024-10-08T21:15:49.0869713Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse
2024-10-08T21:15:49.0871342Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_stress_sparse
2024-10-08T21:15:49.0873043Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse
2024-10-08T21:15:49.0874709Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_proxy_timeout
2024-10-08T21:15:49.0876372Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout
2024-10-08T21:15:49.0878063Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse
2024-10-08T21:15:49.0879848Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse
2024-10-08T21:15:49.0881756Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_no_grad_on_tensor_sparse
2024-10-08T21:15:49.0883574Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse
2024-10-08T21:15:49.0885397Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse
2024-10-08T21:15:49.0887279Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse
2024-10-08T21:15:49.0889489Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse
2024-10-08T21:15:49.0891398Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse
2024-10-08T21:15:49.0893465Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse
2024-10-08T21:15:49.0895595Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse
2024-10-08T21:15:49.0897432Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse
2024-10-08T21:15:49.0899336Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_nested_backward_accumulate_grads_sparse
2024-10-08T21:15:49.0901167Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_trainer_ps_sparse
2024-10-08T21:15:49.0902109Z 
2024-10-08T21:15:49.0902730Z Running distributed/optim/test_named_optimizer 1/1 ... [2024-10-08 21:15:49.061723]
2024-10-08T21:15:49.0903430Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:15:49.0905371Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/optim/test_named_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:15:49.062228]
2024-10-08T21:15:51.8834173Z 
2024-10-08T21:15:51.8836218Z distributed/optim/test_named_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_named_optimizer_1.1_cd9b1e0742bdbba6_.log
2024-10-08T21:15:51.8837876Z 
2024-10-08T21:15:51.8841295Z Running distributed/_composable/test_compose 1/1 ... [2024-10-08 21:15:51.883899]
2024-10-08T21:15:51.8841990Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:15:51.8846652Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_compose.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:15:51.884339]
2024-10-08T21:16:23.2596887Z 
2024-10-08T21:16:23.2599988Z distributed/_composable/test_compose 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_compose_1.1_f9898f6b0b7488ea_.log
2024-10-08T21:16:23.2611700Z Running 9 items in this shard: test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_checkpoint_fsdp_submodules_non_reentrant, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_checkpoint_fsdp_submodules_with_param, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_checkpoint_fsdp_submodules_with_param_no_shard, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_checkpoint_fully_shard_cast_forward_inputs, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_composable_fsdp_replicate, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_fully_shard_replicate_composability, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_fully_shard_replicate_correct_replicate_params, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_state_dict_fsdp_submodules, test/distributed/_composable/test_compose.py::TestFSDPCheckpoint::test_wrap_same_submodule
2024-10-08T21:16:23.2620709Z 
2024-10-08T21:16:23.2621418Z Running distributed/test_nccl 1/1 ... [2024-10-08 21:16:23.260508]
2024-10-08T21:16:23.2622345Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:16:23.2624931Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:16:23.261141]
2024-10-08T21:16:26.4925871Z 
2024-10-08T21:16:26.4928491Z distributed/test_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_nccl_1.1_b1b8018242c4da18_.log
2024-10-08T21:16:26.4930556Z Running 0 items in this shard:
2024-10-08T21:16:26.4931051Z 
2024-10-08T21:16:26.4936677Z Running distributed/checkpoint/test_checkpoint 1/1 ... [2024-10-08 21:16:26.493341]
2024-10-08T21:16:26.4937924Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:16:26.4943671Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:16:26.493903]
2024-10-08T21:16:36.5349984Z 
2024-10-08T21:16:36.5351801Z distributed/checkpoint/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_checkpoint_1.1_6107260fb9a70bab_.log
2024-10-08T21:16:36.5357907Z Running 8 items in this shard: test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_default_metadata, test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_tensor_metadata_with_missing_rank_spec, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_reader_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_writer_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling_no_dist, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling_no_dist
2024-10-08T21:16:36.5363528Z 
2024-10-08T21:16:36.5364135Z Running distributed/_composable/fsdp/test_fully_shard_compile 1/1 ... [2024-10-08 21:16:36.536027]
2024-10-08T21:16:36.5364915Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:16:36.5370858Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:16:36.536690]
2024-10-08T21:16:47.1794170Z 
2024-10-08T21:16:47.1797896Z distributed/_composable/fsdp/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_compile_1.1_7567cdb98b9ebace_.log
2024-10-08T21:16:47.1824401Z Running 14 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompileCompute::test_disable_compiling_hooks, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_dynamo_trace_use_training_state, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_inductor_fullgraph_False, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_inductor_fullgraph_True, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_inductor, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_trace_fsdp_copy_, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_inductor_fullgraph_False, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_inductor_fullgraph_True
2024-10-08T21:16:47.1848390Z 
2024-10-08T21:16:47.1849688Z Running distributed/fsdp/test_fsdp_backward_prefetch 1/1 ... [2024-10-08 21:16:47.179698]
2024-10-08T21:16:47.1851226Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:16:47.1855592Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_backward_prefetch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:16:47.180270]
2024-10-08T21:16:53.7630878Z 
2024-10-08T21:16:53.7632891Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_352ba060bcaf64cf_.log
2024-10-08T21:16:53.7634875Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_backward_prefetch.py::TestBackwardPrefetch::test_backward_prefetch
2024-10-08T21:16:53.7635711Z 
2024-10-08T21:16:53.7638329Z Running distributed/fsdp/test_fsdp_overlap 1/1 ... [2024-10-08 21:16:53.763593]
2024-10-08T21:16:53.7639635Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:16:53.7644298Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:16:53.764105]
2024-10-08T21:17:03.3002451Z 
2024-10-08T21:17:03.3004566Z distributed/fsdp/test_fsdp_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_f5ca89f54a7ffec2_.log
2024-10-08T21:17:03.3007026Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_overlap.py::TestForwardOverlapWorldSizeOne::test_forward_overlap, test/distributed/fsdp/test_fsdp_overlap.py::TestForwardOverlapWorldSizeTwo::test_forward_overlap
2024-10-08T21:17:03.3008611Z 
2024-10-08T21:17:03.3009821Z Running distributed/fsdp/test_fsdp_pure_fp16 1/1 ... [2024-10-08 21:17:03.300744]
2024-10-08T21:17:03.3010525Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:17:03.3015741Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_pure_fp16.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:17:03.301261]
2024-10-08T21:17:12.5881062Z 
2024-10-08T21:17:12.5883158Z distributed/fsdp/test_fsdp_pure_fp16 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_pure_fp16_1.1_691a25bd5f2a5526_.log
2024-10-08T21:17:12.5885394Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_pure_fp16.py::TestPureFP16::test_fp16_dtypes, test/distributed/fsdp/test_fsdp_pure_fp16.py::TestPureFP16::test_pure_fp16_training
2024-10-08T21:17:12.5886566Z 
2024-10-08T21:17:12.5889564Z Running distributed/_composable/fsdp/test_fully_shard_autograd 1/1 ... [2024-10-08 21:17:12.588657]
2024-10-08T21:17:12.5890370Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:17:12.5895532Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:17:12.589153]
2024-10-08T21:17:15.9177195Z 
2024-10-08T21:17:15.9179623Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_0e581181ef0f5d05_.log
2024-10-08T21:17:15.9185537Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_nontensor_activations, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_module, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_output, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiThread::test_post_acc_grad_hook_runs, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiProcess::test_post_acc_grad_hook_optim_parity
2024-10-08T21:17:15.9190217Z 
2024-10-08T21:17:15.9190844Z Running distributed/_composable/fsdp/test_fully_shard_frozen 1/1 ... [2024-10-08 21:17:15.918069]
2024-10-08T21:17:15.9191622Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:17:15.9193625Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_frozen.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:17:15.918556]
2024-10-08T21:17:19.1955983Z 
2024-10-08T21:17:19.1958313Z distributed/_composable/fsdp/test_fully_shard_frozen 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_frozen_1.1_9d60e6f941100a12_.log
2024-10-08T21:17:19.1962259Z Running 3 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_multi_forward_mixed_requires_grad, test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_train_mixed_requires_grad_across_groups, test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_train_mixed_requires_grad_per_group
2024-10-08T21:17:19.1964876Z 
2024-10-08T21:17:19.1965411Z Running distributed/fsdp/test_fsdp_optim_state 1/1 ... [2024-10-08 21:17:19.196139]
2024-10-08T21:17:19.1966103Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:17:19.1970052Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:17:19.196640]
2024-10-08T21:20:36.2154195Z 
2024-10-08T21:20:36.2158500Z distributed/fsdp/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_0b5c05f8af925706_.log
2024-10-08T21:20:36.2212436Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_compatible_with_trec, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_nested, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_flatten_sharded_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_keys, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_full_optim_state_dict_nested_invalid, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_interface_arguments, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_no_grad, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_input_warning, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type0_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_False_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_dict_nested_state_dict_type1_use_multiple_param_groups_True_rank0_only_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_optim_state_without_param_groups, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type0_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_ids_state_dict_type1_use_multiple_param_groups_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_rekey_optim_state_dict_to_names, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type0, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_save_load_without_0th_param_state_state_dict_type1, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_scatter_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_halve_world_size, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_False_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_False_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_nested_use_multiple_param_groups_True_wrap_alt_True_use_diff_optim_inputs_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_transformer, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type0_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_False, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_shard_full_optim_state_dict_unmanaged_params_state_dict_type1_add_to_fsdp_module_True, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_state_dict_with_none_tensor_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_use_orig_params, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_empty_optimizer_state, test/distributed/fsdp/test_fsdp_optim_state.py::TestFSDPOptimState::test_with_no_shard
2024-10-08T21:20:36.2263186Z 
2024-10-08T21:20:36.2263875Z Running distributed/fsdp/test_fsdp_flatten_params 1/1 ... [2024-10-08 21:20:36.216146]
2024-10-08T21:20:36.2264603Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:20:36.2266545Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_flatten_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:20:36.216624]
2024-10-08T21:21:12.6944699Z 
2024-10-08T21:21:12.6947000Z distributed/fsdp/test_fsdp_flatten_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_flatten_params_1.1_1d0ad58b729ed9c4_.log
2024-10-08T21:21:12.6955380Z Running 11 items in this shard: test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_empty_module, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_full_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_mixed_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_unaligned, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flatten_nothing, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_partial_flattening, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_pnorm_after_step_with_shared_params
2024-10-08T21:21:12.6963010Z 
2024-10-08T21:21:12.6963503Z Running distributed/rpc/test_share_memory 1/1 ... [2024-10-08 21:21:12.695005]
2024-10-08T21:21:12.6964190Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:12.6966150Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_share_memory.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:12.695518]
2024-10-08T21:21:22.6423353Z 
2024-10-08T21:21:22.6425600Z distributed/rpc/test_share_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_share_memory_1.1_674d47ddf0277c6a_.log
2024-10-08T21:21:22.6427445Z Running 1 items in this shard: test/distributed/rpc/test_share_memory.py::TestRPCPickler::test_case
2024-10-08T21:21:22.6428759Z Running 1 items in this shard: test/distributed/rpc/test_share_memory.py::TestRPCPickler::test_case
2024-10-08T21:21:22.6429498Z 
2024-10-08T21:21:22.6432600Z Running distributed/test_c10d_logger 1/1 ... [2024-10-08 21:21:22.642982]
2024-10-08T21:21:22.6433379Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:22.6438550Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_logger.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:22.643524]
2024-10-08T21:21:35.1838386Z 
2024-10-08T21:21:35.1840982Z distributed/test_c10d_logger 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_logger_1.1_6e2ea27fb3d6d2da_.log
2024-10-08T21:21:35.1845675Z Running 3 items in this shard: test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_exception_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_get_or_create_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_time_logger
2024-10-08T21:21:35.1848538Z 
2024-10-08T21:21:35.1849774Z Running distributed/fsdp/test_fsdp_tp_integration 1/1 ... [2024-10-08 21:21:35.184604]
2024-10-08T21:21:35.1851015Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:35.1857227Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_tp_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:35.185257]
2024-10-08T21:21:47.4753405Z 
2024-10-08T21:21:47.4755579Z distributed/fsdp/test_fsdp_tp_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_66e0b7096132901a_.log
2024-10-08T21:21:47.4759197Z Running 3 items in this shard: test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_extension_grad, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_integration, test/distributed/fsdp/test_fsdp_tp_integration.py::TestTPFSDPIntegration::test_fsdp_tp_sync_module_state
2024-10-08T21:21:47.4761923Z 
2024-10-08T21:21:47.4762424Z Running distributed/fsdp/test_fsdp_traversal 1/1 ... [2024-10-08 21:21:47.475869]
2024-10-08T21:21:47.4763114Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:47.4766782Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_traversal.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:47.476376]
2024-10-08T21:21:53.8079321Z 
2024-10-08T21:21:53.8081419Z distributed/fsdp/test_fsdp_traversal 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_traversal_1.1_59ab547f9783578f_.log
2024-10-08T21:21:53.8083179Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_traversal.py::TestTraversal::test_fsdp_modules
2024-10-08T21:21:53.8083919Z 
2024-10-08T21:21:53.8086692Z Running distributed/fsdp/test_fsdp_state_dict 1/1 ... [2024-10-08 21:21:53.808415]
2024-10-08T21:21:53.8087385Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:53.8092975Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:53.808934]
2024-10-08T21:21:57.5859166Z 
2024-10-08T21:21:57.5861492Z distributed/fsdp/test_fsdp_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_state_dict_1.1_bf58de91c25a416e_.log
2024-10-08T21:21:57.6054430Z Running 179 items in this shard: test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_basic_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_fp16_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_local_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_sharded_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload0_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_False_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_buffers_save_and_load_state_dict_state_dict_type_state_dict_cpu_offload1_mixed_precision_True_state_dict_rank0_and_offload_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_keys_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_both_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_sharded_state_dict_checkpoint_wrap_source_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_both_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_dest_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_after_wrap_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_fsdp_state_dict_with_activation_checkpoint_state_dict_type_state_dict_checkpoint_wrap_source_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_full_state_dict_missing_unexpected_keys_cleaned, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_local_state_dict_with_empty_ranks, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_local_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_sharded_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_False_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_False_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_True_state_dict_rank0_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_save_and_load_after_forward_state_dict_state_dict_type_state_dict_mixed_precision_True_state_dict_rank0_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_sharded_load_multi_backend_pg, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_shared_module_and_shared_parameter, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_False_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_False_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_True_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_sharded_state_dict_state_dict_rank0_and_offload_True_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_False_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_False_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_True_fsdp_root_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_load_into_local_module_state_dict_type_state_dict_state_dict_rank0_and_offload_True_fsdp_root_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_rank0_offload_save_load_flow_use_orig_params_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_rank0_offload_save_load_flow_use_orig_params_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_save_load_flow_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_local_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_sharded_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_skip_module_state_dict_type_state_dict_double_nest_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_type, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_False_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_sharded_state_dict_prefix_True_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_False_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_ignored_modules_state_dict_type_state_dict_prefix_True_ignore_inner_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_sharded_state_dict_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_sharded_state_dict_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_state_dict_rank0_only_and_offload_False, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_manual_ac_wrapper_state_dict_type_state_dict_rank0_only_and_offload_True, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_local_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_sharded_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_state_dict_with_shared_parameters_state_dict_type_state_dict, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_torch_save_load, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_world_size_one, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict::test_wrong_state_dict_config, test/distributed/fsdp/test_fsdp_state_dict.py::TestFSDPStateDict4GPUs::test_local_state_dict_reshard
2024-10-08T21:21:57.6240895Z 
2024-10-08T21:21:57.6241538Z Running distributed/fsdp/test_fsdp_input 1/1 ... [2024-10-08 21:21:57.587088]
2024-10-08T21:21:57.6242203Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:21:57.6244095Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_input.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:21:57.587565]
2024-10-08T21:22:06.8728672Z 
2024-10-08T21:22:06.8730712Z distributed/fsdp/test_fsdp_input 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_input_1.1_7a22c65937a440d5_.log
2024-10-08T21:22:06.8732889Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_input.py::TestInput::test_input_type_dict, test/distributed/fsdp/test_fsdp_input.py::TestInput::test_input_type_list
2024-10-08T21:22:06.8734016Z 
2024-10-08T21:22:06.8736660Z Running distributed/fsdp/test_fsdp_exec_order 1/1 ... [2024-10-08 21:22:06.873372]
2024-10-08T21:22:06.8737360Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:06.8742021Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_exec_order.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:06.873864]
2024-10-08T21:22:34.2863083Z 
2024-10-08T21:22:34.2864851Z distributed/fsdp/test_fsdp_exec_order 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_0f13ba681579eed3_.log
2024-10-08T21:22:34.2873910Z Running 8 items in this shard: test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy1
2024-10-08T21:22:34.2880259Z 
2024-10-08T21:22:34.2880821Z Running distributed/fsdp/test_fsdp_uneven 1/1 ... [2024-10-08 21:22:34.286918]
2024-10-08T21:22:34.2881517Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:34.2883414Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_uneven.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:34.287436]
2024-10-08T21:22:40.5681881Z 
2024-10-08T21:22:40.5683933Z distributed/fsdp/test_fsdp_uneven 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_uneven_1.1_eb740854cc6935d0_.log
2024-10-08T21:22:40.5686492Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_uneven.py::TestUnevenParamShard::test_one_iteration
2024-10-08T21:22:40.5687258Z 
2024-10-08T21:22:40.5688481Z Running distributed/fsdp/test_fsdp_multiple_wrapping 1/1 ... [2024-10-08 21:22:40.568592]
2024-10-08T21:22:40.5689474Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:40.5694540Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_multiple_wrapping.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:40.569084]
2024-10-08T21:22:46.8501792Z 
2024-10-08T21:22:46.8504018Z distributed/fsdp/test_fsdp_multiple_wrapping 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_multiple_wrapping_1.1_504c01e0c768480f_.log
2024-10-08T21:22:46.8506216Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_multiple_wrapping.py::TestMultipleWrapping::test_multiple_wrapping
2024-10-08T21:22:46.8507079Z 
2024-10-08T21:22:46.8507542Z Running distributed/test_distributed_spawn 1/3 ... [2024-10-08 21:22:46.850361]
2024-10-08T21:22:46.8596312Z MPI not available -- MPI backend tests will be skipped
2024-10-08T21:22:46.8598266Z Running distributed tests for the test backend with env init_method
2024-10-08T21:22:46.8601636Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:46.8607821Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:46.860477]
2024-10-08T21:22:50.1135758Z 
2024-10-08T21:22:50.1137684Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_d5f4826c2dbc773a_.log
2024-10-08T21:22:50.1138962Z Running 0 items in this shard:
2024-10-08T21:22:50.1139252Z 
2024-10-08T21:22:50.1147829Z Running distributed tests for the test backend with file init_method
2024-10-08T21:22:50.1149904Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:50.1155371Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:50.115195]
2024-10-08T21:22:53.3606997Z 
2024-10-08T21:22:53.3609170Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_68566bfb0b411533_.log
2024-10-08T21:22:53.3610459Z Running 0 items in this shard:
2024-10-08T21:22:53.3610723Z 
2024-10-08T21:22:53.3618433Z Running distributed tests for the gloo backend with env init_method
2024-10-08T21:22:53.3620685Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:22:53.3626301Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:22:53.362274]
2024-10-08T21:33:07.3199608Z 
2024-10-08T21:33:07.3201305Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_e54094341078bcc2_.log
2024-10-08T21:33:07.3282993Z Running 102 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-10-08T21:33:07.3344728Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager
2024-10-08T21:33:07.3346553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager
2024-10-08T21:33:07.3348098Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class
2024-10-08T21:33:07.3349594Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU
2024-10-08T21:33:07.3351254Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input
2024-10-08T21:33:07.3353201Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last
2024-10-08T21:33:07.3355111Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value
2024-10-08T21:33:07.3356984Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine
2024-10-08T21:33:07.3358696Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad
2024-10-08T21:33:07.3360287Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync
2024-10-08T21:33:07.3361903Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook
2024-10-08T21:33:07.3363589Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view
2024-10-08T21:33:07.3365103Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda
2024-10-08T21:33:07.3366666Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda
2024-10-08T21:33:07.3368210Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg
2024-10-08T21:33:07.3369718Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup
2024-10-08T21:33:07.3371276Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max
2024-10-08T21:33:07.3372970Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min
2024-10-08T21:33:07.3374602Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product
2024-10-08T21:33:07.3376222Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum
2024-10-08T21:33:07.3377809Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max
2024-10-08T21:33:07.3379347Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min
2024-10-08T21:33:07.3380869Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max
2024-10-08T21:33:07.3382470Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported
2024-10-08T21:33:07.3384063Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min
2024-10-08T21:33:07.3385551Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max
2024-10-08T21:33:07.3387029Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min
2024-10-08T21:33:07.3388500Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max
2024-10-08T21:33:07.3390155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max
2024-10-08T21:33:07.3391553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product
2024-10-08T21:33:07.3393080Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum
2024-10-08T21:33:07.3394481Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async
2024-10-08T21:33:07.3395961Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async
2024-10-08T21:33:07.3397427Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group
2024-10-08T21:33:07.3398907Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda
2024-10-08T21:33:07.3400352Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group
2024-10-08T21:33:07.3401809Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split
2024-10-08T21:33:07.3403419Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex
2024-10-08T21:33:07.3405078Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group
2024-10-08T21:33:07.3406848Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda
2024-10-08T21:33:07.3408532Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group
2024-10-08T21:33:07.3410195Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda
2024-10-08T21:33:07.3411742Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group
2024-10-08T21:33:07.3413181Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier
2024-10-08T21:33:07.3414502Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda
2024-10-08T21:33:07.3415928Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda
2024-10-08T21:33:07.3417381Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group
2024-10-08T21:33:07.3418872Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags
2024-10-08T21:33:07.3420431Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err
2024-10-08T21:33:07.3422011Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err
2024-10-08T21:33:07.3423440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast
2024-10-08T21:33:07.3424820Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list
2024-10-08T21:33:07.3426263Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager
2024-10-08T21:33:07.3427720Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async
2024-10-08T21:33:07.3429383Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger
2024-10-08T21:33:07.3431206Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping
2024-10-08T21:33:07.3432902Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad
2024-10-08T21:33:07.3434542Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph
2024-10-08T21:33:07.3435978Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph
2024-10-08T21:33:07.3437433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook
2024-10-08T21:33:07.3438945Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD
2024-10-08T21:33:07.3440424Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg
2024-10-08T21:33:07.3441870Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu
2024-10-08T21:33:07.3443429Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params
2024-10-08T21:33:07.3445161Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace
2024-10-08T21:33:07.3446679Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged
2024-10-08T21:33:07.3448202Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params
2024-10-08T21:33:07.3449737Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states
2024-10-08T21:33:07.3451250Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable
2024-10-08T21:33:07.3452808Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs
2024-10-08T21:33:07.3454350Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn
2024-10-08T21:33:07.3455991Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group
2024-10-08T21:33:07.3457634Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused
2024-10-08T21:33:07.3459170Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group
2024-10-08T21:33:07.3460554Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group
2024-10-08T21:33:07.3461976Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params
2024-10-08T21:33:07.3463375Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future
2024-10-08T21:33:07.3464693Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank
2024-10-08T21:33:07.3466076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph
2024-10-08T21:33:07.3467440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv
2024-10-08T21:33:07.3468882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler
2024-10-08T21:33:07.3470402Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order
2024-10-08T21:33:07.3471918Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo
2024-10-08T21:33:07.3473446Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup
2024-10-08T21:33:07.3474990Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce
2024-10-08T21:33:07.3476436Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort
2024-10-08T21:33:07.3477792Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups
2024-10-08T21:33:07.3479369Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size
2024-10-08T21:33:07.3481074Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module
2024-10-08T21:33:07.3482688Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product
2024-10-08T21:33:07.3484141Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min
2024-10-08T21:33:07.3485511Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product
2024-10-08T21:33:07.3486852Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum
2024-10-08T21:33:07.3488214Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda
2024-10-08T21:33:07.3489832Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda
2024-10-08T21:33:07.3491195Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl
2024-10-08T21:33:07.3492739Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler
2024-10-08T21:33:07.3494290Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler
2024-10-08T21:33:07.3495799Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler
2024-10-08T21:33:07.3497355Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler
2024-10-08T21:33:07.3498891Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu
2024-10-08T21:33:07.3500433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-10-08T21:33:07.3501359Z 
2024-10-08T21:33:07.3501661Z Running distributed tests for the gloo backend with file init_method
2024-10-08T21:33:07.3502288Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:33:07.3504430Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:33:07.325609]
2024-10-08T21:43:21.0124577Z 
2024-10-08T21:43:21.0126691Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_cd4aad2615bcf04a_.log
2024-10-08T21:43:21.0206205Z Running 102 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-10-08T21:43:21.0267785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager
2024-10-08T21:43:21.0269677Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager
2024-10-08T21:43:21.0271187Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class
2024-10-08T21:43:21.0272687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU
2024-10-08T21:43:21.0274355Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input
2024-10-08T21:43:21.0276145Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last
2024-10-08T21:43:21.0278047Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value
2024-10-08T21:43:21.0279926Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine
2024-10-08T21:43:21.0281697Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad
2024-10-08T21:43:21.0283297Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync
2024-10-08T21:43:21.0284909Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook
2024-10-08T21:43:21.0286594Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view
2024-10-08T21:43:21.0288129Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda
2024-10-08T21:43:21.0289844Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda
2024-10-08T21:43:21.0291412Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg
2024-10-08T21:43:21.0293026Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup
2024-10-08T21:43:21.0294730Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max
2024-10-08T21:43:21.0296345Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min
2024-10-08T21:43:21.0297958Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product
2024-10-08T21:43:21.0299590Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum
2024-10-08T21:43:21.0301184Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max
2024-10-08T21:43:21.0302751Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min
2024-10-08T21:43:21.0304279Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max
2024-10-08T21:43:21.0305857Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported
2024-10-08T21:43:21.0307452Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min
2024-10-08T21:43:21.0308948Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max
2024-10-08T21:43:21.0310448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min
2024-10-08T21:43:21.0311921Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max
2024-10-08T21:43:21.0313326Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max
2024-10-08T21:43:21.0314736Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product
2024-10-08T21:43:21.0316126Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum
2024-10-08T21:43:21.0317525Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async
2024-10-08T21:43:21.0319585Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async
2024-10-08T21:43:21.0321053Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group
2024-10-08T21:43:21.0322540Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda
2024-10-08T21:43:21.0324001Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group
2024-10-08T21:43:21.0325484Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split
2024-10-08T21:43:21.0327093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex
2024-10-08T21:43:21.0328735Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group
2024-10-08T21:43:21.0330424Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda
2024-10-08T21:43:21.0332114Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group
2024-10-08T21:43:21.0333956Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda
2024-10-08T21:43:21.0335498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group
2024-10-08T21:43:21.0336860Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier
2024-10-08T21:43:21.0338173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda
2024-10-08T21:43:21.0339605Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda
2024-10-08T21:43:21.0341077Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group
2024-10-08T21:43:21.0342564Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags
2024-10-08T21:43:21.0344127Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err
2024-10-08T21:43:21.0345683Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err
2024-10-08T21:43:21.0347114Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast
2024-10-08T21:43:21.0348519Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list
2024-10-08T21:43:21.0349958Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager
2024-10-08T21:43:21.0351419Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async
2024-10-08T21:43:21.0353097Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger
2024-10-08T21:43:21.0354837Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping
2024-10-08T21:43:21.0356549Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad
2024-10-08T21:43:21.0358271Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph
2024-10-08T21:43:21.0359719Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph
2024-10-08T21:43:21.0361156Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook
2024-10-08T21:43:21.0362676Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD
2024-10-08T21:43:21.0364163Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg
2024-10-08T21:43:21.0365614Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu
2024-10-08T21:43:21.0367177Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params
2024-10-08T21:43:21.0368761Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace
2024-10-08T21:43:21.0370276Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged
2024-10-08T21:43:21.0371875Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params
2024-10-08T21:43:21.0373498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states
2024-10-08T21:43:21.0375010Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable
2024-10-08T21:43:21.0376472Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs
2024-10-08T21:43:21.0378016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn
2024-10-08T21:43:21.0379668Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group
2024-10-08T21:43:21.0381312Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused
2024-10-08T21:43:21.0382841Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group
2024-10-08T21:43:21.0384220Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group
2024-10-08T21:43:21.0385643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params
2024-10-08T21:43:21.0387070Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future
2024-10-08T21:43:21.0388392Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank
2024-10-08T21:43:21.0390069Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph
2024-10-08T21:43:21.0391429Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv
2024-10-08T21:43:21.0392820Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler
2024-10-08T21:43:21.0394350Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order
2024-10-08T21:43:21.0395872Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo
2024-10-08T21:43:21.0397553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup
2024-10-08T21:43:21.0399073Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce
2024-10-08T21:43:21.0400528Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort
2024-10-08T21:43:21.0401907Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups
2024-10-08T21:43:21.0403485Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size
2024-10-08T21:43:21.0405177Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module
2024-10-08T21:43:21.0406712Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product
2024-10-08T21:43:21.0408157Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min
2024-10-08T21:43:21.0409533Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product
2024-10-08T21:43:21.0410972Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum
2024-10-08T21:43:21.0412329Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda
2024-10-08T21:43:21.0413770Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda
2024-10-08T21:43:21.0415134Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl
2024-10-08T21:43:21.0416609Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler
2024-10-08T21:43:21.0418165Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler
2024-10-08T21:43:21.0419679Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler
2024-10-08T21:43:21.0421221Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler
2024-10-08T21:43:21.0422749Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu
2024-10-08T21:43:21.0424289Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-10-08T21:43:21.0425196Z 
2024-10-08T21:43:21.0425831Z Running distributed/test_distributed_spawn 3/3 ... [2024-10-08 21:43:21.017872]
2024-10-08T21:43:21.0426641Z MPI not available -- MPI backend tests will be skipped
2024-10-08T21:43:21.0427317Z Running distributed tests for the test backend with env init_method
2024-10-08T21:43:21.0427943Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:43:21.0429904Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:43:21.026461]
2024-10-08T21:43:24.2683400Z 
2024-10-08T21:43:24.2685260Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_689937b612a8c27b_.log
2024-10-08T21:43:24.2686535Z Running 0 items in this shard:
2024-10-08T21:43:24.2686817Z 
2024-10-08T21:43:24.2695035Z Running distributed tests for the test backend with file init_method
2024-10-08T21:43:24.2696347Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:43:24.2701702Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:43:24.269845]
2024-10-08T21:43:27.5288284Z 
2024-10-08T21:43:27.5290597Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_dd52f128fac66097_.log
2024-10-08T21:43:27.5291882Z Running 0 items in this shard:
2024-10-08T21:43:27.5292144Z 
2024-10-08T21:43:27.5297810Z Running distributed tests for the gloo backend with env init_method
2024-10-08T21:43:27.5300023Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:43:27.5305413Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:43:27.530228]
2024-10-08T21:53:06.4338208Z 
2024-10-08T21:53:06.4341189Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_f906993489ef2bb8_.log
2024-10-08T21:53:06.4437653Z Running 91 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-10-08T21:53:06.4500030Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view
2024-10-08T21:53:06.4501867Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient
2024-10-08T21:53:06.4503707Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream
2024-10-08T21:53:06.4505453Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view
2024-10-08T21:53:06.4506992Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather
2024-10-08T21:53:06.4508407Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex
2024-10-08T21:53:06.4510138Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group
2024-10-08T21:53:06.4511628Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group
2024-10-08T21:53:06.4513055Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group
2024-10-08T21:53:06.4514558Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda
2024-10-08T21:53:06.4516130Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product
2024-10-08T21:53:06.4517713Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum
2024-10-08T21:53:06.4519241Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum
2024-10-08T21:53:06.4520758Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product
2024-10-08T21:53:06.4522256Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product
2024-10-08T21:53:06.4523819Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum
2024-10-08T21:53:06.4525232Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min
2024-10-08T21:53:06.4526673Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex
2024-10-08T21:53:06.4528165Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex
2024-10-08T21:53:06.4529635Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda
2024-10-08T21:53:06.4531155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group
2024-10-08T21:53:06.4532887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda
2024-10-08T21:53:06.4534526Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda
2024-10-08T21:53:06.4536049Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters
2024-10-08T21:53:06.4537478Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group
2024-10-08T21:53:06.4538890Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda
2024-10-08T21:53:06.4540351Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group
2024-10-08T21:53:06.4541832Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo
2024-10-08T21:53:06.4543374Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl
2024-10-08T21:53:06.4544981Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl
2024-10-08T21:53:06.4546531Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl
2024-10-08T21:53:06.4548110Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group
2024-10-08T21:53:06.4549776Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger
2024-10-08T21:53:06.4551612Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false
2024-10-08T21:53:06.4553283Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook
2024-10-08T21:53:06.4554806Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce
2024-10-08T21:53:06.4556354Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks
2024-10-08T21:53:06.4557979Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks
2024-10-08T21:53:06.4559440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device
2024-10-08T21:53:06.4560932Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group
2024-10-08T21:53:06.4562604Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD
2024-10-08T21:53:06.4564086Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu
2024-10-08T21:53:06.4565631Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks
2024-10-08T21:53:06.4567246Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks
2024-10-08T21:53:06.4568866Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error
2024-10-08T21:53:06.4570384Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple
2024-10-08T21:53:06.4572009Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none
2024-10-08T21:53:06.4574006Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none
2024-10-08T21:53:06.4575687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd
2024-10-08T21:53:06.4577216Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph
2024-10-08T21:53:06.4578765Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks
2024-10-08T21:53:06.4580287Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad
2024-10-08T21:53:06.4581844Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types
2024-10-08T21:53:06.4583444Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined
2024-10-08T21:53:06.4585071Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group
2024-10-08T21:53:06.4586696Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks
2024-10-08T21:53:06.4588093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather
2024-10-08T21:53:06.4589692Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks
2024-10-08T21:53:06.4591052Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object
2024-10-08T21:53:06.4592447Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group
2024-10-08T21:53:06.4593949Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang
2024-10-08T21:53:06.4595514Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks
2024-10-08T21:53:06.4597055Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather
2024-10-08T21:53:06.4598558Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce
2024-10-08T21:53:06.4600192Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream
2024-10-08T21:53:06.4601806Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank
2024-10-08T21:53:06.4603524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size
2024-10-08T21:53:06.4605164Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group
2024-10-08T21:53:06.4606763Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity
2024-10-08T21:53:06.4608396Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view
2024-10-08T21:53:06.4610213Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view
2024-10-08T21:53:06.4611911Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min
2024-10-08T21:53:06.4613450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum
2024-10-08T21:53:06.4614881Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max
2024-10-08T21:53:06.4616244Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min
2024-10-08T21:53:06.4617676Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda
2024-10-08T21:53:06.4619160Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice
2024-10-08T21:53:06.4620528Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter
2024-10-08T21:53:06.4621866Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks
2024-10-08T21:53:06.4623249Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex
2024-10-08T21:53:06.4624666Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex
2024-10-08T21:53:06.4626190Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group
2024-10-08T21:53:06.4627606Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list
2024-10-08T21:53:06.4628988Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv
2024-10-08T21:53:06.4630471Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler
2024-10-08T21:53:06.4632000Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag
2024-10-08T21:53:06.4633507Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler
2024-10-08T21:53:06.4635050Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda
2024-10-08T21:53:06.4636556Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward
2024-10-08T21:53:06.4638135Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters
2024-10-08T21:53:06.4639826Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-10-08T21:53:06.4640713Z 
2024-10-08T21:53:06.4641029Z Running distributed tests for the gloo backend with file init_method
2024-10-08T21:53:06.4641640Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T21:53:06.4643774Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 21:53:06.440289]
2024-10-08T22:02:45.0014434Z 
2024-10-08T22:02:45.0016457Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_4323586ccfbf62a6_.log
2024-10-08T22:02:45.0088393Z Running 91 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-10-08T22:02:45.0144202Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view
2024-10-08T22:02:45.0146138Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient
2024-10-08T22:02:45.0147984Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream
2024-10-08T22:02:45.0149743Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view
2024-10-08T22:02:45.0151303Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather
2024-10-08T22:02:45.0152719Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex
2024-10-08T22:02:45.0154255Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group
2024-10-08T22:02:45.0155746Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group
2024-10-08T22:02:45.0157173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group
2024-10-08T22:02:45.0158730Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda
2024-10-08T22:02:45.0160312Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product
2024-10-08T22:02:45.0161895Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum
2024-10-08T22:02:45.0163421Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum
2024-10-08T22:02:45.0164943Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product
2024-10-08T22:02:45.0166458Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product
2024-10-08T22:02:45.0167907Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum
2024-10-08T22:02:45.0169319Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min
2024-10-08T22:02:45.0170770Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex
2024-10-08T22:02:45.0172267Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex
2024-10-08T22:02:45.0173795Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda
2024-10-08T22:02:45.0175312Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group
2024-10-08T22:02:45.0176945Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda
2024-10-08T22:02:45.0178579Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda
2024-10-08T22:02:45.0180104Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters
2024-10-08T22:02:45.0181529Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group
2024-10-08T22:02:45.0182929Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda
2024-10-08T22:02:45.0184465Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group
2024-10-08T22:02:45.0185948Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo
2024-10-08T22:02:45.0187479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl
2024-10-08T22:02:45.0189354Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl
2024-10-08T22:02:45.0190922Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl
2024-10-08T22:02:45.0192412Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group
2024-10-08T22:02:45.0194094Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger
2024-10-08T22:02:45.0195929Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false
2024-10-08T22:02:45.0197746Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook
2024-10-08T22:02:45.0199263Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce
2024-10-08T22:02:45.0200822Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks
2024-10-08T22:02:45.0202450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks
2024-10-08T22:02:45.0203912Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device
2024-10-08T22:02:45.0205396Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group
2024-10-08T22:02:45.0207002Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD
2024-10-08T22:02:45.0208488Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu
2024-10-08T22:02:45.0210035Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks
2024-10-08T22:02:45.0211643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks
2024-10-08T22:02:45.0213356Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error
2024-10-08T22:02:45.0214882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple
2024-10-08T22:02:45.0216503Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none
2024-10-08T22:02:45.0218427Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none
2024-10-08T22:02:45.0220116Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd
2024-10-08T22:02:45.0221638Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph
2024-10-08T22:02:45.0223709Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks
2024-10-08T22:02:45.0225225Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad
2024-10-08T22:02:45.0226787Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types
2024-10-08T22:02:45.0228389Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined
2024-10-08T22:02:45.0230016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group
2024-10-08T22:02:45.0231584Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks
2024-10-08T22:02:45.0232993Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather
2024-10-08T22:02:45.0234320Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks
2024-10-08T22:02:45.0235683Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object
2024-10-08T22:02:45.0237144Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group
2024-10-08T22:02:45.0238645Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang
2024-10-08T22:02:45.0240212Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks
2024-10-08T22:02:45.0241759Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather
2024-10-08T22:02:45.0243268Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce
2024-10-08T22:02:45.0244769Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream
2024-10-08T22:02:45.0246388Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank
2024-10-08T22:02:45.0248101Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size
2024-10-08T22:02:45.0249733Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group
2024-10-08T22:02:45.0251320Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity
2024-10-08T22:02:45.0253072Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view
2024-10-08T22:02:45.0254891Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view
2024-10-08T22:02:45.0256591Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min
2024-10-08T22:02:45.0258035Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum
2024-10-08T22:02:45.0259466Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max
2024-10-08T22:02:45.0260816Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min
2024-10-08T22:02:45.0262302Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda
2024-10-08T22:02:45.0263787Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice
2024-10-08T22:02:45.0265156Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter
2024-10-08T22:02:45.0266486Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks
2024-10-08T22:02:45.0267858Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex
2024-10-08T22:02:45.0269271Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex
2024-10-08T22:02:45.0270701Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group
2024-10-08T22:02:45.0272120Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list
2024-10-08T22:02:45.0273490Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv
2024-10-08T22:02:45.0275031Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler
2024-10-08T22:02:45.0276550Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag
2024-10-08T22:02:45.0278046Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler
2024-10-08T22:02:45.0279580Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda
2024-10-08T22:02:45.0281092Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward
2024-10-08T22:02:45.0282672Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters
2024-10-08T22:02:45.0284305Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-10-08T22:02:45.0285194Z 
2024-10-08T22:02:45.0285772Z Running distributed/fsdp/test_utils 1/1 ... [2024-10-08 22:02:45.006422]
2024-10-08T22:02:45.0286396Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:02:45.0288243Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:02:45.006858]
2024-10-08T22:02:48.2829227Z 
2024-10-08T22:02:48.2831127Z distributed/fsdp/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_utils_1.1_853f9fb0c41460e8_.log
2024-10-08T22:02:48.2834431Z Running 5 items in this shard: test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_cpu_cuda, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices0, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices1, test/distributed/fsdp/test_utils.py::TestUtils::test_packed_sequence, test/distributed/fsdp/test_utils.py::TestUtils::test_replace_by_prefix
2024-10-08T22:02:48.2837470Z 
2024-10-08T22:02:48.2838035Z Running distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 ... [2024-10-08 22:02:48.283424]
2024-10-08T22:02:48.2838783Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:02:48.2842788Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_sharded_grad_scaler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:02:48.283915]
2024-10-08T22:03:42.8883694Z 
2024-10-08T22:03:42.8886207Z distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_sharded_grad_scaler_1.1_e205c1aecb97b09a_.log
2024-10-08T22:03:42.8907856Z Running 20 items in this shard: test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_grad_scaling, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_inf_gradients_skip_optim_step, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_scaling_unscaling_sparse, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_sharded_grad_scaler_found_inf
2024-10-08T22:03:42.8926717Z 
2024-10-08T22:03:42.8927281Z Running distributed/fsdp/test_fsdp_fine_tune 1/1 ... [2024-10-08 22:03:42.888958]
2024-10-08T22:03:42.8927975Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:03:42.8929995Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fine_tune.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:03:42.889576]
2024-10-08T22:03:46.1657078Z 
2024-10-08T22:03:46.1659060Z distributed/fsdp/test_fsdp_fine_tune 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_b17756586eef3536_.log
2024-10-08T22:03:46.1662571Z Running 4 items in this shard: test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_backward_reshard_hooks, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_hooks_multi_traversal, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_ddp, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_non_frozen_fsdp
2024-10-08T22:03:46.1665562Z 
2024-10-08T22:03:46.1666081Z Running distributed/fsdp/test_fsdp_multiple_forward 1/1 ... [2024-10-08 22:03:46.166179]
2024-10-08T22:03:46.1666826Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:03:46.1669943Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_multiple_forward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:03:46.166650]
2024-10-08T22:03:52.4978430Z 
2024-10-08T22:03:52.4980503Z distributed/fsdp/test_fsdp_multiple_forward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_multiple_forward_1.1_734973e45f08ecee_.log
2024-10-08T22:03:52.4982391Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_multiple_forward.py::TestMultiForward::test_multi_forward
2024-10-08T22:03:52.4983172Z 
2024-10-08T22:03:52.4986062Z Running distributed/test_multi_threaded_pg 1/1 ... [2024-10-08 22:03:52.498369]
2024-10-08T22:03:52.4986737Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:03:52.4992133Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_multi_threaded_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:03:52.498904]
2024-10-08T22:03:55.9254227Z 
2024-10-08T22:03:55.9256259Z distributed/test_multi_threaded_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_multi_threaded_pg_1.1_3aa098411da756cf_.log
2024-10-08T22:03:55.9270934Z Running 22 items in this shard: test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_none, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_tensor, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_skip, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_coalesced, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_ops, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_to_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_allgather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_assert_equal_on_rank, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_bwd_sees_fwd_pg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_gather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_reduce_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_subpg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_using_pg_from_another_thread
2024-10-08T22:03:55.9283523Z 
2024-10-08T22:03:55.9284071Z Running distributed/fsdp/test_fsdp_hybrid_shard 1/1 ... [2024-10-08 22:03:55.925868]
2024-10-08T22:03:55.9284782Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:03:55.9286715Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_hybrid_shard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:03:55.926363]
2024-10-08T22:04:17.9321808Z 
2024-10-08T22:04:17.9323852Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_8ca93e47001cc555_.log
2024-10-08T22:04:17.9329244Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_basic_setup, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_parity, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_save_load_state_dict, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_sync_module_state, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_invalid_pg_specification_raises, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_raises_manual_wrap_hybrid_shard_when_none_policy
2024-10-08T22:04:17.9333313Z 
2024-10-08T22:04:17.9333786Z Running distributed/algorithms/test_join 1/1 ... [2024-10-08 22:04:17.932544]
2024-10-08T22:04:17.9334461Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:04:17.9336353Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/test_join.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:04:17.933038]
2024-10-08T22:04:49.3049049Z 
2024-10-08T22:04:49.3051992Z distributed/algorithms/test_join 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.test_join_1.1_a5a3af1f20ee3708_.log
2024-10-08T22:04:49.3061614Z Running 9 items in this shard: test/distributed/algorithms/test_join.py::TestJoin::test_join_kwargs, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables_throw, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_main_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_post_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_throw
2024-10-08T22:04:49.3068859Z 
2024-10-08T22:04:49.3069988Z Running distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint 1/1 ... [2024-10-08 22:04:49.305726]
2024-10-08T22:04:49.3071300Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:04:49.3074850Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:04:49.306356]
2024-10-08T22:04:58.8438627Z 
2024-10-08T22:04:58.8441486Z distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_optim_checkpoint_1.1_96028216f3a77436_.log
2024-10-08T22:04:58.8445242Z Running 2 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint.py::TestOptimStateCheckpointing::test_optim_state_dict_save_load, test/distributed/_composable/fully_shard/test_fully_shard_optim_checkpoint.py::TestOptimStateCheckpointing::test_optim_state_dict_submodule_fully_shard
2024-10-08T22:04:58.8447263Z 
2024-10-08T22:04:58.8447714Z Running distributed/fsdp/test_fsdp_misc 1/1 ... [2024-10-08 22:04:58.844297]
2024-10-08T22:04:58.8448375Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:04:58.8451653Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_misc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:04:58.844796]
2024-10-08T22:05:45.8921242Z 
2024-10-08T22:05:45.8923470Z distributed/fsdp/test_fsdp_misc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_misc_1.1_5761e5286da68d7f_.log
2024-10-08T22:05:45.8943403Z Running 28 items in this shard: test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_cpu_init_with_sync_module_states, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_init_stays_on_cpu, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_training, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_False, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_True, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_not_all_outputs_used_in_loss, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optim_overlap_no_use_orig_params_error, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optimizer_overlap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_zero2_eval_with_prefetch, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_cpu_gpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_device_id_auto_wrap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_cpu_offload, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_no_move_ignored_params_and_bufs, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_ignored_module_meta, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_namedtuple, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_same_model_across_ranks, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_unsupported_module_cls, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_homogeneous_attributes, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_module_device_mismatches_device_id, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_multigpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_no_params, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_training_device_mismatch_errors, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_unsafe_setattr, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_world_size_1_sharding_strategy_warning
2024-10-08T22:05:45.8960458Z 
2024-10-08T22:05:45.8961003Z Running distributed/fsdp/test_fsdp_comm 1/1 ... [2024-10-08 22:05:45.892802]
2024-10-08T22:05:45.8961668Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:05:45.8963518Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_comm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:05:45.893381]
2024-10-08T22:06:13.4058768Z 
2024-10-08T22:06:13.4060766Z distributed/fsdp/test_fsdp_comm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_comm_1.1_88f5ee433ee198af_.log
2024-10-08T22:06:13.4069452Z Running 10 items in this shard: test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_False_use_no_sync_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_False_use_no_sync_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_False_use_no_sync_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_False_use_no_sync_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_True_use_no_sync_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_True_use_no_sync_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_True_use_no_sync_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm.py::TestCommunication::test_communication_nested_model_True_use_no_sync_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm.py::TestExplicitUnshard::test_unshard_async_use_orig_params_False, test/distributed/fsdp/test_fsdp_comm.py::TestExplicitUnshard::test_unshard_async_use_orig_params_True
2024-10-08T22:06:13.4077399Z 
2024-10-08T22:06:13.4077920Z Running distributed/checkpoint/test_state_dict 1/1 ... [2024-10-08 22:06:13.406393]
2024-10-08T22:06:13.4078625Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:06:13.4080551Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:06:13.406865]
2024-10-08T22:06:20.5410499Z 
2024-10-08T22:06:20.5412792Z distributed/checkpoint/test_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_1.1_addf78cb2e0dc54d_.log
2024-10-08T22:06:20.5428799Z Running 25 items in this shard: test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_fsdp1, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0_hsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_compiled_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_cpu_offload_full_state_dict, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_fsdp_api, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_partial, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_extra_state, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_flattened_osd, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_frozen_parameters, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp2, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_root_not_initialized, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_non_persistent_buffers, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_optim_state_dict_param_matching, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_optim_state_dict_tensor_matching, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model_broadcasting, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_shared_weight, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_single_gpu, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_strict, test/distributed/checkpoint/test_state_dict.py::TestNoComm::test_no_dist
2024-10-08T22:06:20.5443084Z 
2024-10-08T22:06:20.5443662Z Running distributed/rpc/test_faulty_agent 1/1 ... [2024-10-08 22:06:20.541640]
2024-10-08T22:06:20.5444403Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:06:20.5446625Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_faulty_agent.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:06:20.542159]
2024-10-08T22:12:29.8248938Z 
2024-10-08T22:12:29.8251755Z distributed/rpc/test_faulty_agent 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_faulty_agent_1.1_aee78da0f0ae409c_.log
2024-10-08T22:12:29.8285244Z Running 28 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_check_failed_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_faulty_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_messages_to_delay, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_no_faulty_messages, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_builtin_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_script_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rref_to_here_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout_to_self, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_verify_backend_options, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_context_cleanup_tensor_with_grad, test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_verify_backend_options, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_remote_timeout_to_here_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_script_func, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_to_here_timeout_in_jit, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_python, test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_torchscript_function
2024-10-08T22:12:29.8313538Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout
2024-10-08T22:12:29.8316671Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_builtin_remote_message_dropped_timeout_to_self
2024-10-08T22:12:29.8319079Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_check_failed_messages
2024-10-08T22:12:29.8321334Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_faulty_messages
2024-10-08T22:12:29.8323829Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_custom_messages_to_delay
2024-10-08T22:12:29.8326085Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_no_faulty_messages
2024-10-08T22:12:29.8328653Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout
2024-10-08T22:12:29.8330561Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_builtin_delay_timeout_to_self
2024-10-08T22:12:29.8332202Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle
2024-10-08T22:12:29.8333904Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_dropped_pickle_to_self
2024-10-08T22:12:29.8335518Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout
2024-10-08T22:12:29.8337183Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_remote_message_script_delay_timeout_to_self
2024-10-08T22:12:29.8338754Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_builtin_timeout
2024-10-08T22:12:29.8340204Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rpc_script_timeout
2024-10-08T22:12:29.8341638Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_rref_to_here_timeout
2024-10-08T22:12:29.8343136Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout
2024-10-08T22:12:29.8344750Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_delay_timeout_to_self
2024-10-08T22:12:29.8346562Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout
2024-10-08T22:12:29.8348214Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_udf_remote_message_dropped_timeout_to_self
2024-10-08T22:12:29.8349803Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentRpcTest::test_verify_backend_options
2024-10-08T22:12:29.8351399Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_context_cleanup_tensor_with_grad
2024-10-08T22:12:29.8353046Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyFaultyAgentDistAutogradTest::test_verify_backend_options
2024-10-08T22:12:29.8354658Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_remote_timeout_to_here_in_jit
2024-10-08T22:12:29.8356239Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_in_jit
2024-10-08T22:12:29.8357837Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_timeout_pickle_script_func
2024-10-08T22:12:29.8359524Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_rref_to_here_timeout_in_jit
2024-10-08T22:12:29.8361018Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_python
2024-10-08T22:12:29.8362568Z Running 1 items in this shard: test/distributed/rpc/test_faulty_agent.py::FaultyJitFaultyAgentRpcTest::test_timeout_in_torchscript_function
2024-10-08T22:12:29.8363481Z 
2024-10-08T22:12:29.8364129Z Running distributed/fsdp/test_fsdp_use_orig_params 1/1 ... [2024-10-08 22:12:29.827132]
2024-10-08T22:12:29.8364850Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:12:29.8367429Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_use_orig_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:12:29.827758]
2024-10-08T22:13:40.0726498Z 
2024-10-08T22:13:40.0729193Z distributed/fsdp/test_fsdp_use_orig_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_3d087ff5f2028d94_.log
2024-10-08T22:13:40.0752050Z Running 25 items in this shard: test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_trainability, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_fsdp_compile, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_multiple_optimizers, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsParamAccess::test_access_params_after_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_grad_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_no_reshard_and_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_param_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_between_fwd_and_bwd_for_no_reshard_raises, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_shape_mismatch, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsFQNs::test_named_parameters_in_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_correctness, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsInit::test_non_uniform_requires_grad, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cpu, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cuda
2024-10-08T22:13:40.0771067Z 
2024-10-08T22:13:40.0771571Z Running distributed/test_c10d_ucc 1/1 ... [2024-10-08 22:13:40.073628]
2024-10-08T22:13:40.0772194Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:13:40.0774194Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:13:40.074249]
2024-10-08T22:13:41.6390042Z 
2024-10-08T22:13:41.6391809Z distributed/test_c10d_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ucc_1.1_585139027176939e_.log
2024-10-08T22:13:41.6392857Z 
2024-10-08T22:13:41.6396499Z Running distributed/test_launcher 1/1 ... [2024-10-08 22:13:41.639438]
2024-10-08T22:13:41.6397221Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:13:41.6402242Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_launcher.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:13:41.639889]
2024-10-08T22:13:46.0697389Z 
2024-10-08T22:13:46.0699108Z distributed/test_launcher 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_launcher_1.1_bc36842d67ace779_.log
2024-10-08T22:13:46.0701516Z Running 1 items in this shard: test/distributed/test_launcher.py::TestDistributedLaunch::test_launch_user_script
2024-10-08T22:13:46.0702278Z 
2024-10-08T22:13:46.0706167Z Running distributed/test_c10d_gloo 1/1 ... [2024-10-08 22:13:46.070337]
2024-10-08T22:13:46.0706787Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set
2024-10-08T22:13:46.0711723Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-10-08 22:13:46.070853]
2024-10-08T22:26:30.5144393Z 
2024-10-08T22:26:30.5146452Z distributed/test_c10d_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_gloo_1.1_957a323d3569e0e5_.log
2024-10-08T22:26:30.5229659Z Running 120 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init, test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket, test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check
2024-10-08T22:26:30.5294353Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init
2024-10-08T22:26:30.5295593Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo
2024-10-08T22:26:30.5296865Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics
2024-10-08T22:26:30.5298166Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda
2024-10-08T22:26:30.5299440Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks
2024-10-08T22:26:30.5300918Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async
2024-10-08T22:26:30.5302978Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks
2024-10-08T22:26:30.5304389Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced
2024-10-08T22:26:30.5305812Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input
2024-10-08T22:26:30.5307139Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress
2024-10-08T22:26:30.5308423Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda
2024-10-08T22:26:30.5309702Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics
2024-10-08T22:26:30.5310976Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda
2024-10-08T22:26:30.5312256Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks
2024-10-08T22:26:30.5313547Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async
2024-10-08T22:26:30.5314905Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics
2024-10-08T22:26:30.5316376Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks
2024-10-08T22:26:30.5317762Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda
2024-10-08T22:26:30.5319152Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress
2024-10-08T22:26:30.5320445Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress
2024-10-08T22:26:30.5321728Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda
2024-10-08T22:26:30.5323020Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait
2024-10-08T22:26:30.5324289Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics
2024-10-08T22:26:30.5325556Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda
2024-10-08T22:26:30.5326835Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks
2024-10-08T22:26:30.5328075Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress
2024-10-08T22:26:30.5329355Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda
2024-10-08T22:26:30.5330621Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors
2024-10-08T22:26:30.5331824Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics
2024-10-08T22:26:30.5333175Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda
2024-10-08T22:26:30.5334427Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks
2024-10-08T22:26:30.5335716Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input
2024-10-08T22:26:30.5337010Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress
2024-10-08T22:26:30.5338240Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda
2024-10-08T22:26:30.5339548Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor
2024-10-08T22:26:30.5340922Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics
2024-10-08T22:26:30.5342165Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda
2024-10-08T22:26:30.5343389Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks
2024-10-08T22:26:30.5344662Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor
2024-10-08T22:26:30.5346027Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced
2024-10-08T22:26:30.5347341Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress
2024-10-08T22:26:30.5348585Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda
2024-10-08T22:26:30.5349827Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics
2024-10-08T22:26:30.5351079Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda
2024-10-08T22:26:30.5352337Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks
2024-10-08T22:26:30.5353631Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress
2024-10-08T22:26:30.5354888Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda
2024-10-08T22:26:30.5356165Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all
2024-10-08T22:26:30.5357447Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout
2024-10-08T22:26:30.5358764Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics
2024-10-08T22:26:30.5360125Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda
2024-10-08T22:26:30.5361489Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks
2024-10-08T22:26:30.5363009Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched
2024-10-08T22:26:30.5364412Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output
2024-10-08T22:26:30.5365845Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param
2024-10-08T22:26:30.5367369Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module
2024-10-08T22:26:30.5368956Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing
2024-10-08T22:26:30.5370579Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False
2024-10-08T22:26:30.5372224Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True
2024-10-08T22:26:30.5374211Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False
2024-10-08T22:26:30.5376010Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True
2024-10-08T22:26:30.5377717Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False
2024-10-08T22:26:30.5379452Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True
2024-10-08T22:26:30.5381075Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing
2024-10-08T22:26:30.5382747Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False
2024-10-08T22:26:30.5384463Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True
2024-10-08T22:26:30.5386296Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False
2024-10-08T22:26:30.5388030Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True
2024-10-08T22:26:30.5389926Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu
2024-10-08T22:26:30.5391482Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo
2024-10-08T22:26:30.5393166Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once
2024-10-08T22:26:30.5394678Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients
2024-10-08T22:26:30.5396150Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init
2024-10-08T22:26:30.5397649Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type
2024-10-08T22:26:30.5399289Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty
2024-10-08T22:26:30.5401091Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad
2024-10-08T22:26:30.5402715Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view
2024-10-08T22:26:30.5404414Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph
2024-10-08T22:26:30.5406090Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list
2024-10-08T22:26:30.5407809Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list
2024-10-08T22:26:30.5409386Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module
2024-10-08T22:26:30.5410823Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module
2024-10-08T22:26:30.5412263Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module
2024-10-08T22:26:30.5413838Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view
2024-10-08T22:26:30.5415281Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output
2024-10-08T22:26:30.5416743Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters
2024-10-08T22:26:30.5428657Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor
2024-10-08T22:26:30.5430122Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state
2024-10-08T22:26:30.5431561Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint
2024-10-08T22:26:30.5432941Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients
2024-10-08T22:26:30.5434369Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view
2024-10-08T22:26:30.5435844Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input
2024-10-08T22:26:30.5437340Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input
2024-10-08T22:26:30.5438666Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward
2024-10-08T22:26:30.5439856Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer
2024-10-08T22:26:30.5441241Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters
2024-10-08T22:26:30.5442510Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket
2024-10-08T22:26:30.5443734Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket
2024-10-08T22:26:30.5444966Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket
2024-10-08T22:26:30.5446114Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors
2024-10-08T22:26:30.5447247Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu
2024-10-08T22:26:30.5448485Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda
2024-10-08T22:26:30.5449675Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership
2024-10-08T22:26:30.5450840Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group
2024-10-08T22:26:30.5452088Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default
2024-10-08T22:26:30.5453782Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup
2024-10-08T22:26:30.5455082Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo
2024-10-08T22:26:30.5456351Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group
2024-10-08T22:26:30.5457547Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex
2024-10-08T22:26:30.5458699Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch
2024-10-08T22:26:30.5460103Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single
2024-10-08T22:26:30.5461769Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced
2024-10-08T22:26:30.5463424Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced
2024-10-08T22:26:30.5465045Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives
2024-10-08T22:26:30.5466855Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends
2024-10-08T22:26:30.5468686Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend
2024-10-08T22:26:30.5470441Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier
2024-10-08T22:26:30.5471866Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync
2024-10-08T22:26:30.5473145Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg
2024-10-08T22:26:30.5474487Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check
2024-10-08T22:26:30.5475236Z 
2024-10-08T22:26:31.0953010Z Running test batch 'tests to run' cost 7579.44 seconds
2024-10-08T22:26:31.6144869Z 
2024-10-08T22:26:31.6145383Z real	126m24.574s
2024-10-08T22:26:31.6145744Z user	245m12.256s
2024-10-08T22:26:31.6146121Z sys	49m16.319s
2024-10-08T22:26:31.6146411Z + assert_git_not_dirty
2024-10-08T22:26:31.6147389Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]]
2024-10-08T22:26:31.6148386Z + [[ linux-jammy-py3.9-gcc11 != *xla* ]]
2024-10-08T22:26:31.6152888Z ++ git status --porcelain
2024-10-08T22:26:31.6153662Z ++ grep -v '?? third_party'
2024-10-08T22:26:54.9333622Z ++ true
2024-10-08T22:26:54.9336110Z + git_status=
2024-10-08T22:26:54.9336861Z + [[ -n '' ]]
2024-10-08T22:26:54.9337564Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]]
2024-10-08T22:26:54.9338629Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-10-08T22:26:54.9339314Z + [[ 2 == 1 ]]
2024-10-08T22:26:54.9339909Z + cleanup_workspace
2024-10-08T22:26:54.9340972Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.'
2024-10-08T22:26:54.9342246Z sudo may print the following warning message that can be ignored. The chown command will still run.
2024-10-08T22:26:54.9343409Z + echo '    sudo: setrlimit(RLIMIT_STACK): Operation not permitted'
2024-10-08T22:26:54.9344170Z     sudo: setrlimit(RLIMIT_STACK): Operation not permitted
2024-10-08T22:26:54.9345050Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42'
2024-10-08T22:26:54.9346009Z For more details refer to https://github.com/sudo-project/sudo/issues/42
2024-10-08T22:26:54.9346734Z + sudo chown -R 1000 /var/lib/jenkins/workspace
2024-10-08T22:26:57.5972960Z ##[group]Run cat test/**/*_toprint.log || true
2024-10-08T22:26:57.5973499Z cat test/**/*_toprint.log || true
2024-10-08T22:26:57.6007591Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:57.6008119Z env:
2024-10-08T22:26:57.6008382Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:57.6009032Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:57.6009731Z ##[endgroup]
2024-10-08T22:26:57.6098620Z cat: 'test/**/*_toprint.log': No such file or directory
2024-10-08T22:26:57.6135394Z ##[group]Run kill "$MONITOR_SCRIPT_PID"
2024-10-08T22:26:57.6135867Z kill "$MONITOR_SCRIPT_PID"
2024-10-08T22:26:57.6142215Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:57.6142740Z env:
2024-10-08T22:26:57.6143017Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:57.6143666Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:57.6144370Z   MONITOR_SCRIPT_PID: 85975
2024-10-08T22:26:57.6144722Z ##[endgroup]
2024-10-08T22:26:57.6356977Z Prepare all required actions
2024-10-08T22:26:57.6357458Z Getting action download info
2024-10-08T22:26:57.8495201Z Download action repository 'actions/upload-artifact@v3' (SHA:ff15f0306b3f739f7b6fd43fb5d26cd321bd4de5)
2024-10-08T22:26:58.0333691Z ##[group]Run ./.github/actions/upload-test-artifacts
2024-10-08T22:26:58.0334189Z with:
2024-10-08T22:26:58.0334605Z   file-suffix: test-distributed-2-2-linux.2xlarge_31257778946
2024-10-08T22:26:58.0335164Z   s3-bucket: gha-artifacts
2024-10-08T22:26:58.0335487Z env:
2024-10-08T22:26:58.0335750Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.0336385Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.0337084Z ##[endgroup]
2024-10-08T22:26:58.0368642Z ##[group]Run # Remove any previous test jsons if they exist
2024-10-08T22:26:58.0369298Z # Remove any previous test jsons if they exist
2024-10-08T22:26:58.0369829Z rm -f test-jsons-*.zip
2024-10-08T22:26:58.0370405Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json'
2024-10-08T22:26:58.0376956Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:58.0377480Z env:
2024-10-08T22:26:58.0377756Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.0378393Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.0379242Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_31257778946
2024-10-08T22:26:58.0379784Z ##[endgroup]
2024-10-08T22:26:58.0719139Z   adding: test/allowlist_for_publicAPI.json (deflated 79%)
2024-10-08T22:26:58.0748024Z   adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%)
2024-10-08T22:26:58.0749283Z   adding: test/minioptest_failures_dict.json (deflated 70%)
2024-10-08T22:26:58.0755099Z   adding: test/profiler/profiler_utils_mock_events.json (deflated 87%)
2024-10-08T22:26:58.0760690Z   adding: test/slow_tests.json (deflated 82%)
2024-10-08T22:26:58.0767718Z   adding: test/test-reports/td_exclusions-39dac2221430034c21a0.json (deflated 86%)
2024-10-08T22:26:58.0780491Z   adding: test/.pytorch-disabled-tests.json (deflated 88%)
2024-10-08T22:26:58.0813826Z ##[group]Run # Remove any previous test reports if they exist
2024-10-08T22:26:58.0814513Z # Remove any previous test reports if they exist
2024-10-08T22:26:58.0815062Z rm -f test-reports-*.zip
2024-10-08T22:26:58.0815677Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv'
2024-10-08T22:26:58.0821989Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:58.0822510Z env:
2024-10-08T22:26:58.0822788Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.0823457Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.0824305Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_31257778946
2024-10-08T22:26:58.0824842Z ##[endgroup]
2024-10-08T22:26:58.1113394Z   adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor_compile/distributed._tensor.test_dtensor_compile-7df8d9b68f2373b2.xml (deflated 86%)
2024-10-08T22:26:58.1116576Z   adding: test/test-reports/python-pytest/distributed.test_fake_pg/distributed.test_fake_pg-b092c68839a518ad.xml (deflated 82%)
2024-10-08T22:26:58.1122906Z   adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_examples/distributed.tensor.parallel.test_tp_examples-5a5aade034522db0.xml (deflated 89%)
2024-10-08T22:26:58.1140288Z   adding: test/test-reports/python-pytest/distributed._tensor.test_embedding_ops/distributed._tensor.test_embedding_ops-853eafe6e210d087.xml (deflated 67%)
2024-10-08T22:26:58.1146104Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_dedup_tensors/distributed.checkpoint.test_dedup_tensors-e592fa2c94bca7cf.xml (deflated 38%)
2024-10-08T22:26:58.1150854Z   adding: test/test-reports/python-pytest/distributed._tensor.test_tensor_ops/distributed._tensor.test_tensor_ops-b719356e66e4eefe.xml (deflated 85%)
2024-10-08T22:26:58.1155212Z   adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_register_sharding/distributed._tensor.experimental.test_register_sharding-8f9d135589c32da6.xml (deflated 52%)
2024-10-08T22:26:58.1159068Z   adding: test/test-reports/python-pytest/distributed._tensor.test_experimental_ops/distributed._tensor.test_experimental_ops-4886d9b2b0774566.xml (deflated 60%)
2024-10-08T22:26:58.1162869Z   adding: test/test-reports/python-pytest/distributed._tensor.test_redistribute/distributed._tensor.test_redistribute-89b83bf4d1ea9eb6.xml (deflated 82%)
2024-10-08T22:26:58.1168506Z   adding: test/test-reports/python-pytest/distributed._tensor.test_init/distributed._tensor.test_init-29fad259f93d87e5.xml (deflated 74%)
2024-10-08T22:26:58.1172447Z   adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_tp_transform/distributed._tensor.experimental.test_tp_transform-7b434a2226e3cd99.xml (deflated 62%)
2024-10-08T22:26:58.1175986Z   adding: test/test-reports/python-pytest/distributed._tensor.test_api/distributed._tensor.test_api-0ec7a10c79b8ec39.xml (deflated 77%)
2024-10-08T22:26:58.1180461Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_resharding/distributed.checkpoint.test_dtensor_resharding-7c70fd9daccc3797.xml (deflated 80%)
2024-10-08T22:26:58.1185262Z   adding: test/test-reports/python-pytest/distributed._tensor.test_random_ops/distributed._tensor.test_random_ops-8ec43e97c4bd7a2d.xml (deflated 82%)
2024-10-08T22:26:58.1194257Z   adding: test/test-reports/python-pytest/distributed._tools.test_mod_tracker/distributed._tools.test_mod_tracker-6feecce90340c658.xml (deflated 65%)
2024-10-08T22:26:58.1198623Z   adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode_features/distributed._tensor.debug.test_comm_mode_features-f24847a7bb747dab.xml (deflated 66%)
2024-10-08T22:26:58.1200703Z   adding: test/test-reports/python-pytest/distributed._tensor.test_convolution_ops/distributed._tensor.test_convolution_ops-9cb4beb0c2fba5b6.xml (deflated 54%)
2024-10-08T22:26:58.1202784Z   adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_local_map/distributed._tensor.experimental.test_local_map-3d01c372653e65ba.xml (deflated 68%)
2024-10-08T22:26:58.1204738Z   adding: test/test-reports/python-pytest/distributed._tensor.test_math_ops/distributed._tensor.test_math_ops-09b8032d7cb04fea.xml (deflated 81%)
2024-10-08T22:26:58.1206552Z   adding: test/test-reports/python-pytest/distributed._tensor.test_matrix_ops/distributed._tensor.test_matrix_ops-162dba2b251ff55d.xml (deflated 77%)
2024-10-08T22:26:58.1208547Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_dtensor_state_dict/distributed.fsdp.test_fsdp_dtensor_state_dict-ebe7e400f012b5e7.xml (deflated 92%)
2024-10-08T22:26:58.1210608Z   adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fsdp_ep/distributed.checkpoint.e2e.test_fsdp_ep-04ef425ce15ea242.xml (deflated 34%)
2024-10-08T22:26:58.1212670Z   adding: test/test-reports/python-pytest/distributed._composable.test_contract/distributed._composable.test_contract-137a82288173ef43.xml (deflated 69%)
2024-10-08T22:26:58.1214545Z   adding: test/test-reports/python-pytest/distributed._tools.test_mem_tracker/distributed._tools.test_mem_tracker-b25088bd14034992.xml (deflated 65%)
2024-10-08T22:26:58.1216468Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_save_load_api/distributed.checkpoint.test_save_load_api-569e11a83dcbb59e.xml (deflated 44%)
2024-10-08T22:26:58.1218412Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_pipe/distributed.pipelining.test_pipe-5315eee65a3a3b44.xml (deflated 65%)
2024-10-08T22:26:58.1220327Z   adding: test/test-reports/python-pytest/distributed.test_c10d_functional_native/distributed.test_c10d_functional_native-5c62aaf1851166b4.xml (deflated 93%)
2024-10-08T22:26:58.1222157Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fx/distributed.fsdp.test_fsdp_fx-c9578fb4d1e8020e.xml (deflated 37%)
2024-10-08T22:26:58.1224324Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_tensor_ops/distributed._shard.sharded_tensor.ops.test_tensor_ops-177e1b8dd34c787d.xml (deflated 83%)
2024-10-08T22:26:58.1226611Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_binary_cmp/distributed._shard.sharded_tensor.ops.test_binary_cmp-7679495ff4233064.xml (deflated 81%)
2024-10-08T22:26:58.1228792Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_optim_state/distributed.checkpoint.test_fsdp_optim_state-439a44cf10e69764.xml (deflated 65%)
2024-10-08T22:26:58.1230927Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_init/distributed._shard.sharded_tensor.ops.test_init-4fbe67c363dcb09c.xml (deflated 76%)
2024-10-08T22:26:58.1232906Z   adding: test/test-reports/python-pytest/distributed.test_data_parallel/distributed.test_data_parallel-38401b44091195c7.xml (deflated 94%)
2024-10-08T22:26:58.1234918Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_state/distributed._composable.fsdp.test_fully_shard_state-f969e0e699e15be5.xml (deflated 81%)
2024-10-08T22:26:58.1237180Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding/distributed._shard.sharded_tensor.ops.test_embedding-d3f3d6145f0a11d4.xml (deflated 68%)
2024-10-08T22:26:58.1239497Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding_bag/distributed._shard.sharded_tensor.ops.test_embedding_bag-5445380a1e6e2680.xml (deflated 68%)
2024-10-08T22:26:58.1241654Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_microbatch/distributed.pipelining.test_microbatch-e5c50dfde54db5a3.xml (deflated 54%)
2024-10-08T22:26:58.1243767Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-73a2a4324edb65ab.xml (deflated 41%)
2024-10-08T22:26:58.1245850Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-37b77c720f5de82e.xml (deflated 42%)
2024-10-08T22:26:58.1247927Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-482b87d7c477a822.xml (deflated 41%)
2024-10-08T22:26:58.1250008Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bdc96ee9001bc879.xml (deflated 42%)
2024-10-08T22:26:58.1252067Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-69aa2f3e9e8eb3c1.xml (deflated 41%)
2024-10-08T22:26:58.1254222Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-abc2533cdca9883b.xml (deflated 41%)
2024-10-08T22:26:58.1256309Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-dc4528899d4e1c3e.xml (deflated 41%)
2024-10-08T22:26:58.1258378Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2bcdfea5ff2c07a2.xml (deflated 41%)
2024-10-08T22:26:58.1260447Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-99485a4691691382.xml (deflated 43%)
2024-10-08T22:26:58.1262496Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-95dfa973b73ded56.xml (deflated 42%)
2024-10-08T22:26:58.1264557Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-45544a39ca0dc72e.xml (deflated 42%)
2024-10-08T22:26:58.1266676Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-69ea6f61b02120f7.xml (deflated 42%)
2024-10-08T22:26:58.1268742Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-86c9b9d4e1cd6a99.xml (deflated 42%)
2024-10-08T22:26:58.1270785Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-76991d3f583c4724.xml (deflated 42%)
2024-10-08T22:26:58.1272840Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3e3d60e61818f460.xml (deflated 42%)
2024-10-08T22:26:58.1274896Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-bdf6c7b3be3b9934.xml (deflated 42%)
2024-10-08T22:26:58.1276965Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f6199398b98e952d.xml (deflated 42%)
2024-10-08T22:26:58.1279013Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-14359c0ef0bb14fc.xml (deflated 42%)
2024-10-08T22:26:58.1295578Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c4652eb59f0977ea.xml (deflated 42%)
2024-10-08T22:26:58.1299607Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c2550b407ce586f2.xml (deflated 42%)
2024-10-08T22:26:58.1303377Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-557c4de0d03f57ad.xml (deflated 42%)
2024-10-08T22:26:58.1307587Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-040649be3365e850.xml (deflated 42%)
2024-10-08T22:26:58.1311505Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-12c7bf3c2947a6f2.xml (deflated 42%)
2024-10-08T22:26:58.1315417Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-4d5cff7783354de7.xml (deflated 42%)
2024-10-08T22:26:58.1319341Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-05040e71a1658944.xml (deflated 42%)
2024-10-08T22:26:58.1323199Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-18f9524e762434bd.xml (deflated 42%)
2024-10-08T22:26:58.1327116Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-81435856207cd2c6.xml (deflated 42%)
2024-10-08T22:26:58.1331029Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9d9d55e0dd57d140.xml (deflated 42%)
2024-10-08T22:26:58.1335039Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8fe9ce42d721a251.xml (deflated 42%)
2024-10-08T22:26:58.1338973Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-6ab99c0e4c933722.xml (deflated 36%)
2024-10-08T22:26:58.1342013Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f2a625499e3a1f89.xml (deflated 42%)
2024-10-08T22:26:58.1345587Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-35cec106d3f9b354.xml (deflated 42%)
2024-10-08T22:26:58.1347667Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-716572c457bb7ec4.xml (deflated 42%)
2024-10-08T22:26:58.1351393Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-883b02dfcbb74ece.xml (deflated 43%)
2024-10-08T22:26:58.1355113Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-4cf541c240938fc7.xml (deflated 42%)
2024-10-08T22:26:58.1358795Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f56e317ab66f101e.xml (deflated 42%)
2024-10-08T22:26:58.1362668Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c02ade982daa4f4d.xml (deflated 41%)
2024-10-08T22:26:58.1366609Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-456bd9b0f367ef3c.xml (deflated 41%)
2024-10-08T22:26:58.1370180Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a162433a82de64d6.xml (deflated 42%)
2024-10-08T22:26:58.1374172Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ac77a70da5f0da07.xml (deflated 42%)
2024-10-08T22:26:58.1378083Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-491a5dc42f38efab.xml (deflated 42%)
2024-10-08T22:26:58.1381990Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e72dea557bdf9424.xml (deflated 42%)
2024-10-08T22:26:58.1386047Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-75d9a920d455aeb6.xml (deflated 42%)
2024-10-08T22:26:58.1390054Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7392d0f16d4cf77b.xml (deflated 42%)
2024-10-08T22:26:58.1393999Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-330aee04d99d5a75.xml (deflated 41%)
2024-10-08T22:26:58.1397905Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f4c77b7b9027451c.xml (deflated 42%)
2024-10-08T22:26:58.1401822Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-21fb9adc04dce59e.xml (deflated 42%)
2024-10-08T22:26:58.1405738Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-15134172948fbe76.xml (deflated 42%)
2024-10-08T22:26:58.1409624Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-214c2c2647082818.xml (deflated 41%)
2024-10-08T22:26:58.1413606Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9fdbb070076ca26d.xml (deflated 42%)
2024-10-08T22:26:58.1417554Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-8169e2a856392d44.xml (deflated 42%)
2024-10-08T22:26:58.1421908Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-3fa11bcbd19750e4.xml (deflated 42%)
2024-10-08T22:26:58.1425827Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-44d5388a6b823bb8.xml (deflated 41%)
2024-10-08T22:26:58.1429733Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2cf9fca0de89c062.xml (deflated 42%)
2024-10-08T22:26:58.1433803Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-405a2631de871b54.xml (deflated 42%)
2024-10-08T22:26:58.1437710Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-19c01c442e37118c.xml (deflated 42%)
2024-10-08T22:26:58.1441754Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c6c7569dd9eda9b9.xml (deflated 42%)
2024-10-08T22:26:58.1445676Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-50904a8412f9e708.xml (deflated 42%)
2024-10-08T22:26:58.1449585Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a5b2dea1da1fe90f.xml (deflated 42%)
2024-10-08T22:26:58.1453552Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2f440fa0a5877d68.xml (deflated 42%)
2024-10-08T22:26:58.1457427Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-7187255708b57552.xml (deflated 42%)
2024-10-08T22:26:58.1461312Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-af5bb22b1c53957a.xml (deflated 41%)
2024-10-08T22:26:58.1465226Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-604649dcc45cc2d8.xml (deflated 42%)
2024-10-08T22:26:58.1469227Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-dec30ab147507a27.xml (deflated 42%)
2024-10-08T22:26:58.1471517Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a3a70a9feca2f06a.xml (deflated 42%)
2024-10-08T22:26:58.1473861Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9b17f8b334e465fd.xml (deflated 42%)
2024-10-08T22:26:58.1476158Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c191df521e592cdc.xml (deflated 42%)
2024-10-08T22:26:58.1478464Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-b9d2239891f027b5.xml (deflated 42%)
2024-10-08T22:26:58.1480758Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-51cad110d425966d.xml (deflated 42%)
2024-10-08T22:26:58.1483068Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-00834c72651f6aa2.xml (deflated 42%)
2024-10-08T22:26:58.1485372Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f226ddaf2820d60f.xml (deflated 42%)
2024-10-08T22:26:58.1487696Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a626e76b8a88d1bd.xml (deflated 42%)
2024-10-08T22:26:58.1490186Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-60486c0dd9d65dc3.xml (deflated 42%)
2024-10-08T22:26:58.1492615Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f8fb6d3b8f580ba4.xml (deflated 42%)
2024-10-08T22:26:58.1494963Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-e5ad6f039ce87d44.xml (deflated 42%)
2024-10-08T22:26:58.1497647Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-a4b672d4e330f9f4.xml (deflated 42%)
2024-10-08T22:26:58.1500017Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c626e80718f454f3.xml (deflated 42%)
2024-10-08T22:26:58.1502291Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-5e81ace79a83c019.xml (deflated 42%)
2024-10-08T22:26:58.1504539Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-634077c13d33e7e1.xml (deflated 41%)
2024-10-08T22:26:58.1506847Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2c12492cb8918ea2.xml (deflated 41%)
2024-10-08T22:26:58.1509142Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ae0074117b551811.xml (deflated 41%)
2024-10-08T22:26:58.1511447Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f335a52d0d4d66dc.xml (deflated 41%)
2024-10-08T22:26:58.1513754Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c1bdc6df1fbc4073.xml (deflated 41%)
2024-10-08T22:26:58.1516046Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2198b490b7f62d26.xml (deflated 41%)
2024-10-08T22:26:58.1518348Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-2756f3dbfdc6d58b.xml (deflated 41%)
2024-10-08T22:26:58.1520800Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0d9fde65a90552f6.xml (deflated 41%)
2024-10-08T22:26:58.1523109Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-c50aaac063248722.xml (deflated 41%)
2024-10-08T22:26:58.1525406Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-ae78735545d113b4.xml (deflated 41%)
2024-10-08T22:26:58.1527707Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-36cf30368320933c.xml (deflated 41%)
2024-10-08T22:26:58.1530008Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-9e5935922ce7646d.xml (deflated 41%)
2024-10-08T22:26:58.1532405Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-71be35b254fbcd2d.xml (deflated 42%)
2024-10-08T22:26:58.1534744Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-cc3265ad3ca51b72.xml (deflated 41%)
2024-10-08T22:26:58.1537045Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-4528716088586ee7.xml (deflated 41%)
2024-10-08T22:26:58.1539340Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-f8f810efec101140.xml (deflated 41%)
2024-10-08T22:26:58.1541649Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-11cbcd32d0940976.xml (deflated 42%)
2024-10-08T22:26:58.1543948Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-41c8710556348f09.xml (deflated 42%)
2024-10-08T22:26:58.1546355Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-0d971db696f0a0a5.xml (deflated 42%)
2024-10-08T22:26:58.1548658Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-112dba5303b610b9.xml (deflated 43%)
2024-10-08T22:26:58.1550945Z   adding: test/test-reports/python-pytest/distributed.rpc.cuda.test_tensorpipe_agent/distributed.rpc.cuda.test_tensorpipe_agent-40842f5e3751432c.xml (deflated 42%)
2024-10-08T22:26:58.1553414Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_logging/distributed._composable.fsdp.test_fully_shard_logging-026aee892eb30c09.xml (deflated 27%)
2024-10-08T22:26:58.1555788Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0c9b7d0cf00c3493.xml (deflated 35%)
2024-10-08T22:26:58.1557953Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2890dc77a64260af.xml (deflated 36%)
2024-10-08T22:26:58.1559876Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b83257c3ad94a3a.xml (deflated 36%)
2024-10-08T22:26:58.1561802Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6f53313e48e1b125.xml (deflated 35%)
2024-10-08T22:26:58.1563713Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b70ce0272095f4e.xml (deflated 36%)
2024-10-08T22:26:58.1565867Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-840277864aa6bd76.xml (deflated 35%)
2024-10-08T22:26:58.1568922Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-aa775841736c73ba.xml (deflated 36%)
2024-10-08T22:26:58.1570873Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e48e67bc887a2277.xml (deflated 35%)
2024-10-08T22:26:58.1572897Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-83989db123568464.xml (deflated 36%)
2024-10-08T22:26:58.1574819Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2d14936d47b34b5a.xml (deflated 35%)
2024-10-08T22:26:58.1576752Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5ea9c10c134d4c07.xml (deflated 36%)
2024-10-08T22:26:58.1578670Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5dd7d8cdbe326040.xml (deflated 35%)
2024-10-08T22:26:58.1580589Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-27a31d93619c313d.xml (deflated 36%)
2024-10-08T22:26:58.1582516Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14e78de29fb90e2f.xml (deflated 35%)
2024-10-08T22:26:58.1584442Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b67b9f02e79b43a.xml (deflated 36%)
2024-10-08T22:26:58.1586359Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-688e3bd141900eb0.xml (deflated 35%)
2024-10-08T22:26:58.1588273Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-412ad99177561e94.xml (deflated 35%)
2024-10-08T22:26:58.1590423Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-32f569644b992a4c.xml (deflated 35%)
2024-10-08T22:26:58.1592505Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fdbc30e1b33d2343.xml (deflated 36%)
2024-10-08T22:26:58.1594444Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75cd2f415df8a7a6.xml (deflated 35%)
2024-10-08T22:26:58.1596364Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-43a409c8af92ef30.xml (deflated 35%)
2024-10-08T22:26:58.1598280Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ac4b9ee669072988.xml (deflated 36%)
2024-10-08T22:26:58.1600194Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e3e0580d0c8d9ad1.xml (deflated 35%)
2024-10-08T22:26:58.1602100Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9170967e051162b2.xml (deflated 36%)
2024-10-08T22:26:58.1604023Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-545a971a1c089632.xml (deflated 35%)
2024-10-08T22:26:58.1605933Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-843823bcb584ece0.xml (deflated 35%)
2024-10-08T22:26:58.1607842Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9ab91bec1a8bc189.xml (deflated 35%)
2024-10-08T22:26:58.1609760Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-74f56b806b31fbaa.xml (deflated 35%)
2024-10-08T22:26:58.1611749Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f89e9b12d93d211e.xml (deflated 36%)
2024-10-08T22:26:58.1613771Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7db552beaf9626d6.xml (deflated 36%)
2024-10-08T22:26:58.1615695Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-51d0b435f30340ef.xml (deflated 35%)
2024-10-08T22:26:58.1617619Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d82ce13c60ea149e.xml (deflated 35%)
2024-10-08T22:26:58.1619541Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8a53d0962a33d155.xml (deflated 35%)
2024-10-08T22:26:58.1621458Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6cec693d690c9a5b.xml (deflated 35%)
2024-10-08T22:26:58.1623364Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-05250492e8d7060a.xml (deflated 35%)
2024-10-08T22:26:58.1625280Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-262f238e7642ffb7.xml (deflated 35%)
2024-10-08T22:26:58.1627195Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-749a9f08cd9131e1.xml (deflated 36%)
2024-10-08T22:26:58.1629102Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d61ee48173e3efff.xml (deflated 36%)
2024-10-08T22:26:58.1631022Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c08742fbe30415a3.xml (deflated 36%)
2024-10-08T22:26:58.1632920Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b635fd142b771e2d.xml (deflated 35%)
2024-10-08T22:26:58.1634835Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e053a3975a8354c4.xml (deflated 36%)
2024-10-08T22:26:58.1636817Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-59f5976bb17b3db0.xml (deflated 36%)
2024-10-08T22:26:58.1638736Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-89a7e81ce10ed630.xml (deflated 36%)
2024-10-08T22:26:58.1640664Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-807fd3ee8ac41e6d.xml (deflated 36%)
2024-10-08T22:26:58.1642587Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3be3ef566da29ad3.xml (deflated 36%)
2024-10-08T22:26:58.1644510Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f4285d8dfa8e137a.xml (deflated 35%)
2024-10-08T22:26:58.1646427Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-70240655e5bb6d9f.xml (deflated 36%)
2024-10-08T22:26:58.1648338Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a19f47cd869a2078.xml (deflated 36%)
2024-10-08T22:26:58.1650253Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-766434d1643152d8.xml (deflated 35%)
2024-10-08T22:26:58.1652260Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-061634b613ab182e.xml (deflated 35%)
2024-10-08T22:26:58.1654161Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-628a9562ac78340a.xml (deflated 35%)
2024-10-08T22:26:58.1656146Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-101fd7b7c7791a46.xml (deflated 36%)
2024-10-08T22:26:58.1658069Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6ab9ed05a8cad93a.xml (deflated 35%)
2024-10-08T22:26:58.1659999Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d15ccc709d354acb.xml (deflated 35%)
2024-10-08T22:26:58.1661921Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d5959f2ff64103cd.xml (deflated 36%)
2024-10-08T22:26:58.1663829Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-976309e62aef7d98.xml (deflated 35%)
2024-10-08T22:26:58.1665738Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e62f9aabaf212f4e.xml (deflated 36%)
2024-10-08T22:26:58.1667655Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3b0040ffd091e9d2.xml (deflated 38%)
2024-10-08T22:26:58.1669570Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eacad6921abda93b.xml (deflated 35%)
2024-10-08T22:26:58.1671493Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-71d96e8625547816.xml (deflated 35%)
2024-10-08T22:26:58.1673395Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5f1f0b46326ea998.xml (deflated 36%)
2024-10-08T22:26:58.1675293Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5abda710bd29ce89.xml (deflated 35%)
2024-10-08T22:26:58.1677219Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-41cdce521a2b0cbe.xml (deflated 35%)
2024-10-08T22:26:58.1679209Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7dcefbc7f02362bd.xml (deflated 35%)
2024-10-08T22:26:58.1681130Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52aa2b4d15b60366.xml (deflated 35%)
2024-10-08T22:26:58.1683048Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2fbac9ef6cab568f.xml (deflated 36%)
2024-10-08T22:26:58.1684963Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-767bcd708e954e85.xml (deflated 35%)
2024-10-08T22:26:58.1686869Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bac5aca6e28174c1.xml (deflated 36%)
2024-10-08T22:26:58.1689032Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-920c59691f66fb0d.xml (deflated 34%)
2024-10-08T22:26:58.1690979Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-43d4ecae9ab54ccc.xml (deflated 35%)
2024-10-08T22:26:58.1692977Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-de212ff4d2a754e5.xml (deflated 34%)
2024-10-08T22:26:58.1694910Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-deaddd4b23fa1e61.xml (deflated 35%)
2024-10-08T22:26:58.1696823Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ffeddee7d86df044.xml (deflated 34%)
2024-10-08T22:26:58.1698851Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-07b90af6e366dd4d.xml (deflated 36%)
2024-10-08T22:26:58.1700771Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-18bc6591ddd57598.xml (deflated 35%)
2024-10-08T22:26:58.1702695Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b99eea6d27a10f12.xml (deflated 35%)
2024-10-08T22:26:58.1704619Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f6ea87e22bdbef9f.xml (deflated 35%)
2024-10-08T22:26:58.1706533Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3bada6fbb74c5b11.xml (deflated 35%)
2024-10-08T22:26:58.1708438Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f024b61b1f33d02c.xml (deflated 36%)
2024-10-08T22:26:58.1710363Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14f2c7f88d35058e.xml (deflated 34%)
2024-10-08T22:26:58.1712280Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4618315a1a114c3d.xml (deflated 35%)
2024-10-08T22:26:58.1714188Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-25f3c9b10176dedc.xml (deflated 36%)
2024-10-08T22:26:58.1716106Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d06a58e75333e915.xml (deflated 35%)
2024-10-08T22:26:58.1717994Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c62969c9f193f9da.xml (deflated 35%)
2024-10-08T22:26:58.1719912Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9773c1f9ddf8363c.xml (deflated 34%)
2024-10-08T22:26:58.1721830Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-81e0830a153dc578.xml (deflated 34%)
2024-10-08T22:26:58.1723812Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-732b773cb959ca0a.xml (deflated 35%)
2024-10-08T22:26:58.1725729Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ecff553b39132025.xml (deflated 35%)
2024-10-08T22:26:58.1727645Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3eddf4748ddc8202.xml (deflated 35%)
2024-10-08T22:26:58.1729542Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7234fd40b0ec7cd4.xml (deflated 35%)
2024-10-08T22:26:58.1731465Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a0c844e5da88344c.xml (deflated 35%)
2024-10-08T22:26:58.1733472Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f2b052bb94d24037.xml (deflated 35%)
2024-10-08T22:26:58.1735392Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2b33c1718c905eb9.xml (deflated 35%)
2024-10-08T22:26:58.1737307Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d45e9ecad2bbc866.xml (deflated 35%)
2024-10-08T22:26:58.1739212Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6acf84634fbe3559.xml (deflated 35%)
2024-10-08T22:26:58.1741197Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5d19acba6978f326.xml (deflated 35%)
2024-10-08T22:26:58.1743117Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8532864078eecd2f.xml (deflated 35%)
2024-10-08T22:26:58.1745032Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e3977faf8b68656.xml (deflated 34%)
2024-10-08T22:26:58.1746950Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1471daba0ac5b4c8.xml (deflated 35%)
2024-10-08T22:26:58.1748864Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3f842c2ee4e0a8e3.xml (deflated 35%)
2024-10-08T22:26:58.1750774Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b3b7fb151eb8df3.xml (deflated 36%)
2024-10-08T22:26:58.1752693Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-90d654e4c7543243.xml (deflated 36%)
2024-10-08T22:26:58.1754609Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1493b9a1cf14d78d.xml (deflated 55%)
2024-10-08T22:26:58.1756520Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8f1df27e72a2d5b2.xml (deflated 55%)
2024-10-08T22:26:58.1758431Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bed722f75337b934.xml (deflated 35%)
2024-10-08T22:26:58.1760322Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-715782f0c593d362.xml (deflated 37%)
2024-10-08T22:26:58.1762225Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-65ca17105ba75253.xml (deflated 37%)
2024-10-08T22:26:58.1764135Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cef0c54d828da05e.xml (deflated 37%)
2024-10-08T22:26:58.1766117Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-096719080064d025.xml (deflated 36%)
2024-10-08T22:26:58.1768024Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-877d38c900d6aed6.xml (deflated 37%)
2024-10-08T22:26:58.1769931Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-050af0775b506eda.xml (deflated 37%)
2024-10-08T22:26:58.1771835Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f068ec920ec1a592.xml (deflated 37%)
2024-10-08T22:26:58.1773834Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bea4b22551e4c4be.xml (deflated 37%)
2024-10-08T22:26:58.1775766Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d15c8eaabf2738a.xml (deflated 37%)
2024-10-08T22:26:58.1777688Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-518b88037ee76a8f.xml (deflated 36%)
2024-10-08T22:26:58.1779603Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b07b882c8ca64cd.xml (deflated 36%)
2024-10-08T22:26:58.1781508Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-23d318174b2c5613.xml (deflated 37%)
2024-10-08T22:26:58.1783421Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a553ffff0879701b.xml (deflated 36%)
2024-10-08T22:26:58.1785394Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f38d8685595873ca.xml (deflated 37%)
2024-10-08T22:26:58.1787298Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a2075da829cf49ae.xml (deflated 36%)
2024-10-08T22:26:58.1789564Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68d07aea071617f9.xml (deflated 37%)
2024-10-08T22:26:58.1791501Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8e719c2fcc6e14ba.xml (deflated 37%)
2024-10-08T22:26:58.1793408Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fbc754b950eb91a1.xml (deflated 36%)
2024-10-08T22:26:58.1795331Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a34506381feaedb6.xml (deflated 36%)
2024-10-08T22:26:58.1797252Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5ce0d0f79a503cad.xml (deflated 36%)
2024-10-08T22:26:58.1799172Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e275405d3ef8814.xml (deflated 36%)
2024-10-08T22:26:58.1801082Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0dd254397940c389.xml (deflated 35%)
2024-10-08T22:26:58.1802967Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-02217b9110b4a6ef.xml (deflated 36%)
2024-10-08T22:26:58.1804882Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a4671886b0f226fb.xml (deflated 36%)
2024-10-08T22:26:58.1806804Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-564cccdc91c800bc.xml (deflated 36%)
2024-10-08T22:26:58.1808838Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-87c93d219c4c0133.xml (deflated 36%)
2024-10-08T22:26:58.1810760Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-174d6e460aab0c2b.xml (deflated 35%)
2024-10-08T22:26:58.1812758Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-47f4d223b5f0994d.xml (deflated 35%)
2024-10-08T22:26:58.1814658Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dfc21074f28ace10.xml (deflated 35%)
2024-10-08T22:26:58.1816580Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7fa66d4f71db3b8b.xml (deflated 35%)
2024-10-08T22:26:58.1818502Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0506f9e7c6a0d872.xml (deflated 35%)
2024-10-08T22:26:58.1820416Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d822053cc64b8cf8.xml (deflated 35%)
2024-10-08T22:26:58.1822330Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7f6ffd8c4ea51a3.xml (deflated 35%)
2024-10-08T22:26:58.1824231Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-729ed8077f412d7b.xml (deflated 36%)
2024-10-08T22:26:58.1826140Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-32d53040b28d0d39.xml (deflated 35%)
2024-10-08T22:26:58.1828140Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fda7a3017eb2ab2a.xml (deflated 35%)
2024-10-08T22:26:58.1830059Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a5a635c261446f05.xml (deflated 35%)
2024-10-08T22:26:58.1831979Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ce7485df11f7d5da.xml (deflated 36%)
2024-10-08T22:26:58.1833910Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0653de1bb576e11f.xml (deflated 36%)
2024-10-08T22:26:58.1835810Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c153b64e89995faf.xml (deflated 36%)
2024-10-08T22:26:58.1837730Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-adc7af04f2d129f1.xml (deflated 35%)
2024-10-08T22:26:58.1839660Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f7c613d3fbef9a50.xml (deflated 35%)
2024-10-08T22:26:58.1841592Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-66c8e6b5616cce23.xml (deflated 35%)
2024-10-08T22:26:58.1843515Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0fe76068e7773ac7.xml (deflated 35%)
2024-10-08T22:26:58.1845417Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b00c8fe5a33f4a99.xml (deflated 35%)
2024-10-08T22:26:58.1847334Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-be3b887c2b46285b.xml (deflated 35%)
2024-10-08T22:26:58.1849263Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6994b3aacabe5a5c.xml (deflated 36%)
2024-10-08T22:26:58.1851177Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7e95a757ce1370e.xml (deflated 36%)
2024-10-08T22:26:58.1853260Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-47f40f4fb82d4ac6.xml (deflated 35%)
2024-10-08T22:26:58.1855179Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2e6edc912e1e2d46.xml (deflated 35%)
2024-10-08T22:26:58.1857075Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-46885f2bd988f4f6.xml (deflated 36%)
2024-10-08T22:26:58.1858992Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cf8967eab22d5b50.xml (deflated 36%)
2024-10-08T22:26:58.1860915Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2f9e45699a5285ce.xml (deflated 36%)
2024-10-08T22:26:58.1862836Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b9c4d8fbfd1f73f.xml (deflated 35%)
2024-10-08T22:26:58.1864751Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-084ba901216b15c7.xml (deflated 36%)
2024-10-08T22:26:58.1866657Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b72de2dc8693290a.xml (deflated 36%)
2024-10-08T22:26:58.1868579Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-84d02d21ab6b3421.xml (deflated 36%)
2024-10-08T22:26:58.1870505Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7e1bd0aa831f8a5f.xml (deflated 36%)
2024-10-08T22:26:58.1872497Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d8576149bb3b5e4b.xml (deflated 36%)
2024-10-08T22:26:58.1874426Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68255eaad123c481.xml (deflated 36%)
2024-10-08T22:26:58.1876332Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3a9332008e8e567.xml (deflated 36%)
2024-10-08T22:26:58.1878244Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fe1a533f7252e007.xml (deflated 35%)
2024-10-08T22:26:58.1880161Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d0af2bd86715886.xml (deflated 37%)
2024-10-08T22:26:58.1882077Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-64e01a4376a96f36.xml (deflated 36%)
2024-10-08T22:26:58.1883997Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b0a23b27bfdfb7d.xml (deflated 36%)
2024-10-08T22:26:58.1885918Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bd73bd1c9bb9f663.xml (deflated 35%)
2024-10-08T22:26:58.1887823Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c394d80cabff0087.xml (deflated 36%)
2024-10-08T22:26:58.1889969Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-208aa55e29b8f0fb.xml (deflated 35%)
2024-10-08T22:26:58.1891892Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a16c0909aebba38d.xml (deflated 35%)
2024-10-08T22:26:58.1893887Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-96d40911657b990a.xml (deflated 35%)
2024-10-08T22:26:58.1895909Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3e545e5a7ef9d0d.xml (deflated 36%)
2024-10-08T22:26:58.1897818Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-106091b03096dd7f.xml (deflated 35%)
2024-10-08T22:26:58.1899731Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bf1f942f6e103013.xml (deflated 37%)
2024-10-08T22:26:58.1901653Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b40c7074ac3f184.xml (deflated 36%)
2024-10-08T22:26:58.1903565Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-df02776da6951964.xml (deflated 34%)
2024-10-08T22:26:58.1905463Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2466c1679ff13989.xml (deflated 34%)
2024-10-08T22:26:58.1907380Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba82eea9ad643859.xml (deflated 34%)
2024-10-08T22:26:58.1909276Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6e20a440218ca8e7.xml (deflated 34%)
2024-10-08T22:26:58.1911179Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e615be4571740cbb.xml (deflated 35%)
2024-10-08T22:26:58.1913092Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-992aa763cfef9c40.xml (deflated 34%)
2024-10-08T22:26:58.1915100Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3516fb1a5fed5da8.xml (deflated 35%)
2024-10-08T22:26:58.1917018Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8d9f2d0efcd357b3.xml (deflated 34%)
2024-10-08T22:26:58.1918925Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9a2ae9d2d10e6917.xml (deflated 35%)
2024-10-08T22:26:58.1920846Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef450bf7b77f23d6.xml (deflated 35%)
2024-10-08T22:26:58.1922777Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fe760ebb7caae0af.xml (deflated 35%)
2024-10-08T22:26:58.1924702Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b511bd923f6b72c0.xml (deflated 35%)
2024-10-08T22:26:58.1926629Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e3db5bafa3ae3e2.xml (deflated 35%)
2024-10-08T22:26:58.1928556Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d62a574a347a5017.xml (deflated 35%)
2024-10-08T22:26:58.1930452Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4717f38e0787a633.xml (deflated 35%)
2024-10-08T22:26:58.1932438Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5c52fbce73b933a0.xml (deflated 35%)
2024-10-08T22:26:58.1934366Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1e798e8b86769027.xml (deflated 35%)
2024-10-08T22:26:58.1936278Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6213135a7e88ba07.xml (deflated 35%)
2024-10-08T22:26:58.1938263Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-986af310a74d3c22.xml (deflated 35%)
2024-10-08T22:26:58.1940167Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-690b59045789b89d.xml (deflated 36%)
2024-10-08T22:26:58.1942079Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-53941d2c35b08f19.xml (deflated 35%)
2024-10-08T22:26:58.1943995Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8d1c5c45b41aa23d.xml (deflated 35%)
2024-10-08T22:26:58.1945914Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34c7c39d7687c6d0.xml (deflated 35%)
2024-10-08T22:26:58.1947850Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0bee2e0f288a239f.xml (deflated 35%)
2024-10-08T22:26:58.1949768Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40938b6f121f0fde.xml (deflated 35%)
2024-10-08T22:26:58.1951662Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6fd770c0eb1d3a6d.xml (deflated 35%)
2024-10-08T22:26:58.1953571Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-61601b27bbd0aa83.xml (deflated 36%)
2024-10-08T22:26:58.1955489Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-91c5bbf06e696131.xml (deflated 36%)
2024-10-08T22:26:58.1957472Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7681bad2266debfd.xml (deflated 36%)
2024-10-08T22:26:58.1959390Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fe38b4b03651e8ee.xml (deflated 55%)
2024-10-08T22:26:58.1961296Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba5041a8fd5450c0.xml (deflated 36%)
2024-10-08T22:26:58.1963214Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4981ca764aa5e18b.xml (deflated 35%)
2024-10-08T22:26:58.1965135Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67f0dcd5ecbb6ead.xml (deflated 36%)
2024-10-08T22:26:58.1967053Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e9e03c2f0d0e6583.xml (deflated 41%)
2024-10-08T22:26:58.1968982Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bf708480ec85e434.xml (deflated 37%)
2024-10-08T22:26:58.1970902Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3708ef0a7884eff2.xml (deflated 37%)
2024-10-08T22:26:58.1972864Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5ca5f2fad5599979.xml (deflated 37%)
2024-10-08T22:26:58.1974781Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d9f3023348fa689.xml (deflated 37%)
2024-10-08T22:26:58.1976699Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9d9e9984f3ee7529.xml (deflated 37%)
2024-10-08T22:26:58.1978615Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f65e030ff5f766d7.xml (deflated 37%)
2024-10-08T22:26:58.1980534Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fd69e4a9ed2564b6.xml (deflated 37%)
2024-10-08T22:26:58.1982540Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8d29d707543bdce7.xml (deflated 38%)
2024-10-08T22:26:58.1984461Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b022b99a03d6cedb.xml (deflated 36%)
2024-10-08T22:26:58.1986374Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14534399ee03927f.xml (deflated 36%)
2024-10-08T22:26:58.1988294Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5fbdc9105ffcc5bf.xml (deflated 37%)
2024-10-08T22:26:58.1990446Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b834dbbfea4fce7.xml (deflated 36%)
2024-10-08T22:26:58.1992382Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1cc975ba5c96d3aa.xml (deflated 36%)
2024-10-08T22:26:58.1994290Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b7d04176190a113.xml (deflated 36%)
2024-10-08T22:26:58.1996214Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ceb365c4e9fa1178.xml (deflated 36%)
2024-10-08T22:26:58.1998149Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-46c6cd8c5ccb2136.xml (deflated 37%)
2024-10-08T22:26:58.2000061Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7d15b31885bad0ab.xml (deflated 37%)
2024-10-08T22:26:58.2002109Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a850039d53c9080b.xml (deflated 36%)
2024-10-08T22:26:58.2004020Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-742d0a3e4162993f.xml (deflated 37%)
2024-10-08T22:26:58.2005952Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3903ccc5cd4b907e.xml (deflated 37%)
2024-10-08T22:26:58.2007875Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3bde0b2f3889f489.xml (deflated 37%)
2024-10-08T22:26:58.2009795Z   adding: test/test-reports/python-pytest/distributed._composable.test_compose/distributed._composable.test_compose-cdaa920718c1e517.xml (deflated 86%)
2024-10-08T22:26:58.2011499Z   adding: test/test-reports/python-pytest/distributed.test_nccl/distributed.test_nccl-c314ea5456928a09.xml (deflated 28%)
2024-10-08T22:26:58.2013365Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_checkpoint/distributed.checkpoint.test_checkpoint-c7cf3efbfef0eff6.xml (deflated 84%)
2024-10-08T22:26:58.2015528Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_compile/distributed._composable.fsdp.test_fully_shard_compile-28000b2480a36553.xml (deflated 90%)
2024-10-08T22:26:58.2017713Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_backward_prefetch/distributed.fsdp.test_fsdp_backward_prefetch-605e757fcb58999a.xml (deflated 47%)
2024-10-08T22:26:58.2019687Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_overlap/distributed.fsdp.test_fsdp_overlap-ff987bd2b7a5e9bf.xml (deflated 64%)
2024-10-08T22:26:58.2021580Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_pure_fp16/distributed.fsdp.test_fsdp_pure_fp16-4d0c629bb22f120c.xml (deflated 63%)
2024-10-08T22:26:58.2023706Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_autograd/distributed._composable.fsdp.test_fully_shard_autograd-c75596ad7ee60df5.xml (deflated 68%)
2024-10-08T22:26:58.2026116Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_frozen/distributed._composable.fsdp.test_fully_shard_frozen-9eedaf7dad044e6b.xml (deflated 62%)
2024-10-08T22:26:58.2028207Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_optim_state/distributed.fsdp.test_fsdp_optim_state-1c9525aa66037b4d.xml (deflated 96%)
2024-10-08T22:26:58.2030191Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_flatten_params/distributed.fsdp.test_fsdp_flatten_params-50a477a6d08e195f.xml (deflated 84%)
2024-10-08T22:26:58.2032120Z   adding: test/test-reports/python-pytest/distributed.rpc.test_share_memory/distributed.rpc.test_share_memory-e81f3a2a61127bef.xml (deflated 48%)
2024-10-08T22:26:58.2033886Z   adding: test/test-reports/python-pytest/distributed.test_c10d_logger/distributed.test_c10d_logger-f6a8fe421f24fd41.xml (deflated 65%)
2024-10-08T22:26:58.2035773Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_tp_integration/distributed.fsdp.test_fsdp_tp_integration-a49b11024b0cc80f.xml (deflated 72%)
2024-10-08T22:26:58.2037722Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_traversal/distributed.fsdp.test_fsdp_traversal-359ea86bd14f2b15.xml (deflated 46%)
2024-10-08T22:26:58.2039643Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_state_dict/distributed.fsdp.test_fsdp_state_dict-9834ece77cb70217.xml (deflated 97%)
2024-10-08T22:26:58.2041506Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_input/distributed.fsdp.test_fsdp_input-b388931e58532ff8.xml (deflated 64%)
2024-10-08T22:26:58.2043373Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_exec_order/distributed.fsdp.test_fsdp_exec_order-4d7af0260342f19a.xml (deflated 87%)
2024-10-08T22:26:58.2045334Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_uneven/distributed.fsdp.test_fsdp_uneven-a4f0cc5d1075fbd1.xml (deflated 44%)
2024-10-08T22:26:58.2047308Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_multiple_wrapping/distributed.fsdp.test_fsdp_multiple_wrapping-9b4c1c8307a782d1.xml (deflated 47%)
2024-10-08T22:26:58.2049210Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_utils/distributed.fsdp.test_utils-a46a976bec05de55.xml (deflated 70%)
2024-10-08T22:26:58.2051144Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_sharded_grad_scaler/distributed.fsdp.test_fsdp_sharded_grad_scaler-291e371aad47a944.xml (deflated 93%)
2024-10-08T22:26:58.2053254Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fine_tune/distributed.fsdp.test_fsdp_fine_tune-eb6ab696220a6961.xml (deflated 64%)
2024-10-08T22:26:58.2055257Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_multiple_forward/distributed.fsdp.test_fsdp_multiple_forward-9b0d7a40c4a1ad0b.xml (deflated 46%)
2024-10-08T22:26:58.2057202Z   adding: test/test-reports/python-pytest/distributed.test_multi_threaded_pg/distributed.test_multi_threaded_pg-aa9a7d30f1016f62.xml (deflated 81%)
2024-10-08T22:26:58.2059096Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_hybrid_shard/distributed.fsdp.test_fsdp_hybrid_shard-1b85c6b107de2856.xml (deflated 81%)
2024-10-08T22:26:58.2061002Z   adding: test/test-reports/python-pytest/distributed.algorithms.test_join/distributed.algorithms.test_join-06d190be3b5e7df2.xml (deflated 79%)
2024-10-08T22:26:58.2063303Z   adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_optim_checkpoint/distributed._composable.fully_shard.test_fully_shard_optim_checkpoint-6f73d1e5fa1ade98.xml (deflated 67%)
2024-10-08T22:26:58.2065501Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_misc/distributed.fsdp.test_fsdp_misc-daca51d83344c00f.xml (deflated 89%)
2024-10-08T22:26:58.2067298Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_comm/distributed.fsdp.test_fsdp_comm-4fbda113c181e6a6.xml (deflated 88%)
2024-10-08T22:26:58.2069271Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict/distributed.checkpoint.test_state_dict-6f613a722b1498bf.xml (deflated 85%)
2024-10-08T22:26:58.2071156Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-3f78104089ae5b9c.xml (deflated 36%)
2024-10-08T22:26:58.2072976Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-6d93ab0c2e1a5901.xml (deflated 36%)
2024-10-08T22:26:58.2074793Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-051e06183bd8abeb.xml (deflated 36%)
2024-10-08T22:26:58.2076614Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-da0e2665fa6602f5.xml (deflated 36%)
2024-10-08T22:26:58.2078435Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-6687f13625caad5d.xml (deflated 35%)
2024-10-08T22:26:58.2080239Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-90adce5189898571.xml (deflated 36%)
2024-10-08T22:26:58.2082059Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-33c522d87e0177ac.xml (deflated 36%)
2024-10-08T22:26:58.2084681Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-74a4dd41e811c08b.xml (deflated 36%)
2024-10-08T22:26:58.2086531Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-5c544cbf377d4327.xml (deflated 36%)
2024-10-08T22:26:58.2088492Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-deea738c74c73367.xml (deflated 35%)
2024-10-08T22:26:58.2090541Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-e9c57a66ae86d30c.xml (deflated 36%)
2024-10-08T22:26:58.2092445Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-7a5a6acbbfd60b81.xml (deflated 36%)
2024-10-08T22:26:58.2094292Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-d81cb717bbabe2d5.xml (deflated 36%)
2024-10-08T22:26:58.2096128Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-7b8b282acb10a5ae.xml (deflated 36%)
2024-10-08T22:26:58.2097942Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-0c1b583a7d1b3e5d.xml (deflated 36%)
2024-10-08T22:26:58.2099766Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-89e86838c1d19a8f.xml (deflated 36%)
2024-10-08T22:26:58.2101555Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-99440c82c4127217.xml (deflated 36%)
2024-10-08T22:26:58.2103372Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-5dbbf29383c3a7fa.xml (deflated 36%)
2024-10-08T22:26:58.2105192Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-3c05b38c46086dd6.xml (deflated 36%)
2024-10-08T22:26:58.2107017Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-c0f195ff747eea11.xml (deflated 35%)
2024-10-08T22:26:58.2108841Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-e21b2eb2809be4c6.xml (deflated 36%)
2024-10-08T22:26:58.2110643Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-35d4a0481cc01380.xml (deflated 36%)
2024-10-08T22:26:58.2112574Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-506c8342adba838e.xml (deflated 36%)
2024-10-08T22:26:58.2114396Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-37d0367c5cebf567.xml (deflated 35%)
2024-10-08T22:26:58.2116203Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-38060b5216646974.xml (deflated 35%)
2024-10-08T22:26:58.2118005Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-526bbd8abed0090b.xml (deflated 35%)
2024-10-08T22:26:58.2119801Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-e8c768fc6e7b84c8.xml (deflated 35%)
2024-10-08T22:26:58.2121609Z   adding: test/test-reports/python-pytest/distributed.rpc.test_faulty_agent/distributed.rpc.test_faulty_agent-4805b11a407764c9.xml (deflated 36%)
2024-10-08T22:26:58.2123540Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_use_orig_params/distributed.fsdp.test_fsdp_use_orig_params-e41421297625f2f5.xml (deflated 90%)
2024-10-08T22:26:58.2125361Z   adding: test/test-reports/python-pytest/distributed.test_launcher/distributed.test_launcher-5977cb1a42724612.xml (deflated 39%)
2024-10-08T22:26:58.2127010Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-73b9fbadbcc36e5f.xml (deflated 34%)
2024-10-08T22:26:58.2128634Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6427e0b554f3dc7a.xml (deflated 37%)
2024-10-08T22:26:58.2130265Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7ac271219341acdb.xml (deflated 35%)
2024-10-08T22:26:58.2131980Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8b49284ebae371e4.xml (deflated 43%)
2024-10-08T22:26:58.2133733Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-800d9922ac62927d.xml (deflated 36%)
2024-10-08T22:26:58.2135375Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a36a6b8fff369865.xml (deflated 35%)
2024-10-08T22:26:58.2137011Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-595a219861fc86f2.xml (deflated 35%)
2024-10-08T22:26:58.2138623Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f6b88f289aa98707.xml (deflated 35%)
2024-10-08T22:26:58.2140248Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2a1d9000d504824f.xml (deflated 35%)
2024-10-08T22:26:58.2141874Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-93e378a6e9c7dd10.xml (deflated 35%)
2024-10-08T22:26:58.2143501Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-68a7d5e863019378.xml (deflated 42%)
2024-10-08T22:26:58.2145128Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5df99c274df0c41b.xml (deflated 35%)
2024-10-08T22:26:58.2146751Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f47a8bf19698b7c2.xml (deflated 42%)
2024-10-08T22:26:58.2148382Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3d07b77f042e4992.xml (deflated 36%)
2024-10-08T22:26:58.2150011Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cb6b8bfe22f63459.xml (deflated 35%)
2024-10-08T22:26:58.2151639Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-849f3682062d6acb.xml (deflated 35%)
2024-10-08T22:26:58.2153274Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f7cf5021c167cd3f.xml (deflated 35%)
2024-10-08T22:26:58.2154951Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fd48daf3c675662c.xml (deflated 42%)
2024-10-08T22:26:58.2156597Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-409331e1cd16f6b4.xml (deflated 35%)
2024-10-08T22:26:58.2158221Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-679ee2c4f3ebd197.xml (deflated 35%)
2024-10-08T22:26:58.2159845Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-66d40c23cfe99fd9.xml (deflated 43%)
2024-10-08T22:26:58.2161472Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-32f25b17d38ab684.xml (deflated 35%)
2024-10-08T22:26:58.2163088Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-27efc4fa62668f5a.xml (deflated 36%)
2024-10-08T22:26:58.2164718Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-161e3f71a37da7cb.xml (deflated 43%)
2024-10-08T22:26:58.2166339Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fa14855de1712124.xml (deflated 35%)
2024-10-08T22:26:58.2167967Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5cdcc7986caf7ce5.xml (deflated 35%)
2024-10-08T22:26:58.2169593Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fe8a71dd9345b2de.xml (deflated 43%)
2024-10-08T22:26:58.2171210Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fa0f7fba683621c4.xml (deflated 35%)
2024-10-08T22:26:58.2172982Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d452408b98eac57c.xml (deflated 34%)
2024-10-08T22:26:58.2174612Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9ff1e29a797de319.xml (deflated 42%)
2024-10-08T22:26:58.2176248Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c85513b075ecb297.xml (deflated 36%)
2024-10-08T22:26:58.2177873Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2488a1be52181bc7.xml (deflated 35%)
2024-10-08T22:26:58.2179483Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8088df238dc0da2c.xml (deflated 36%)
2024-10-08T22:26:58.2181113Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f1a8cebf05cb72a2.xml (deflated 42%)
2024-10-08T22:26:58.2182737Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-93871b25461f7cc9.xml (deflated 34%)
2024-10-08T22:26:58.2184365Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0f4bdd49e9e8eda4.xml (deflated 35%)
2024-10-08T22:26:58.2185983Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9fba593998e78498.xml (deflated 42%)
2024-10-08T22:26:58.2187592Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d854546028acd504.xml (deflated 35%)
2024-10-08T22:26:58.2189453Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1ba198e4586fb338.xml (deflated 35%)
2024-10-08T22:26:58.2191077Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0b770346f4a72a64.xml (deflated 35%)
2024-10-08T22:26:58.2192701Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-612fa9369a024094.xml (deflated 35%)
2024-10-08T22:26:58.2194324Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e790c194066592ae.xml (deflated 43%)
2024-10-08T22:26:58.2195940Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9a08224eabb9c445.xml (deflated 35%)
2024-10-08T22:26:58.2197679Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0f31dc1feae9e78b.xml (deflated 42%)
2024-10-08T22:26:58.2199311Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ca742700c46af2af.xml (deflated 35%)
2024-10-08T22:26:58.2200936Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9f0341026f240fd8.xml (deflated 36%)
2024-10-08T22:26:58.2202559Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4d3a39f0288acfd0.xml (deflated 47%)
2024-10-08T22:26:58.2204170Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-58ed0d41205686ba.xml (deflated 35%)
2024-10-08T22:26:58.2205806Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0cfb11ac29ea9e7a.xml (deflated 58%)
2024-10-08T22:26:58.2207436Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-abc5c663f3d8b77d.xml (deflated 35%)
2024-10-08T22:26:58.2209061Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-66cd13b02d901f58.xml (deflated 43%)
2024-10-08T22:26:58.2210674Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-40135095a89752d4.xml (deflated 35%)
2024-10-08T22:26:58.2212382Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8582b272b3e9ee43.xml (deflated 42%)
2024-10-08T22:26:58.2214020Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9c110f8892c6d993.xml (deflated 43%)
2024-10-08T22:26:58.2215742Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f7e4eb5a3dc9a9b6.xml (deflated 42%)
2024-10-08T22:26:58.2217381Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b7e3b759dec2d4b5.xml (deflated 42%)
2024-10-08T22:26:58.2219013Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1b3916eec5a263e3.xml (deflated 42%)
2024-10-08T22:26:58.2220627Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-715934fbd7ab9f1b.xml (deflated 42%)
2024-10-08T22:26:58.2222248Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f5df8fc53f478e33.xml (deflated 42%)
2024-10-08T22:26:58.2223876Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b8e446fd6c707087.xml (deflated 41%)
2024-10-08T22:26:58.2225508Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ddc53b09eb3e3602.xml (deflated 42%)
2024-10-08T22:26:58.2227131Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ee1877f730495c9a.xml (deflated 42%)
2024-10-08T22:26:58.2228748Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a9e6ff1f65dc90c8.xml (deflated 42%)
2024-10-08T22:26:58.2230373Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-76cff33c85ae3d87.xml (deflated 42%)
2024-10-08T22:26:58.2232002Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3243f35d1e389b89.xml (deflated 42%)
2024-10-08T22:26:58.2233626Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f3aab27e7c76df0e.xml (deflated 42%)
2024-10-08T22:26:58.2235258Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5a173fee5ce14d7c.xml (deflated 42%)
2024-10-08T22:26:58.2236879Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fc4d9bd424e1c402.xml (deflated 42%)
2024-10-08T22:26:58.2238585Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f4d2cba845fc0873.xml (deflated 36%)
2024-10-08T22:26:58.2240217Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5f8e1c422c8c2a90.xml (deflated 44%)
2024-10-08T22:26:58.2241857Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b7f158329f456ffe.xml (deflated 37%)
2024-10-08T22:26:58.2243481Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e47477bb7b565d61.xml (deflated 36%)
2024-10-08T22:26:58.2245087Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-689bed09ad8d4573.xml (deflated 36%)
2024-10-08T22:26:58.2246712Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1d7266e7ab419d36.xml (deflated 36%)
2024-10-08T22:26:58.2248336Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7cc9fa6682c9cb5c.xml (deflated 45%)
2024-10-08T22:26:58.2249952Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a6b7942024191066.xml (deflated 44%)
2024-10-08T22:26:58.2251581Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7e9636f89cf72f4c.xml (deflated 44%)
2024-10-08T22:26:58.2253304Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b9ed58528f90b603.xml (deflated 43%)
2024-10-08T22:26:58.2254926Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-85239a7af0bdae10.xml (deflated 44%)
2024-10-08T22:26:58.2256615Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-56512b8beb36c479.xml (deflated 44%)
2024-10-08T22:26:58.2258227Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-668890ee623cc168.xml (deflated 44%)
2024-10-08T22:26:58.2259924Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c7fb0a56715bb123.xml (deflated 44%)
2024-10-08T22:26:58.2261531Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-097a765892c0decf.xml (deflated 37%)
2024-10-08T22:26:58.2263152Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ec459993c409cbc4.xml (deflated 36%)
2024-10-08T22:26:58.2264776Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9bbf93e7e6429b50.xml (deflated 36%)
2024-10-08T22:26:58.2266407Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b3c98cbc754a92b4.xml (deflated 36%)
2024-10-08T22:26:58.2268045Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1255455d78fc06e5.xml (deflated 44%)
2024-10-08T22:26:58.2269655Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c80f719a0b83e01d.xml (deflated 35%)
2024-10-08T22:26:58.2271284Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fa0b166fdecbffa5.xml (deflated 44%)
2024-10-08T22:26:58.2272922Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a742ffc82d5809a7.xml (deflated 37%)
2024-10-08T22:26:58.2274540Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-653354e4e349c51f.xml (deflated 36%)
2024-10-08T22:26:58.2276159Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-95bd5e9ce981176b.xml (deflated 42%)
2024-10-08T22:26:58.2277777Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-014b92e0e8bda2ea.xml (deflated 42%)
2024-10-08T22:26:58.2279403Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c119b8e64000017b.xml (deflated 36%)
2024-10-08T22:26:58.2281077Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-442606c54053b8c4.xml (deflated 36%)
2024-10-08T22:26:58.2282698Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1ac98893b2d422b0.xml (deflated 36%)
2024-10-08T22:26:58.2284326Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-05e29193a3660b0c.xml (deflated 37%)
2024-10-08T22:26:58.2285937Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-223d0dace8f3fb59.xml (deflated 36%)
2024-10-08T22:26:58.2287563Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dd541973a904ca6d.xml (deflated 37%)
2024-10-08T22:26:58.2289399Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f551309b88800b0e.xml (deflated 36%)
2024-10-08T22:26:58.2291037Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e69b22cc1e002cd0.xml (deflated 36%)
2024-10-08T22:26:58.2292734Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cfe4d8d5f0627d97.xml (deflated 44%)
2024-10-08T22:26:58.2294351Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6a38def5c5df76f7.xml (deflated 44%)
2024-10-08T22:26:58.2295971Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9577e03feccb7f79.xml (deflated 44%)
2024-10-08T22:26:58.2297583Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f5927404f909034b.xml (deflated 43%)
2024-10-08T22:26:58.2299314Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-604f9d1a5fa9dc53.xml (deflated 43%)
2024-10-08T22:26:58.2300945Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-449e9d003d8992fe.xml (deflated 43%)
2024-10-08T22:26:58.2302553Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b1b25c690b504be0.xml (deflated 43%)
2024-10-08T22:26:58.2304181Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-62364cc63006f9c7.xml (deflated 43%)
2024-10-08T22:26:58.2305803Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d274a52fceba99e.xml (deflated 43%)
2024-10-08T22:26:58.2307423Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-80ec0b95211a48b4.xml (deflated 34%)
2024-10-08T22:26:58.2309044Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1a1efe51bdf8e269.xml (deflated 34%)
2024-10-08T22:26:58.2310656Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-31f008e17ffe0451.xml (deflated 34%)
2024-10-08T22:26:58.2312271Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-213218706b00fe2f.xml (deflated 35%)
2024-10-08T22:26:58.2313884Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-138dd2eb49f48e97.xml (deflated 34%)
2024-10-08T22:26:58.2315509Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cfc99d1a0e9aca16.xml (deflated 34%)
2024-10-08T22:26:58.2317140Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c80631fec952f1e0.xml (deflated 34%)
2024-10-08T22:26:58.2318749Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b09ec24edfd02060.xml (deflated 34%)
2024-10-08T22:26:58.2320378Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-306107430fe437fa.xml (deflated 34%)
2024-10-08T22:26:58.2322071Z   adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-21d608a189528ab6.xml (deflated 34%)
2024-10-08T22:26:58.2323781Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-819ef049bad59c22.xml (deflated 43%)
2024-10-08T22:26:58.2325561Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4e0d9fd84df659d0.xml (deflated 43%)
2024-10-08T22:26:58.2327321Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ca5437857093bdc.xml (deflated 37%)
2024-10-08T22:26:58.2329100Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-508fb660572ab9ce.xml (deflated 37%)
2024-10-08T22:26:58.2330867Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2c775211ebe62054.xml (deflated 41%)
2024-10-08T22:26:58.2332712Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88826fc84b790a8b.xml (deflated 41%)
2024-10-08T22:26:58.2334479Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65751803ea474851.xml (deflated 40%)
2024-10-08T22:26:58.2336231Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c8d0dd8369a210ef.xml (deflated 42%)
2024-10-08T22:26:58.2337998Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-112a1a5a70efa299.xml (deflated 36%)
2024-10-08T22:26:58.2339763Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eac2138ae0664f60.xml (deflated 35%)
2024-10-08T22:26:58.2341629Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a5065d1cba5c83e9.xml (deflated 35%)
2024-10-08T22:26:58.2343403Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5a341cfb23f668f.xml (deflated 36%)
2024-10-08T22:26:58.2345174Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de6aa53bec9e2619.xml (deflated 43%)
2024-10-08T22:26:58.2346926Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f195fb87ab0f32db.xml (deflated 45%)
2024-10-08T22:26:58.2348705Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10999924f21834ae.xml (deflated 35%)
2024-10-08T22:26:58.2350473Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cee50b7a9e3b1c68.xml (deflated 35%)
2024-10-08T22:26:58.2352251Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc9e34dfe70662c4.xml (deflated 35%)
2024-10-08T22:26:58.2354022Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88c023284b0af850.xml (deflated 35%)
2024-10-08T22:26:58.2355772Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-53b7b3f1587f1016.xml (deflated 35%)
2024-10-08T22:26:58.2357537Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02b3a1dd1d311212.xml (deflated 35%)
2024-10-08T22:26:58.2359297Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7d50317af99a931.xml (deflated 35%)
2024-10-08T22:26:58.2361065Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c206f8cf6eff50c1.xml (deflated 35%)
2024-10-08T22:26:58.2362819Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-916399d76141c1f5.xml (deflated 35%)
2024-10-08T22:26:58.2364629Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f33fca032263d26.xml (deflated 36%)
2024-10-08T22:26:58.2366677Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc887ec3802f6bcc.xml (deflated 35%)
2024-10-08T22:26:58.2368457Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dbcffab3f9ed364c.xml (deflated 35%)
2024-10-08T22:26:58.2370236Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a7b41c8fafe2427.xml (deflated 36%)
2024-10-08T22:26:58.2372010Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7454716dbd61ebd.xml (deflated 35%)
2024-10-08T22:26:58.2373875Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e170c33ff903c63.xml (deflated 35%)
2024-10-08T22:26:58.2375631Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00afe99f58677f48.xml (deflated 36%)
2024-10-08T22:26:58.2377406Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0cc25196ec207de5.xml (deflated 36%)
2024-10-08T22:26:58.2379167Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e0f17f9ae019678f.xml (deflated 35%)
2024-10-08T22:26:58.2380926Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9395f2b66537cb49.xml (deflated 42%)
2024-10-08T22:26:58.2382749Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7378286d80177f09.xml (deflated 43%)
2024-10-08T22:26:58.2384491Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3a115ae76d023b6a.xml (deflated 43%)
2024-10-08T22:26:58.2406323Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-06dc2b2ba2c5cf6b.xml (deflated 43%)
2024-10-08T22:26:58.2408124Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bbc8bba209aa8f96.xml (deflated 44%)
2024-10-08T22:26:58.2409888Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b02237162f45ec3.xml (deflated 44%)
2024-10-08T22:26:58.2411636Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7be6aa198128c426.xml (deflated 44%)
2024-10-08T22:26:58.2413502Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-42ebf620cce9a880.xml (deflated 44%)
2024-10-08T22:26:58.2415256Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c8b1aee1397350b.xml (deflated 44%)
2024-10-08T22:26:58.2417008Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9692c3ec60b4ba4c.xml (deflated 44%)
2024-10-08T22:26:58.2418763Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17c2b4e46a64e255.xml (deflated 43%)
2024-10-08T22:26:58.2420516Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d253dcf0a0ef8847.xml (deflated 36%)
2024-10-08T22:26:58.2422263Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1902fb5acc63c878.xml (deflated 42%)
2024-10-08T22:26:58.2424010Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-08baaa6f8d7ec3f5.xml (deflated 42%)
2024-10-08T22:26:58.2425981Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee7fa1c9bed58bbb.xml (deflated 35%)
2024-10-08T22:26:58.2427750Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9ba22f5055d5e33d.xml (deflated 35%)
2024-10-08T22:26:58.2429520Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c96fd5737b0e5fbf.xml (deflated 42%)
2024-10-08T22:26:58.2431358Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a8f6e158de00b93.xml (deflated 42%)
2024-10-08T22:26:58.2433153Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-942cb3320730aae6.xml (deflated 35%)
2024-10-08T22:26:58.2434920Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e4993de505adbd8.xml (deflated 47%)
2024-10-08T22:26:58.2436682Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d44d124c63171479.xml (deflated 47%)
2024-10-08T22:26:58.2438438Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-205e9ee995af3566.xml (deflated 47%)
2024-10-08T22:26:58.2440203Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe3d8c8a86f491f3.xml (deflated 42%)
2024-10-08T22:26:58.2441968Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43701eb270cf64da.xml (deflated 42%)
2024-10-08T22:26:58.2443724Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6b8da8ac336781f4.xml (deflated 56%)
2024-10-08T22:26:58.2445578Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e6b7f0935d4fcca0.xml (deflated 42%)
2024-10-08T22:26:58.2447352Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6044451793fd8db4.xml (deflated 36%)
2024-10-08T22:26:58.2449111Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc5e4dd73b912e00.xml (deflated 42%)
2024-10-08T22:26:58.2450886Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a86454003fb2ccd0.xml (deflated 42%)
2024-10-08T22:26:58.2452736Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3d1a0fab69271e05.xml (deflated 42%)
2024-10-08T22:26:58.2454519Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b88e7126e51cfeff.xml (deflated 35%)
2024-10-08T22:26:58.2456298Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1e59ba1260401ce.xml (deflated 42%)
2024-10-08T22:26:58.2458078Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-49a8227a86699f70.xml (deflated 43%)
2024-10-08T22:26:58.2459840Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2fc8411b2c7955b3.xml (deflated 42%)
2024-10-08T22:26:58.2461596Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1056d609276c72ee.xml (deflated 42%)
2024-10-08T22:26:58.2463372Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1c5fe4ba44b6a025.xml (deflated 42%)
2024-10-08T22:26:58.2465152Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b30a8056f028abc3.xml (deflated 42%)
2024-10-08T22:26:58.2466949Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d7df5b9bdffb645.xml (deflated 44%)
2024-10-08T22:26:58.2468841Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3da02fe9ad31c8a.xml (deflated 42%)
2024-10-08T22:26:58.2470628Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee3ba225d100c4b9.xml (deflated 43%)
2024-10-08T22:26:58.2472414Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-59cbb35ad30ca3a6.xml (deflated 43%)
2024-10-08T22:26:58.2474196Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98432da8309c0dc8.xml (deflated 35%)
2024-10-08T22:26:58.2475966Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7834163f677e495.xml (deflated 36%)
2024-10-08T22:26:58.2477744Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-359475364b0b2e99.xml (deflated 42%)
2024-10-08T22:26:58.2479525Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1b0efd5bcd82fb09.xml (deflated 36%)
2024-10-08T22:26:58.2481297Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-16f80a63d783a951.xml (deflated 35%)
2024-10-08T22:26:58.2483064Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d011c682f36e79b6.xml (deflated 42%)
2024-10-08T22:26:58.2484834Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bf3264ba4d5f96e4.xml (deflated 36%)
2024-10-08T22:26:58.2486629Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ccdb0acbc95b309.xml (deflated 35%)
2024-10-08T22:26:58.2488497Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7020e8e2ecff6963.xml (deflated 36%)
2024-10-08T22:26:58.2490545Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4581181c4bceeb10.xml (deflated 35%)
2024-10-08T22:26:58.2492399Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65c34b627b149d17.xml (deflated 35%)
2024-10-08T22:26:58.2494176Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d499fa735f3b3885.xml (deflated 45%)
2024-10-08T22:26:58.2495937Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ed46354274ed8c35.xml (deflated 43%)
2024-10-08T22:26:58.2497714Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-903d33907d544342.xml (deflated 43%)
2024-10-08T22:26:58.2499469Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e06d9c0a0bcc9bf.xml (deflated 43%)
2024-10-08T22:26:58.2501251Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a102a062d5090e3d.xml (deflated 56%)
2024-10-08T22:26:58.2503013Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b65a8e4617bad53.xml (deflated 35%)
2024-10-08T22:26:58.2504785Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f3d68fc20d4623c3.xml (deflated 35%)
2024-10-08T22:26:58.2506555Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ea24e2678bc022d6.xml (deflated 37%)
2024-10-08T22:26:58.2508338Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3aad3dec428c5ae5.xml (deflated 36%)
2024-10-08T22:26:58.2510095Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72f99adb65b13ca6.xml (deflated 43%)
2024-10-08T22:26:58.2512025Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39dd9caf07d6ff39.xml (deflated 43%)
2024-10-08T22:26:58.2513809Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9dbb8757c779c66c.xml (deflated 41%)
2024-10-08T22:26:58.2515579Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f6e1a982849ab458.xml (deflated 42%)
2024-10-08T22:26:58.2517354Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e50c4615c07e91e.xml (deflated 42%)
2024-10-08T22:26:58.2519116Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3ce71f5f26b237c.xml (deflated 35%)
2024-10-08T22:26:58.2520910Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc5fd4a403772dc5.xml (deflated 36%)
2024-10-08T22:26:58.2522685Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-735d0587b8319ea9.xml (deflated 35%)
2024-10-08T22:26:58.2524452Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bac803202989391.xml (deflated 43%)
2024-10-08T22:26:58.2526220Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f23fad1a219a33c1.xml (deflated 43%)
2024-10-08T22:26:58.2527972Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-12bec8e0023a04a6.xml (deflated 43%)
2024-10-08T22:26:58.2529842Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f90c01dd9212dcee.xml (deflated 37%)
2024-10-08T22:26:58.2531625Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1f49df774b6bfa79.xml (deflated 36%)
2024-10-08T22:26:58.2533492Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4844e75bccca2cfb.xml (deflated 41%)
2024-10-08T22:26:58.2535273Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cc66e5abb5d04ba8.xml (deflated 41%)
2024-10-08T22:26:58.2537033Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fbfc6ed177e28171.xml (deflated 40%)
2024-10-08T22:26:58.2538802Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-da05b61578d4a3f5.xml (deflated 41%)
2024-10-08T22:26:58.2540579Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb676a6ee109e53f.xml (deflated 36%)
2024-10-08T22:26:58.2542338Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57d9a28c46ea08f4.xml (deflated 35%)
2024-10-08T22:26:58.2544108Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70e056b8f8a61645.xml (deflated 35%)
2024-10-08T22:26:58.2545870Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aa72f1f58f91f30f.xml (deflated 36%)
2024-10-08T22:26:58.2547620Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-087adbf86f370765.xml (deflated 43%)
2024-10-08T22:26:58.2549383Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6cf1d7b32a123527.xml (deflated 45%)
2024-10-08T22:26:58.2551151Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ec09c05fe407a96.xml (deflated 35%)
2024-10-08T22:26:58.2553001Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80b8d36af762799f.xml (deflated 35%)
2024-10-08T22:26:58.2554764Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d6277239550cee10.xml (deflated 35%)
2024-10-08T22:26:58.2556516Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5a5bb81631fca6ab.xml (deflated 35%)
2024-10-08T22:26:58.2558295Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-022cbe3b33c2dcad.xml (deflated 36%)
2024-10-08T22:26:58.2560063Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6646592eab9d4edf.xml (deflated 36%)
2024-10-08T22:26:58.2561833Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9fc7d89a80a5eab6.xml (deflated 35%)
2024-10-08T22:26:58.2563609Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-177d528fd11f3a6a.xml (deflated 35%)
2024-10-08T22:26:58.2565351Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-996a8e69841cb660.xml (deflated 35%)
2024-10-08T22:26:58.2567106Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e587bb9a16d0b2b3.xml (deflated 36%)
2024-10-08T22:26:58.2568878Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2cd9f68a021b65f5.xml (deflated 35%)
2024-10-08T22:26:58.2570649Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-12aa7fb87998a839.xml (deflated 36%)
2024-10-08T22:26:58.2572601Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8fa402bb9df1cd32.xml (deflated 35%)
2024-10-08T22:26:58.2574474Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c299b289af74bfb7.xml (deflated 35%)
2024-10-08T22:26:58.2576312Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fd5b9bb3773eb0b6.xml (deflated 36%)
2024-10-08T22:26:58.2578104Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c9ab48e69ec2a350.xml (deflated 35%)
2024-10-08T22:26:58.2579873Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e20ee71940e8b2c.xml (deflated 36%)
2024-10-08T22:26:58.2581633Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-68bfc4e3374d9930.xml (deflated 35%)
2024-10-08T22:26:58.2583409Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-220c2d3e4b96a511.xml (deflated 42%)
2024-10-08T22:26:58.2585186Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ce9b574ae0f3ec9.xml (deflated 43%)
2024-10-08T22:26:58.2586950Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f7d103708ddbfb52.xml (deflated 43%)
2024-10-08T22:26:58.2588949Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d851ee527af2b245.xml (deflated 44%)
2024-10-08T22:26:58.2590728Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-716130cc5bb3fb81.xml (deflated 44%)
2024-10-08T22:26:58.2592500Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e896ce6d62ca75d5.xml (deflated 44%)
2024-10-08T22:26:58.2594283Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d49be955d263eb1f.xml (deflated 44%)
2024-10-08T22:26:58.2596163Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3bbb2729e0ae078.xml (deflated 45%)
2024-10-08T22:26:58.2597938Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc73ef84d16510cc.xml (deflated 44%)
2024-10-08T22:26:58.2599716Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d68d6b94a9aeae57.xml (deflated 44%)
2024-10-08T22:26:58.2601481Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4c5f449ba2d18114.xml (deflated 42%)
2024-10-08T22:26:58.2603252Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c620b25a4417c16b.xml (deflated 35%)
2024-10-08T22:26:58.2605011Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c512a7517c28c96b.xml (deflated 42%)
2024-10-08T22:26:58.2606787Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bd015a7b83449f90.xml (deflated 42%)
2024-10-08T22:26:58.2608549Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b1c2ac5707312ef.xml (deflated 36%)
2024-10-08T22:26:58.2610317Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9f1a32819e8cf40a.xml (deflated 35%)
2024-10-08T22:26:58.2612086Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4f712ab0ad6366fc.xml (deflated 42%)
2024-10-08T22:26:58.2613944Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8bbd7f0ccb42d875.xml (deflated 42%)
2024-10-08T22:26:58.2615805Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e8562ce3b38fbc01.xml (deflated 35%)
2024-10-08T22:26:58.2617584Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-24cc3b20f5a04cec.xml (deflated 47%)
2024-10-08T22:26:58.2619351Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e4c236090dc85d9.xml (deflated 47%)
2024-10-08T22:26:58.2621128Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-842c1afb364bb880.xml (deflated 47%)
2024-10-08T22:26:58.2622899Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cac025f59c656c5c.xml (deflated 42%)
2024-10-08T22:26:58.2624652Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d437842cfeb63ce1.xml (deflated 42%)
2024-10-08T22:26:58.2626427Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-985e8c378e9bf5c9.xml (deflated 56%)
2024-10-08T22:26:58.2628197Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-95cd7ffc100a19dc.xml (deflated 42%)
2024-10-08T22:26:58.2629969Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-efc1e076bf5be2f8.xml (deflated 36%)
2024-10-08T22:26:58.2631743Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-169b7e078cb47ee2.xml (deflated 42%)
2024-10-08T22:26:58.2633499Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09419623f02b956d.xml (deflated 42%)
2024-10-08T22:26:58.2635268Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ffb11287c0a3119.xml (deflated 42%)
2024-10-08T22:26:58.2637031Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5216134c2865867.xml (deflated 35%)
2024-10-08T22:26:58.2638857Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25da7ad3e77a5ad6.xml (deflated 42%)
2024-10-08T22:26:58.2640626Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6b589e9033905a30.xml (deflated 43%)
2024-10-08T22:26:58.2642382Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c4fc3ef5f478ebd.xml (deflated 43%)
2024-10-08T22:26:58.2644149Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bcb84b0b54420141.xml (deflated 42%)
2024-10-08T22:26:58.2645929Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cf293be6fcbd559e.xml (deflated 42%)
2024-10-08T22:26:58.2647699Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-466599209b5bc716.xml (deflated 42%)
2024-10-08T22:26:58.2649485Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d6ae6b5c95b2786b.xml (deflated 44%)
2024-10-08T22:26:58.2651248Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-355086f825e35e68.xml (deflated 42%)
2024-10-08T22:26:58.2653072Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3344b57f8b19b960.xml (deflated 43%)
2024-10-08T22:26:58.2654841Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aa51233b0a4ec3c0.xml (deflated 43%)
2024-10-08T22:26:58.2656688Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c6b9f84c855ff6e2.xml (deflated 36%)
2024-10-08T22:26:58.2658455Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1c0e09864dc39de.xml (deflated 36%)
2024-10-08T22:26:58.2660223Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6871e80d2a16039a.xml (deflated 42%)
2024-10-08T22:26:58.2661971Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cfcd3512a7d68ff5.xml (deflated 35%)
2024-10-08T22:26:58.2663747Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca1197e2b74077b7.xml (deflated 36%)
2024-10-08T22:26:58.2665526Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-824d0b3fc6ed804f.xml (deflated 42%)
2024-10-08T22:26:58.2667305Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7139e1d4cad515ad.xml (deflated 36%)
2024-10-08T22:26:58.2669077Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-87351d13f3fa1770.xml (deflated 35%)
2024-10-08T22:26:58.2670836Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a85731b27b1b779.xml (deflated 36%)
2024-10-08T22:26:58.2672601Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3cb3b6c3e4f171f4.xml (deflated 35%)
2024-10-08T22:26:58.2674383Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a412daac6378fae0.xml (deflated 36%)
2024-10-08T22:26:58.2676170Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7cbd1bbcd73506c2.xml (deflated 44%)
2024-10-08T22:26:58.2677960Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02797cb6e72315f7.xml (deflated 43%)
2024-10-08T22:26:58.2679825Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e0ddb9b3062f2ed7.xml (deflated 43%)
2024-10-08T22:26:58.2681648Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2fbfd8b6d1f37e9.xml (deflated 43%)
2024-10-08T22:26:58.2683446Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b0ab0963883fb410.xml (deflated 56%)
2024-10-08T22:26:58.2685230Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-888b20bf0d683da0.xml (deflated 36%)
2024-10-08T22:26:58.2686996Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-11314a29e615740d.xml (deflated 35%)
2024-10-08T22:26:58.2689010Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aa3e043fce9c17a1.xml (deflated 36%)
2024-10-08T22:26:58.2690786Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a1a12f5184a2b413.xml (deflated 36%)
2024-10-08T22:26:58.2692630Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-918d98094d43c9ad.xml (deflated 43%)
2024-10-08T22:26:58.2694395Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b28988425d114ffb.xml (deflated 43%)
2024-10-08T22:26:58.2696168Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a871830cf4fdf2b4.xml (deflated 41%)
2024-10-08T22:26:58.2697935Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c2118aa6958595b2.xml (deflated 41%)
2024-10-08T22:26:58.2699826Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ce9aa599ec9d748c.xml (deflated 42%)
2024-10-08T22:26:58.2701616Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c0a052a00e2ad81.xml (deflated 35%)
2024-10-08T22:26:58.2703389Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e9b57b60a1e13b3e.xml (deflated 35%)
2024-10-08T22:26:58.2705174Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a5d10639bb84d2b0.xml (deflated 35%)
2024-10-08T22:26:58.2706953Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c055bdaec8957c3f.xml (deflated 44%)
2024-10-08T22:26:58.2708723Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c81e5a4d4fafaacb.xml (deflated 36%)
2024-10-08T22:26:58.2710496Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a7ac291b44e937e9.xml (deflated 41%)
2024-10-08T22:26:58.2712270Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-467c7144b6abb3e6.xml (deflated 42%)
2024-10-08T22:26:58.2714029Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-81df236755319e62.xml (deflated 42%)
2024-10-08T22:26:58.2715797Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2dcd62b7fa2b5df0.xml (deflated 35%)
2024-10-08T22:26:58.2717546Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74529a7cd5e0ca03.xml (deflated 36%)
2024-10-08T22:26:58.2719310Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c850fdb0655cbbd.xml (deflated 35%)
2024-10-08T22:26:58.2721089Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3e705869fbda760.xml (deflated 35%)
2024-10-08T22:26:58.2722937Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17682a607bf26e14.xml (deflated 35%)
2024-10-08T22:26:58.2724725Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58bbb8cd7a48caf7.xml (deflated 45%)
2024-10-08T22:26:58.2726504Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-baacc6ca88ca4596.xml (deflated 36%)
2024-10-08T22:26:58.2728270Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ca9bff867b9c85d.xml (deflated 35%)
2024-10-08T22:26:58.2730045Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-40bae693e35703d9.xml (deflated 36%)
2024-10-08T22:26:58.2731815Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3854f624a9459d37.xml (deflated 35%)
2024-10-08T22:26:58.2733679Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc89ae50afc55528.xml (deflated 36%)
2024-10-08T22:26:58.2735457Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9aa300b098bcb998.xml (deflated 35%)
2024-10-08T22:26:58.2737217Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5dedde3bd0d1cb8d.xml (deflated 35%)
2024-10-08T22:26:58.2739003Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dcfd422e82a4461d.xml (deflated 42%)
2024-10-08T22:26:58.2740780Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5f744dcdb50edae0.xml (deflated 43%)
2024-10-08T22:26:58.2742643Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8a36163c2e9daa97.xml (deflated 44%)
2024-10-08T22:26:58.2744422Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0dcaa936bb46afd9.xml (deflated 44%)
2024-10-08T22:26:58.2746185Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e8f36e7bf29fb029.xml (deflated 44%)
2024-10-08T22:26:58.2747954Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a0ff925b8f2f38a.xml (deflated 45%)
2024-10-08T22:26:58.2749731Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ca8a3e0abbe7ad8.xml (deflated 42%)
2024-10-08T22:26:58.2751507Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b6d91677ffb44d1f.xml (deflated 35%)
2024-10-08T22:26:58.2753269Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6b8167796704f4e0.xml (deflated 42%)
2024-10-08T22:26:58.2755025Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-91ff8bc7b4bd0c0e.xml (deflated 35%)
2024-10-08T22:26:58.2756790Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c4601db8da72e90.xml (deflated 36%)
2024-10-08T22:26:58.2758560Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0af06bb36a2e9ebf.xml (deflated 42%)
2024-10-08T22:26:58.2760337Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4eaf00776880ae01.xml (deflated 42%)
2024-10-08T22:26:58.2762112Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8fbc0a5efa287df.xml (deflated 42%)
2024-10-08T22:26:58.2763893Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1bce872bc898482e.xml (deflated 35%)
2024-10-08T22:26:58.2765721Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad1e1854e593f580.xml (deflated 41%)
2024-10-08T22:26:58.2767496Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2015a05614e63e3c.xml (deflated 42%)
2024-10-08T22:26:58.2769275Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-81d5cf4192c0b14f.xml (deflated 42%)
2024-10-08T22:26:58.2771050Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5f23491f6d9f1e3f.xml (deflated 42%)
2024-10-08T22:26:58.2772906Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0b4ca084d15c4737.xml (deflated 42%)
2024-10-08T22:26:58.2774657Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a904ed83f795e0e.xml (deflated 42%)
2024-10-08T22:26:58.2776428Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-080db567d6fd09e8.xml (deflated 43%)
2024-10-08T22:26:58.2778194Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10b74dff64950c34.xml (deflated 42%)
2024-10-08T22:26:58.2779965Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc18b03429054893.xml (deflated 41%)
2024-10-08T22:26:58.2781734Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2bb4ec40c23b4f4.xml (deflated 42%)
2024-10-08T22:26:58.2783581Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-299d4f437290c090.xml (deflated 42%)
2024-10-08T22:26:58.2785340Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d53dc4255a1dba11.xml (deflated 43%)
2024-10-08T22:26:58.2787110Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a0535dbcb3421654.xml (deflated 56%)
2024-10-08T22:26:58.2789178Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e271cf49ff92a737.xml (deflated 43%)
2024-10-08T22:26:58.2790961Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a7b9c51f0978d737.xml (deflated 42%)
2024-10-08T22:26:58.2792721Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7baab615d25ae37d.xml (deflated 42%)
2024-10-08T22:26:58.2794500Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5debab4da52c4860.xml (deflated 42%)
2024-10-08T22:26:58.2796283Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-813f11d8f3b139ab.xml (deflated 42%)
2024-10-08T22:26:58.2798045Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-522d0210d53ed958.xml (deflated 42%)
2024-10-08T22:26:58.2799810Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3a298c58926702bf.xml (deflated 42%)
2024-10-08T22:26:58.2801566Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bd7756f11373ecb2.xml (deflated 42%)
2024-10-08T22:26:58.2803325Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a031c6a7ae807159.xml (deflated 43%)
2024-10-08T22:26:58.2805095Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ab5c8bc854357e13.xml (deflated 43%)
2024-10-08T22:26:58.2806973Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc5be2896be008dd.xml (deflated 42%)
2024-10-08T22:26:58.2808743Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-254a80fe6d986967.xml (deflated 35%)
2024-10-08T22:26:58.2810507Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad118a2dc3bc6854.xml (deflated 35%)
2024-10-08T22:26:58.2812342Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9467507ba3873141.xml (deflated 35%)
2024-10-08T22:26:58.2814113Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-16f1daeead7789d5.xml (deflated 35%)
2024-10-08T22:26:58.2815885Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-685aa568915cf6c5.xml (deflated 42%)
2024-10-08T22:26:58.2817659Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f316ffcac03e689b.xml (deflated 36%)
2024-10-08T22:26:58.2819430Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-990a2ea9eda0add7.xml (deflated 44%)
2024-10-08T22:26:58.2821193Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7da35b02af5617e7.xml (deflated 45%)
2024-10-08T22:26:58.2822955Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bf07a9c2bbbc4231.xml (deflated 45%)
2024-10-08T22:26:58.2824722Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-12f3e449f65d2ba6.xml (deflated 41%)
2024-10-08T22:26:58.2826577Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d6cef1f72aea97a.xml (deflated 41%)
2024-10-08T22:26:58.2828350Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f46241f0d662c86c.xml (deflated 42%)
2024-10-08T22:26:58.2830121Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d0cb521fe59a754.xml (deflated 41%)
2024-10-08T22:26:58.2831871Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb2d97551198d7fb.xml (deflated 41%)
2024-10-08T22:26:58.2833641Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2fa84a8f0edd3913.xml (deflated 41%)
2024-10-08T22:26:58.2835408Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-557c7d68e4421ecf.xml (deflated 35%)
2024-10-08T22:26:58.2837172Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3a7988f66f98ec57.xml (deflated 35%)
2024-10-08T22:26:58.2838935Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-804e7c0e1822d6b6.xml (deflated 35%)
2024-10-08T22:26:58.2840676Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e0b4c8750156a57.xml (deflated 36%)
2024-10-08T22:26:58.2842437Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aab3edf1995f0b2f.xml (deflated 45%)
2024-10-08T22:26:58.2844190Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-413119e16945684c.xml (deflated 42%)
2024-10-08T22:26:58.2845938Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a333962b819160ed.xml (deflated 36%)
2024-10-08T22:26:58.2847701Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6e491b9a4edcf13a.xml (deflated 36%)
2024-10-08T22:26:58.2849524Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9bcf83583f79ede.xml (deflated 36%)
2024-10-08T22:26:58.2851296Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-017ac1d7221aec5c.xml (deflated 42%)
2024-10-08T22:26:58.2853172Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe37902ee21f74b9.xml (deflated 36%)
2024-10-08T22:26:58.2854943Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-11cb6982bde72e18.xml (deflated 35%)
2024-10-08T22:26:58.2856703Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c3357429bb1177ab.xml (deflated 36%)
2024-10-08T22:26:58.2858458Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9290756aaa9a7473.xml (deflated 35%)
2024-10-08T22:26:58.2860234Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-08a50e0aaf3accdc.xml (deflated 36%)
2024-10-08T22:26:58.2862009Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9edf99b8a4a5bade.xml (deflated 35%)
2024-10-08T22:26:58.2863784Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be7843ea4abd7f6e.xml (deflated 42%)
2024-10-08T22:26:58.2865536Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-29474f7927e56048.xml (deflated 42%)
2024-10-08T22:26:58.2867293Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3daa28641356bc2e.xml (deflated 42%)
2024-10-08T22:26:58.2869110Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2f7a3fb541b223d.xml (deflated 44%)
2024-10-08T22:26:58.2870888Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c5272debac1d409.xml (deflated 36%)
2024-10-08T22:26:58.2872653Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bb56971e2433c477.xml (deflated 41%)
2024-10-08T22:26:58.2874423Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7fcf115e20e8ace0.xml (deflated 42%)
2024-10-08T22:26:58.2876196Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-141da1f62f2e285b.xml (deflated 42%)
2024-10-08T22:26:58.2877946Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-965f81eec798d526.xml (deflated 36%)
2024-10-08T22:26:58.2879707Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e275865a15370d68.xml (deflated 36%)
2024-10-08T22:26:58.2881478Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b0ae9b885282c97.xml (deflated 35%)
2024-10-08T22:26:58.2883242Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-779011b4e8d040d8.xml (deflated 36%)
2024-10-08T22:26:58.2885001Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3eb7a7b4de2c1367.xml (deflated 35%)
2024-10-08T22:26:58.2886753Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-178ada9fd84ece09.xml (deflated 45%)
2024-10-08T22:26:58.2888525Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2aa8212b26bdd1b4.xml (deflated 36%)
2024-10-08T22:26:58.2890530Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-880b6dbc4a6b74ea.xml (deflated 35%)
2024-10-08T22:26:58.2892527Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eb33626fc7ae4b19.xml (deflated 36%)
2024-10-08T22:26:58.2894316Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1d50512d33a2306d.xml (deflated 36%)
2024-10-08T22:26:58.2896076Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7147e570920c5edb.xml (deflated 36%)
2024-10-08T22:26:58.2897844Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-600dcb5be8a96598.xml (deflated 35%)
2024-10-08T22:26:58.2899632Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2675b69f37323767.xml (deflated 36%)
2024-10-08T22:26:58.2901409Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2423f3d5f54979c6.xml (deflated 41%)
2024-10-08T22:26:58.2903175Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7b15e306e729fb04.xml (deflated 43%)
2024-10-08T22:26:58.2904941Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6955daeeabe29e8d.xml (deflated 44%)
2024-10-08T22:26:58.2906691Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b045bd1461888aef.xml (deflated 44%)
2024-10-08T22:26:58.2908457Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a06b49bddb33e62.xml (deflated 44%)
2024-10-08T22:26:58.2910330Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cf8725c31cf156e7.xml (deflated 45%)
2024-10-08T22:26:58.2912090Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-813762904e0f8c94.xml (deflated 42%)
2024-10-08T22:26:58.2913859Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-445239b632f9cf8e.xml (deflated 35%)
2024-10-08T22:26:58.2915614Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d396b2f7d0700d9b.xml (deflated 42%)
2024-10-08T22:26:58.2917392Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a1b1436112cac7e6.xml (deflated 35%)
2024-10-08T22:26:58.2919165Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ccbd05b08e305f0d.xml (deflated 35%)
2024-10-08T22:26:58.2920935Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6ff2a68b567c5cc2.xml (deflated 41%)
2024-10-08T22:26:58.2922710Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc6ee497b126565e.xml (deflated 42%)
2024-10-08T22:26:58.2924461Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-487c8b2b816ede7f.xml (deflated 42%)
2024-10-08T22:26:58.2926222Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9c2ad75ba934f8e.xml (deflated 35%)
2024-10-08T22:26:58.2927990Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d56c804eb8b8c98d.xml (deflated 42%)
2024-10-08T22:26:58.2929763Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bff0c97f8881f5b4.xml (deflated 42%)
2024-10-08T22:26:58.2931539Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c0105b184d331dca.xml (deflated 42%)
2024-10-08T22:26:58.2933460Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b707f1176910c8f.xml (deflated 42%)
2024-10-08T22:26:58.2935327Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df133fb52fa45ffe.xml (deflated 42%)
2024-10-08T22:26:58.2937106Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ed165e0d5539ba98.xml (deflated 42%)
2024-10-08T22:26:58.2938886Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c8f02c86a710e2da.xml (deflated 43%)
2024-10-08T22:26:58.2940662Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dafce47920601fd4.xml (deflated 42%)
2024-10-08T22:26:58.2942441Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-012cd71861a27c25.xml (deflated 42%)
2024-10-08T22:26:58.2944203Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c0d50c80163086f9.xml (deflated 42%)
2024-10-08T22:26:58.2945967Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-211819de658af0a4.xml (deflated 41%)
2024-10-08T22:26:58.2947737Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bda24c1887d897d4.xml (deflated 43%)
2024-10-08T22:26:58.2949499Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c89cacdfa55e037d.xml (deflated 56%)
2024-10-08T22:26:58.2951266Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fac2ca5de791b26a.xml (deflated 43%)
2024-10-08T22:26:58.2953095Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dddaed1e2b27a3f5.xml (deflated 42%)
2024-10-08T22:26:58.2954869Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f54a3caaf2e9fe8.xml (deflated 42%)
2024-10-08T22:26:58.2956651Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c5e4dd38f8ed7372.xml (deflated 42%)
2024-10-08T22:26:58.2958431Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96d593896c8b8ad3.xml (deflated 42%)
2024-10-08T22:26:58.2960203Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-34f38a3f26ac40b2.xml (deflated 42%)
2024-10-08T22:26:58.2961949Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-713059a333efbb28.xml (deflated 42%)
2024-10-08T22:26:58.2963719Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8e96a5eb62c12bee.xml (deflated 42%)
2024-10-08T22:26:58.2965490Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b5447189c938a293.xml (deflated 43%)
2024-10-08T22:26:58.2967251Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-53f6d3298941ec52.xml (deflated 43%)
2024-10-08T22:26:58.2969004Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c29664d30100c473.xml (deflated 42%)
2024-10-08T22:26:58.2970764Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb83d0e6af398dd1.xml (deflated 35%)
2024-10-08T22:26:58.2972615Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-44596a94d36d5bfb.xml (deflated 35%)
2024-10-08T22:26:58.2974400Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-002ffd67e826a645.xml (deflated 35%)
2024-10-08T22:26:58.2976242Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-221d3585253cef20.xml (deflated 35%)
2024-10-08T22:26:58.2978012Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a22eb352cdb70d4c.xml (deflated 42%)
2024-10-08T22:26:58.2979788Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74da0d0718ed382c.xml (deflated 35%)
2024-10-08T22:26:58.2981551Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-907bb712b88ec824.xml (deflated 44%)
2024-10-08T22:26:58.2983324Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6843b3822615cdfc.xml (deflated 45%)
2024-10-08T22:26:58.2985097Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b2753d5bfee81961.xml (deflated 45%)
2024-10-08T22:26:58.2986861Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c45824cc195306b.xml (deflated 41%)
2024-10-08T22:26:58.2988919Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f49c12cd0f0a6525.xml (deflated 42%)
2024-10-08T22:26:58.2990691Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-efdf44db5aee855b.xml (deflated 42%)
2024-10-08T22:26:58.2992463Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-37da9cb378988edf.xml (deflated 42%)
2024-10-08T22:26:58.2994231Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-940d6b96803fdc52.xml (deflated 41%)
2024-10-08T22:26:58.2996156Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-327cf9f5d7ebaf24.xml (deflated 41%)
2024-10-08T22:26:58.2997931Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39d20d132f749a9b.xml (deflated 35%)
2024-10-08T22:26:58.2999690Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ad4a6c865b3cc62.xml (deflated 35%)
2024-10-08T22:26:58.3001455Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b213151d5bcfd262.xml (deflated 35%)
2024-10-08T22:26:58.3003228Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eab36fc3911fe228.xml (deflated 37%)
2024-10-08T22:26:58.3005001Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c13c738bcea3d356.xml (deflated 45%)
2024-10-08T22:26:58.3006768Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7e8f3b700c514c1f.xml (deflated 43%)
2024-10-08T22:26:58.3008532Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4790cbea59659898.xml (deflated 36%)
2024-10-08T22:26:58.3010354Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-16dc95d33bf0f836.xml (deflated 36%)
2024-10-08T22:26:58.3012128Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c9d56f0299d7b61e.xml (deflated 35%)
2024-10-08T22:26:58.3013991Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7e6df722a6e28628.xml (deflated 42%)
2024-10-08T22:26:58.3015773Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc3c853b32d22232.xml (deflated 35%)
2024-10-08T22:26:58.3017553Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2becf8f3dd2c7023.xml (deflated 35%)
2024-10-08T22:26:58.3019423Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1eba1f2edb2f1c1d.xml (deflated 36%)
2024-10-08T22:26:58.3021209Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1a5b7dd4535f9e58.xml (deflated 36%)
2024-10-08T22:26:58.3022973Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-650f841e0f29d800.xml (deflated 36%)
2024-10-08T22:26:58.3024742Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-714e51375fa573b8.xml (deflated 35%)
2024-10-08T22:26:58.3026500Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-67d63f642582136d.xml (deflated 41%)
2024-10-08T22:26:58.3028240Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17d794de218f4832.xml (deflated 42%)
2024-10-08T22:26:58.3029997Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ef29f4a8367a3854.xml (deflated 42%)
2024-10-08T22:26:58.3031776Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3baba02d72cde7ab.xml (deflated 44%)
2024-10-08T22:26:58.3060435Z ##[group]Run # Remove any previous usage logs if they exist
2024-10-08T22:26:58.3061096Z # Remove any previous usage logs if they exist
2024-10-08T22:26:58.3061615Z rm -f logs-*.zip
2024-10-08T22:26:58.3062325Z # this workflow is also run in bazel build test, but we dont generate usage reports for it
2024-10-08T22:26:58.3063253Z # so check to see if the file exists first
2024-10-08T22:26:58.3063776Z if [ -f 'usage_log.txt' ]; then
2024-10-08T22:26:58.3064302Z     zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt'
2024-10-08T22:26:58.3064803Z fi
2024-10-08T22:26:58.3065176Z if ls test/**/*.log 1> /dev/null 2>&1; then
2024-10-08T22:26:58.3065774Z     zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log'
2024-10-08T22:26:58.3066270Z fi
2024-10-08T22:26:58.3072266Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:58.3072781Z env:
2024-10-08T22:26:58.3073039Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.3073680Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.3074528Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_31257778946
2024-10-08T22:26:58.3075068Z ##[endgroup]
2024-10-08T22:26:58.3199035Z   adding: usage_log.txt (deflated 92%)
2024-10-08T22:26:58.3467177Z   adding: test/test-reports/distributed._tensor.test_dtensor_compile_1.1_34d4f3154b868528_.log (deflated 85%)
2024-10-08T22:26:58.3470906Z   adding: test/test-reports/distributed.test_fake_pg_1.1_e8d73f74afb378e3_.log (deflated 73%)
2024-10-08T22:26:58.3477192Z   adding: test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_4224de170011c592_.log (deflated 89%)
2024-10-08T22:26:58.3481356Z   adding: test/test-reports/distributed._tensor.test_embedding_ops_1.1_56f5ca79c9adf99f_.log (deflated 85%)
2024-10-08T22:26:58.3485052Z   adding: test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_717cf2dfb4f988cd_.log (deflated 52%)
2024-10-08T22:26:58.3499062Z   adding: test/test-reports/distributed._tensor.test_tensor_ops_1.1_9b1ef687ca9c6974_.log (deflated 95%)
2024-10-08T22:26:58.3504333Z   adding: test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_b9a19624aef61b9b_.log (deflated 77%)
2024-10-08T22:26:58.3508635Z   adding: test/test-reports/distributed._tensor.test_experimental_ops_1.1_64a4edc6098e5717_.log (deflated 74%)
2024-10-08T22:26:58.3539676Z   adding: test/test-reports/distributed._tensor.test_redistribute_1.1_654c9507853cbe25_.log (deflated 96%)
2024-10-08T22:26:58.3543218Z   adding: test/test-reports/distributed._tensor.test_init_1.1_5ede6bac2995f9b5_.log (deflated 69%)
2024-10-08T22:26:58.3547433Z   adding: test/test-reports/distributed._tensor.experimental.test_tp_transform_1.1_bf64847ebd557f52_.log (deflated 65%)
2024-10-08T22:26:58.3552866Z   adding: test/test-reports/distributed._tensor.test_api_1.1_8955a434bb83a3f8_.log (deflated 89%)
2024-10-08T22:26:58.3557490Z   adding: test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_5f0e5f3da71350b9_.log (deflated 71%)
2024-10-08T22:26:58.3563059Z   adding: test/test-reports/distributed._tensor.test_random_ops_1.1_209a8a636636303a_.log (deflated 75%)
2024-10-08T22:26:58.3567454Z   adding: test/test-reports/distributed._tools.test_mod_tracker_1.1_a08fc9be0eda4f47_.log (deflated 63%)
2024-10-08T22:26:58.3569781Z   adding: test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_84c3b4bf95ebaa5d_.log (deflated 82%)
2024-10-08T22:26:58.3571696Z   adding: test/test-reports/distributed._tensor.test_convolution_ops_1.1_e2151f48303494f8_.log (deflated 62%)
2024-10-08T22:26:58.3574220Z   adding: test/test-reports/distributed._tensor.experimental.test_local_map_1.1_06a31230a89c1c98_.log (deflated 79%)
2024-10-08T22:26:58.3576532Z   adding: test/test-reports/distributed._tensor.test_math_ops_1.1_fddb3806e368da1c_.log (deflated 91%)
2024-10-08T22:26:58.3578843Z   adding: test/test-reports/distributed._tensor.test_matrix_ops_1.1_d7a31da06d38a311_.log (deflated 89%)
2024-10-08T22:26:58.3580914Z   adding: test/test-reports/distributed.fsdp.test_fsdp_dtensor_state_dict_1.1_b6ca11434c749e61_.log (deflated 86%)
2024-10-08T22:26:58.3583326Z   adding: test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_2c60db45a1070353_.log (deflated 55%)
2024-10-08T22:26:58.3585054Z   adding: test/test-reports/distributed._composable.test_contract_1.1_0c4fb2b9f0e24eb1_.log (deflated 66%)
2024-10-08T22:26:58.3586508Z   adding: test/test-reports/distributed._tools.test_mem_tracker_1.1_24c86bdfbfe00902_.log (deflated 61%)
2024-10-08T22:26:58.3587823Z   adding: test/test-reports/distributed.checkpoint.test_save_load_api_1.1_9a276b20f29f1294_.log (deflated 53%)
2024-10-08T22:26:58.3589394Z   adding: test/test-reports/distributed.pipelining.test_pipe_1.1_208d0e514afda35d_.log (deflated 62%)
2024-10-08T22:26:58.3590670Z   adding: test/test-reports/distributed.test_c10d_functional_native_1.1_59a257b2bd2d78c3_.log (deflated 86%)
2024-10-08T22:26:58.3591915Z   adding: test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_6015929831e677ef_.log (deflated 53%)
2024-10-08T22:26:58.3593271Z   adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_tensor_ops_1.1_bd90584a6cf58d44_.log (deflated 71%)
2024-10-08T22:26:58.3594762Z   adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_4fa950eca7840859_.log (deflated 70%)
2024-10-08T22:26:58.3596204Z   adding: test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_36bf166802c47c16_.log (deflated 62%)
2024-10-08T22:26:58.3597601Z   adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_dcb0a5e1a9bd40dc_.log (deflated 67%)
2024-10-08T22:26:58.3598916Z   adding: test/test-reports/distributed.test_data_parallel_1.1_eb43ce41334a5aae_.log (deflated 88%)
2024-10-08T22:26:58.3600266Z   adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_e13eb09289f43181_.log (deflated 72%)
2024-10-08T22:26:58.3601743Z   adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_1.1_29627d8e7267b742_.log (deflated 62%)
2024-10-08T22:26:58.3603238Z   adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_bag_1.1_12b4df839146b52d_.log (deflated 63%)
2024-10-08T22:26:58.3605245Z   adding: test/test-reports/distributed.pipelining.test_microbatch_1.1_7607654d8d18a8c0_.log (deflated 58%)
2024-10-08T22:26:58.3606617Z   adding: test/test-reports/distributed.rpc.cuda.test_tensorpipe_agent_1.1_f31772ee159d7dbe_.log (deflated 98%)
2024-10-08T22:26:58.3608050Z   adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_129d189c9c2b358d_.log (deflated 53%)
2024-10-08T22:26:58.3642533Z   adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_2.4_f53706c9710425f2_.log (deflated 97%)
2024-10-08T22:26:58.3678125Z   adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_4.4_a08159938d7e396b_.log (deflated 97%)
2024-10-08T22:26:58.3680368Z   adding: test/test-reports/distributed.optim.test_named_optimizer_1.1_cd9b1e0742bdbba6_.log (deflated 35%)
2024-10-08T22:26:58.3682832Z   adding: test/test-reports/distributed._composable.test_compose_1.1_f9898f6b0b7488ea_.log (deflated 78%)
2024-10-08T22:26:58.3684326Z   adding: test/test-reports/distributed.test_nccl_1.1_b1b8018242c4da18_.log (deflated 49%)
2024-10-08T22:26:58.3685578Z   adding: test/test-reports/distributed.checkpoint.test_checkpoint_1.1_6107260fb9a70bab_.log (deflated 81%)
2024-10-08T22:26:58.3687765Z   adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_compile_1.1_7567cdb98b9ebace_.log (deflated 83%)
2024-10-08T22:26:58.3690591Z   adding: test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_352ba060bcaf64cf_.log (deflated 55%)
2024-10-08T22:26:58.3691933Z   adding: test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_f5ca89f54a7ffec2_.log (deflated 59%)
2024-10-08T22:26:58.3693310Z   adding: test/test-reports/distributed.fsdp.test_fsdp_pure_fp16_1.1_691a25bd5f2a5526_.log (deflated 58%)
2024-10-08T22:26:58.3694725Z   adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_0e581181ef0f5d05_.log (deflated 72%)
2024-10-08T22:26:58.3696219Z   adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_frozen_1.1_9d60e6f941100a12_.log (deflated 67%)
2024-10-08T22:26:58.3697598Z   adding: test/test-reports/distributed.fsdp.test_fsdp_optim_state_1.1_0b5c05f8af925706_.log (deflated 95%)
2024-10-08T22:26:58.3699906Z   adding: test/test-reports/distributed.fsdp.test_fsdp_flatten_params_1.1_1d0ad58b729ed9c4_.log (deflated 79%)
2024-10-08T22:26:58.3702300Z   adding: test/test-reports/distributed.rpc.test_share_memory_1.1_674d47ddf0277c6a_.log (deflated 57%)
2024-10-08T22:26:58.3703532Z   adding: test/test-reports/distributed.test_c10d_logger_1.1_6e2ea27fb3d6d2da_.log (deflated 60%)
2024-10-08T22:26:58.3704792Z   adding: test/test-reports/distributed.fsdp.test_fsdp_tp_integration_1.1_66e0b7096132901a_.log (deflated 65%)
2024-10-08T22:26:58.3706109Z   adding: test/test-reports/distributed.fsdp.test_fsdp_traversal_1.1_59ab547f9783578f_.log (deflated 53%)
2024-10-08T22:26:58.3707422Z   adding: test/test-reports/distributed.fsdp.test_fsdp_state_dict_1.1_bf58de91c25a416e_.log (deflated 96%)
2024-10-08T22:26:58.3708697Z   adding: test/test-reports/distributed.fsdp.test_fsdp_input_1.1_7a22c65937a440d5_.log (deflated 58%)
2024-10-08T22:26:58.3709976Z   adding: test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_0f13ba681579eed3_.log (deflated 79%)
2024-10-08T22:26:58.3711227Z   adding: test/test-reports/distributed.fsdp.test_fsdp_uneven_1.1_eb740854cc6935d0_.log (deflated 52%)
2024-10-08T22:26:58.3712557Z   adding: test/test-reports/distributed.fsdp.test_fsdp_multiple_wrapping_1.1_504c01e0c768480f_.log (deflated 55%)
2024-10-08T22:26:58.3713870Z   adding: test/test-reports/distributed.test_distributed_spawn_1.3_d5f4826c2dbc773a_.log (deflated 37%)
2024-10-08T22:26:58.3715118Z   adding: test/test-reports/distributed.test_distributed_spawn_1.3_68566bfb0b411533_.log (deflated 37%)
2024-10-08T22:26:58.3723141Z   adding: test/test-reports/distributed.test_distributed_spawn_1.3_e54094341078bcc2_.log (deflated 96%)
2024-10-08T22:26:58.3743517Z   adding: test/test-reports/distributed.test_distributed_spawn_1.3_cd4aad2615bcf04a_.log (deflated 96%)
2024-10-08T22:26:58.3744819Z   adding: test/test-reports/distributed.test_distributed_spawn_3.3_689937b612a8c27b_.log (deflated 37%)
2024-10-08T22:26:58.3746090Z   adding: test/test-reports/distributed.test_distributed_spawn_3.3_dd52f128fac66097_.log (deflated 37%)
2024-10-08T22:26:58.3760642Z   adding: test/test-reports/distributed.test_distributed_spawn_3.3_f906993489ef2bb8_.log (deflated 97%)
2024-10-08T22:26:58.3777811Z   adding: test/test-reports/distributed.test_distributed_spawn_3.3_4323586ccfbf62a6_.log (deflated 97%)
2024-10-08T22:26:58.3778589Z   adding: test/test-reports/distributed.fsdp.test_utils_1.1_853f9fb0c41460e8_.log (deflated 64%)
2024-10-08T22:26:58.3779900Z   adding: test/test-reports/distributed.fsdp.test_fsdp_sharded_grad_scaler_1.1_e205c1aecb97b09a_.log (deflated 88%)
2024-10-08T22:26:58.3780591Z   adding: test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_b17756586eef3536_.log (deflated 68%)
2024-10-08T22:26:58.3781723Z   adding: test/test-reports/distributed.fsdp.test_fsdp_multiple_forward_1.1_734973e45f08ecee_.log (deflated 54%)
2024-10-08T22:26:58.3782742Z   adding: test/test-reports/distributed.test_multi_threaded_pg_1.1_3aa098411da756cf_.log (deflated 86%)
2024-10-08T22:26:58.3783832Z   adding: test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_8ca93e47001cc555_.log (deflated 73%)
2024-10-08T22:26:58.3784437Z   adding: test/test-reports/distributed.algorithms.test_join_1.1_a5a3af1f20ee3708_.log (deflated 80%)
2024-10-08T22:26:58.3785600Z   adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_optim_checkpoint_1.1_96028216f3a77436_.log (deflated 65%)
2024-10-08T22:26:58.3786635Z   adding: test/test-reports/distributed.fsdp.test_fsdp_misc_1.1_5761e5286da68d7f_.log (deflated 90%)
2024-10-08T22:26:58.3787210Z   adding: test/test-reports/distributed.fsdp.test_fsdp_comm_1.1_88f5ee433ee198af_.log (deflated 79%)
2024-10-08T22:26:58.3788313Z   adding: test/test-reports/distributed.checkpoint.test_state_dict_1.1_addf78cb2e0dc54d_.log (deflated 88%)
2024-10-08T22:26:58.3796917Z   adding: test/test-reports/distributed.rpc.test_faulty_agent_1.1_aee78da0f0ae409c_.log (deflated 96%)
2024-10-08T22:26:58.3799159Z   adding: test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_3d087ff5f2028d94_.log (deflated 85%)
2024-10-08T22:26:58.3800050Z   adding: test/test-reports/distributed.test_c10d_ucc_1.1_585139027176939e_.log (stored 0%)
2024-10-08T22:26:58.3801071Z   adding: test/test-reports/distributed.test_launcher_1.1_bc36842d67ace779_.log (deflated 59%)
2024-10-08T22:26:58.3816203Z   adding: test/test-reports/distributed.test_c10d_gloo_1.1_957a323d3569e0e5_.log (deflated 96%)
2024-10-08T22:26:58.3860408Z ##[group]Run # Remove any previous debugging artifacts if they exist
2024-10-08T22:26:58.3860699Z # Remove any previous debugging artifacts if they exist
2024-10-08T22:26:58.3860819Z rm -f debug-*.zip
2024-10-08T22:26:58.3860966Z if [ -d 'test/debug' ]; then
2024-10-08T22:26:58.3861176Z   zip -r "debug-${FILE_SUFFIX}.zip" test/debug
2024-10-08T22:26:58.3861287Z fi
2024-10-08T22:26:58.3867433Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:26:58.3867530Z env:
2024-10-08T22:26:58.3867674Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.3868084Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.3868362Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_31257778946
2024-10-08T22:26:58.3868470Z ##[endgroup]
2024-10-08T22:26:58.3968904Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-10-08T22:26:58.3969011Z with:
2024-10-08T22:26:58.3969137Z   s3-bucket: gha-artifacts
2024-10-08T22:26:58.3969350Z   s3-prefix: pytorch/pytorch/11242664097/1/artifact

2024-10-08T22:26:58.3969467Z   retention-days: 14
2024-10-08T22:26:58.3969602Z   if-no-files-found: warn
2024-10-08T22:26:58.3969720Z   path: test-jsons-*.zip
2024-10-08T22:26:58.3969829Z   name: artifact
2024-10-08T22:26:58.3969950Z   region: us-east-1
2024-10-08T22:26:58.3970043Z env:
2024-10-08T22:26:58.3970163Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:58.3970588Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:58.3970693Z ##[endgroup]
2024-10-08T22:26:58.7879697Z NOTE: s3-prefix specified, ignoring name parameter
2024-10-08T22:26:58.7880520Z With the provided path, there will be 1 file uploaded
2024-10-08T22:26:58.7881462Z Uploading to s3 prefix: pytorch/pytorch/11242664097/1/artifact
2024-10-08T22:26:58.9190931Z Starting upload of test-jsons-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:26:59.0093358Z Finished upload of test-jsons-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:26:59.0295312Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-10-08T22:26:59.0295757Z with:
2024-10-08T22:26:59.0296032Z   s3-bucket: gha-artifacts
2024-10-08T22:26:59.0296471Z   s3-prefix: pytorch/pytorch/11242664097/1/artifact

2024-10-08T22:26:59.0296957Z   retention-days: 14
2024-10-08T22:26:59.0297278Z   if-no-files-found: error
2024-10-08T22:26:59.0297646Z   path: test-reports-*.zip
2024-10-08T22:26:59.0298011Z   name: artifact
2024-10-08T22:26:59.0298296Z   region: us-east-1
2024-10-08T22:26:59.0298590Z env:
2024-10-08T22:26:59.0298857Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:59.0299493Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:59.0300177Z ##[endgroup]
2024-10-08T22:26:59.3999641Z NOTE: s3-prefix specified, ignoring name parameter
2024-10-08T22:26:59.4000703Z With the provided path, there will be 1 file uploaded
2024-10-08T22:26:59.4001891Z Uploading to s3 prefix: pytorch/pytorch/11242664097/1/artifact
2024-10-08T22:26:59.4045646Z Starting upload of test-reports-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:26:59.6923779Z Finished upload of test-reports-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:26:59.7130594Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-10-08T22:26:59.7131040Z with:
2024-10-08T22:26:59.7131317Z   s3-bucket: gha-artifacts
2024-10-08T22:26:59.7131907Z   s3-prefix: pytorch/pytorch/11242664097/1/artifact

2024-10-08T22:26:59.7132493Z   retention-days: 14
2024-10-08T22:26:59.7132814Z   if-no-files-found: ignore
2024-10-08T22:26:59.7133174Z   path: logs-*.zip
2024-10-08T22:26:59.7133481Z   name: artifact
2024-10-08T22:26:59.7133764Z   region: us-east-1
2024-10-08T22:26:59.7134057Z env:
2024-10-08T22:26:59.7134334Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:26:59.7134976Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:26:59.7135662Z ##[endgroup]
2024-10-08T22:27:00.0712546Z NOTE: s3-prefix specified, ignoring name parameter
2024-10-08T22:27:00.0713607Z With the provided path, there will be 1 file uploaded
2024-10-08T22:27:00.0714248Z Uploading to s3 prefix: pytorch/pytorch/11242664097/1/artifact
2024-10-08T22:27:00.0754368Z Starting upload of logs-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:27:00.2422308Z Finished upload of logs-test-distributed-2-2-linux.2xlarge_31257778946.zip
2024-10-08T22:27:00.2636182Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-10-08T22:27:00.2636645Z with:
2024-10-08T22:27:00.2636919Z   s3-bucket: gha-artifacts
2024-10-08T22:27:00.2637362Z   s3-prefix: pytorch/pytorch/11242664097/1/artifact

2024-10-08T22:27:00.2637835Z   retention-days: 14
2024-10-08T22:27:00.2638170Z   if-no-files-found: ignore
2024-10-08T22:27:00.2638541Z   path: debug-*.zip
2024-10-08T22:27:00.2638848Z   name: artifact
2024-10-08T22:27:00.2639134Z   region: us-east-1
2024-10-08T22:27:00.2639427Z env:
2024-10-08T22:27:00.2639690Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:27:00.2640317Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:00.2641016Z ##[endgroup]
2024-10-08T22:27:00.6226418Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded.
2024-10-08T22:27:00.6429874Z ##[group]Run # shellcheck disable=SC2156
2024-10-08T22:27:00.6430375Z # shellcheck disable=SC2156
2024-10-08T22:27:00.6431243Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \;
2024-10-08T22:27:00.6438780Z shell: /usr/bin/bash -e {0}
2024-10-08T22:27:00.6439145Z env:
2024-10-08T22:27:00.6439422Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:27:00.6440074Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:00.6440764Z ##[endgroup]
2024-10-08T22:27:00.8690937Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main
2024-10-08T22:27:00.8691525Z with:
2024-10-08T22:27:00.8691760Z env:
2024-10-08T22:27:00.8692026Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:27:00.8692793Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:00.8693477Z ##[endgroup]
2024-10-08T22:27:00.8715515Z ##[group]Run set -eou pipefail
2024-10-08T22:27:00.8715935Z set -eou pipefail
2024-10-08T22:27:00.8716291Z 
2024-10-08T22:27:00.8716819Z echo "Holding runner for 2 hours until all ssh sessions have logged out"
2024-10-08T22:27:00.8717518Z for _ in $(seq 1440); do
2024-10-08T22:27:00.8717984Z     # Break if no ssh session exists anymore
2024-10-08T22:27:00.8718497Z     if [ "$(who)" = "" ]; then
2024-10-08T22:27:00.8718918Z       break
2024-10-08T22:27:00.8719230Z     fi
2024-10-08T22:27:00.8719552Z     echo "."
2024-10-08T22:27:00.8719864Z     sleep 5
2024-10-08T22:27:00.8720181Z done
2024-10-08T22:27:00.8726112Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:27:00.8726630Z env:
2024-10-08T22:27:00.8726889Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:27:00.8727537Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:00.8728234Z ##[endgroup]
2024-10-08T22:27:00.8752559Z Holding runner for 2 hours until all ssh sessions have logged out
2024-10-08T22:27:00.8868128Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-10-08T22:27:00.8869090Z # ignore expansion of "docker ps -q" since it could be empty
2024-10-08T22:27:00.8869697Z # shellcheck disable=SC2046
2024-10-08T22:27:00.8870170Z docker stop $(docker ps -q) || true
2024-10-08T22:27:00.8870669Z # Prune all of the docker images
2024-10-08T22:27:00.8871125Z docker system prune -af
2024-10-08T22:27:00.8876923Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:27:00.8877444Z env:
2024-10-08T22:27:00.8877719Z   GIT_DEFAULT_BRANCH: main
2024-10-08T22:27:00.8878354Z   DOCKER_CONTAINER_ID: 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:00.8879059Z ##[endgroup]
2024-10-08T22:27:11.5291179Z 37d41d4bda7e
2024-10-08T22:27:12.2419041Z Deleted Containers:
2024-10-08T22:27:12.2419770Z 37d41d4bda7ef7ec346f0417bc6c3c43f148e013ed53f62a6f85c8f3b8ead2f5
2024-10-08T22:27:12.2420337Z 
2024-10-08T22:27:21.9405404Z Deleted Images:
2024-10-08T22:27:21.9406997Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:46f3eb402e47f9fae93ec1dc1f6772950f4498aa
2024-10-08T22:27:21.9409841Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11@sha256:4e0393713933105b539fb30aab8d91040a357314b532348d6cb011314c8916a7
2024-10-08T22:27:21.9411392Z deleted: sha256:8c834a349f9752a25b5f708c94dd15d6312989e62a0e3e6a3f4b2a91730a07f0
2024-10-08T22:27:21.9412865Z deleted: sha256:f2e1ae5b51281174b0ecda80f4c8e25cf228972dd865a018061d20cb90737d66
2024-10-08T22:27:21.9414061Z deleted: sha256:259c82582f35292505589ffd6b8b481ea8479e3ca26f5a0d17fe12ada0addad9
2024-10-08T22:27:21.9414959Z deleted: sha256:a93e7b36a369809aa47d544a5ad2d4376095fc850cb8bc494849bcc52ab5da5e
2024-10-08T22:27:21.9415861Z deleted: sha256:d4a9a4b4fa5c78920299c7d78747296986d9143f44a2f21e988e9e762a18fc16
2024-10-08T22:27:21.9416763Z deleted: sha256:83c0a5b5b3f73623e898f672197f74d1bf48aba6fb9702047af539ac279221c0
2024-10-08T22:27:21.9417689Z deleted: sha256:ba1027b8425df97e533db6eb3ff47fa0050d19d38b91d6e2d82bf888333f800b
2024-10-08T22:27:21.9418643Z deleted: sha256:b340d4911b631ada85256a07131b5f7c1ca3174f00833823095f3e745cbd76d2
2024-10-08T22:27:21.9419531Z deleted: sha256:f4bb286a34cc5e25f0a0ac97d8825cbb02a569404ff043eb98fca7075023f449
2024-10-08T22:27:21.9420742Z deleted: sha256:de4993d95a63e3c6c4b616350b64ce2063cddf06482aaa8da680a84036731b57
2024-10-08T22:27:21.9421661Z deleted: sha256:3dc56505b24e2c75c5213c763ee9caa4003bbd8fbce87bee6d243be5b1daadb6
2024-10-08T22:27:21.9422580Z deleted: sha256:5e5d22e4b0a653e490cae8c02717c94fb75725faec853d7d67baf86813f673d0
2024-10-08T22:27:21.9423489Z deleted: sha256:cf74d92adb39f1b2c39a35a92b1f03a0108cf0accad93ead0ac68dee81a9a776
2024-10-08T22:27:21.9424401Z deleted: sha256:6b4d420701715f683980aa10f04b8512a111f64edef18c3745a27cd053a2cb1b
2024-10-08T22:27:21.9425305Z deleted: sha256:a4879ea117ee83343b00b9fcadbc6dd60914ac8bfe0b92dd50aa20cf49d1dea4
2024-10-08T22:27:21.9426219Z deleted: sha256:68e1e8b5ff9ba7e63df5c34949e2264c0d29f367846f5560e8ec6d4e57b89a06
2024-10-08T22:27:21.9427109Z deleted: sha256:991ab92317d9c5211156cb39c7a4c70fd746ef4b9b13953242604f9b3c4d117e
2024-10-08T22:27:21.9427992Z deleted: sha256:42c26f58d474319bc246c916d9723dc64bc0462a092d26fa6a8e847db1a52f06
2024-10-08T22:27:21.9428866Z deleted: sha256:992f1a92173f0b1550ab375739206773aec64fd585312f84229a02d580950042
2024-10-08T22:27:21.9429746Z deleted: sha256:be9c93622475d6b9eae70492dfa6004e0095410993e5f8d7f877616b075a019c
2024-10-08T22:27:21.9430647Z deleted: sha256:a88ef37f43b19dfec9f1fcb5325228da4b8de10bbcc3f67ecc21e424ff4ffa7c
2024-10-08T22:27:21.9431549Z deleted: sha256:a39bd62652f98c1b903dea841650716360b33e03292218431678716b7bbd0230
2024-10-08T22:27:21.9432445Z deleted: sha256:8b2e7bba5620db3d72a0e32bbfd831f14c4386d9f4e13444f66c48de35affbf6
2024-10-08T22:27:21.9433362Z deleted: sha256:13f523dff3dbbc69af571e72ce392bb9ed538a7a8043e04e4d1989243a6b0157
2024-10-08T22:27:21.9434291Z deleted: sha256:fd824e305b62d03fa9be7cb9d37ee5e5f721ffecf4f4e47a6a975dc74f34c988
2024-10-08T22:27:21.9435337Z deleted: sha256:cdd0abc551c38189be035ef086a299984619a195a3cad007ceb4ae0c6546e2ec
2024-10-08T22:27:21.9436262Z deleted: sha256:27a280a015efdb6bacc64741295b0f55b9b268cf2c159bc54bdaf483c70de4d2
2024-10-08T22:27:21.9437245Z deleted: sha256:f54e46e2daebb587fd0486342c26f50620fa005c6835ca190633b7f1a7ea0c10
2024-10-08T22:27:21.9438159Z deleted: sha256:5de3072528fe938a48a0c9b7f712883dab19d0aba9840bbf2ea3b43d99d27be7
2024-10-08T22:27:21.9439045Z deleted: sha256:4202e6b3cc0b7b38ec69807616884c08b5cfd9ed0f84bf35c2f4591ddbbb711e
2024-10-08T22:27:21.9439999Z deleted: sha256:6de4cb61472b2c04e4ca6847f40a7bae26195c83ae30df565e8b77ae2930f5f0
2024-10-08T22:27:21.9440906Z deleted: sha256:99249da1b34d7e636338df164ca098d0a982544dcc453ae185f164bd0b4a0c52
2024-10-08T22:27:21.9441786Z deleted: sha256:753766301b3c2c9c78b692bcda8542d3702a07e10f0532d34b295f5afffeccab
2024-10-08T22:27:21.9442673Z deleted: sha256:d5a36a3b16d94bf40dd915c47e24acd2d128723d40ebfb2abc17824f0ef2dc32
2024-10-08T22:27:21.9443609Z deleted: sha256:58e6afa5fb019d0704b360558eedac7f0339fbbab8952eff4b18ed3ac9ee9996
2024-10-08T22:27:21.9444529Z deleted: sha256:72421b268edce42c43aa961e86890670f5d2da91f9dc163f77cfed39b7348888
2024-10-08T22:27:21.9445434Z deleted: sha256:e69da35c45c05f3578fc2ca851dc6e18d8b501612eb4c9ce62a365f839604fad
2024-10-08T22:27:21.9446326Z deleted: sha256:76d3f4d6c999c4a845921c1b148a6533f35af7a32d0257551ea7e6ef0e7644d2
2024-10-08T22:27:21.9447212Z deleted: sha256:8f24db1673f11fd521778dad11526687d2103be48cfb7066ca1308cba041ad51
2024-10-08T22:27:21.9448109Z deleted: sha256:e88a8421713abe692d4d5f191a7153e2265cf2cee09e8a82f6080aade5445ec2
2024-10-08T22:27:21.9449008Z deleted: sha256:7f945c7a65ae59257ede6c104cf19cbdb23d5f8133072f6494284547b8f5932b
2024-10-08T22:27:21.9449908Z deleted: sha256:a97750c4ee9820f39e3f378b15f8e3a13ad2c2f27dcc8c57d81dd194eb44dcb8
2024-10-08T22:27:21.9450790Z deleted: sha256:1ece43505a57937d2a287305b5c55c1f6c8fe6aa02c8ef8435151336455a8835
2024-10-08T22:27:21.9451695Z deleted: sha256:ff79359d5978b2d93237e0cf5f1bfc85c7db2bfdc9bf731be3fd884cac15043a
2024-10-08T22:27:21.9452727Z deleted: sha256:4d1a58f130d3f6e6e4f704bee7b866ff58473ee7ba7b83363855251b41a5838c
2024-10-08T22:27:21.9453645Z deleted: sha256:0a966647e0b3b87fc12c2b0a52fcbc80fa05fa7ec0cc9629bd038d8684ab4713
2024-10-08T22:27:21.9454564Z deleted: sha256:fc2a02c57d32f1adba8cd917f68f7afa4b6a7f4c6b1676495208b07bc39bd2f9
2024-10-08T22:27:21.9455616Z deleted: sha256:f8e4a25cb9f4e87fe432bdfc8e23f658c684dd7461aeecb31868eff645f544fa
2024-10-08T22:27:21.9456535Z deleted: sha256:eeca5424e551468153fda582a8f137795299b6ad0a2f0e5376658e78f8174fa8
2024-10-08T22:27:21.9457436Z deleted: sha256:62de4eb8079c04e7d4fc0c6b97f695a1183d74975f4e32647ae030984808c05b
2024-10-08T22:27:21.9458317Z deleted: sha256:9525a535c93bf8c9707b42bb3ea4e33b0626d23c407375ddc12dab6b72beef2f
2024-10-08T22:27:21.9459314Z deleted: sha256:a12df283a3d30eb52418d417bb12b3d289fd4295712afac3f416b48b4f4ade9b
2024-10-08T22:27:21.9460356Z deleted: sha256:9a0b4239578e58a12fd5304293bd6468e97eb0e63d0863caf8d6cf15de40f12b
2024-10-08T22:27:21.9461484Z deleted: sha256:d388a3d6bb1adc14138395525da3b2aab2daa0638d34a767d3ff1c62eaa3e2cf
2024-10-08T22:27:21.9462372Z deleted: sha256:6d7d31386e373b424657c1487c62b0183052ed0e46ac9df8e3f94d1828f45713
2024-10-08T22:27:21.9463276Z deleted: sha256:a4d2f2d5d7fdbfd1eef488d93159e55fe83168c5273e2ff1ed8d78bdc20e85ec
2024-10-08T22:27:21.9464212Z deleted: sha256:08d4026fe64bfbcc47acaeba469627ff619697cd5cc842b4a3e69aa3099a733e
2024-10-08T22:27:21.9465124Z deleted: sha256:82477af4ed78c26869b6937c78c1ac5dab70f21c7efed596b14535dec06efc50
2024-10-08T22:27:21.9466017Z deleted: sha256:58cd80ca2486b1de3094a44f6e7e9ea0db30227f4d3399396290fbf21c56a3cf
2024-10-08T22:27:21.9466922Z deleted: sha256:4e9c749d01df850dffe5775c7b92bf8a427f3a94a0bea6b916638fc829ece8da
2024-10-08T22:27:21.9467821Z deleted: sha256:9073386eaa38da7693c86899de923ba9184588965069749d5befec27eab6f9a9
2024-10-08T22:27:21.9468714Z deleted: sha256:4e3ea7185e5614511b1e886aa7ad2623321e9087faad3206767c528b3f033bf0
2024-10-08T22:27:21.9469718Z deleted: sha256:2d9fdba6dce71c1f913eb44592288b03b55bbc163eeefab975759f9aedf9d3fb
2024-10-08T22:27:21.9470634Z deleted: sha256:9912b3a5c4b1ed28acca19a1ac4054fd0c7ca6cde0884207e7fc27459f974c31
2024-10-08T22:27:21.9471564Z deleted: sha256:7fe6ab74b6a094bd50bbe8e78beb4a30eb803435009660ec57ddba7ec1bdee38
2024-10-08T22:27:21.9472493Z deleted: sha256:b5c57e053c563d14859e697ec52b79d414d56eabc6aaed2162ac0b5ab139f05d
2024-10-08T22:27:21.9473402Z deleted: sha256:06ecfb101f43a22ad64f4e0f8332e4a3d36ff290f80fd2e278863a133188166a
2024-10-08T22:27:21.9474298Z deleted: sha256:33c65d2f478ea12a63ac4cefff9fff0d91665916484334d90977089d3e26fe30
2024-10-08T22:27:21.9475216Z deleted: sha256:f6d76d3cded1e3fd3232b503a3d1782e849c1123b818cdfb58d0b82f7bc807b8
2024-10-08T22:27:21.9476136Z deleted: sha256:c80d4ba31c172294ab9e528f7ffcef2ffe881955a007b92349719c17a09ba3fa
2024-10-08T22:27:21.9477039Z deleted: sha256:6b715ec3e9495ce25b8806c2356814f90ff370ad27a1b39ec80e4417521cea70
2024-10-08T22:27:21.9478180Z deleted: sha256:92a1f68a80ed43acbc42faf2ad910a89a78ea35704e70dc6f57645fc9de327e3
2024-10-08T22:27:21.9479132Z deleted: sha256:e9ccc4df3adde6d97ce5d81e83c22a8bca61a131ca31a14a66ef8df332a80c0f
2024-10-08T22:27:21.9480064Z deleted: sha256:9b6e703610b327616e3dda2bfe8b678d54126cdf757db89dd4463df6561a8d7d
2024-10-08T22:27:21.9480981Z deleted: sha256:597e478a756ebb549d49813e651f5cfcfecd05ca3ec7cf265a3a31eec98e1acf
2024-10-08T22:27:21.9481911Z deleted: sha256:37b1e7c04d75b4fea7f125c4501ae46e765a0e4c9cc8dead2d4de150f258e6ad
2024-10-08T22:27:21.9482806Z deleted: sha256:c64b67bfd0ab6860e79ea9c1962a15b7e15374800ab6376d2c18034a16387f87
2024-10-08T22:27:21.9483725Z deleted: sha256:5b54fca9e445c4ed42e2f2af7f17185deb8092d3c9adaf5d13ec4aa52e8a7ae4
2024-10-08T22:27:21.9484625Z deleted: sha256:988b3cf1c1e7677d54384006851687c6551e80a65914a8184820e903133d2fcc
2024-10-08T22:27:21.9485521Z deleted: sha256:b3b4543ea7fea6ccdf592b8a4e6dc5107d1ca2d374d565b95ec8302dcf45e3d6
2024-10-08T22:27:21.9486442Z deleted: sha256:8d425547b2e4460aab6f5acf30b20da2480f60ff5826ab0b53dc62d066675658
2024-10-08T22:27:21.9487364Z deleted: sha256:9b98ccfaac2731126154cb62de5e8b677d17d9b080c13d0a90ff9a659d8dadf9
2024-10-08T22:27:21.9488271Z deleted: sha256:d48f952be25936168c723a5447f9c3cbeee0667dfeac2b263a6173156193588b
2024-10-08T22:27:21.9489408Z deleted: sha256:c692ab9ff4a8a807475d93490704b3a4c61ed7fa6d40b6896f044f3d4724149d
2024-10-08T22:27:21.9490475Z deleted: sha256:cc007f299e92d10232e92cffebdf6c2ed7ab322324c630df4fdbe846c8c5a8f6
2024-10-08T22:27:21.9491388Z deleted: sha256:13a909c587ce8898bed39ef178ac4ea105a9a34066405f686856264a3b177589
2024-10-08T22:27:21.9492394Z deleted: sha256:0f803f34f760fd9ab262bbf8d21a29399ef64963c3f99e8f02b7f52223d9fd99
2024-10-08T22:27:21.9493288Z deleted: sha256:7a804f57f3016e1c609203a432211e9256ee55e1ef45f633db3f94a64d234a6c
2024-10-08T22:27:21.9494171Z deleted: sha256:24b0153e9d42b6cb1ad46a3316ab61cd7117dbce5905a3a76fde54f0bf97d196
2024-10-08T22:27:21.9495102Z deleted: sha256:fb292fecbd0f3a68e11cd6aeb40ec681315e31ba68131fc0230e0286c031b3bc
2024-10-08T22:27:21.9496028Z deleted: sha256:970c5ae0cd4d0f4904e9d87c0fda1bc02b0e82065d8674e7d434311423ad935e
2024-10-08T22:27:21.9496945Z deleted: sha256:eb0dfb7ab3f544503b81d62e5622edcb843321baada683a9e967e8844de6c546
2024-10-08T22:27:21.9497839Z deleted: sha256:a95c1694c12bf1516bff0485c4a3767746d08c72764c736a669782ee3a1ce8d8
2024-10-08T22:27:21.9513820Z deleted: sha256:c9241f71fa56197c26de90195e344120664744b414885f1dcd9bcce1b3d0655d
2024-10-08T22:27:21.9514754Z deleted: sha256:514c56b86eb441b2a248b8875fbbadfd7c45b9c1ef25a9aa02f53828025088c7
2024-10-08T22:27:21.9515678Z deleted: sha256:c91f9b114c93da86588c213e8f9969c70172d0535d6acf1d38ce2733fc51e92e
2024-10-08T22:27:21.9516566Z deleted: sha256:f0c7118bd06b5ec0f815020ea55601d3726a19d301b8f14525608e425299be15
2024-10-08T22:27:21.9517467Z deleted: sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465
2024-10-08T22:27:21.9518020Z 
2024-10-08T22:27:21.9518169Z Total reclaimed space: 21.18GB
2024-10-08T22:27:21.9636302Z Post job cleanup.
2024-10-08T22:27:21.9708673Z Post job cleanup.
2024-10-08T22:27:22.0667889Z [command]/usr/bin/git version
2024-10-08T22:27:22.0751076Z git version 2.40.1
2024-10-08T22:27:22.0791249Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/9b6940fb-f89d-46ab-b1e6-18c534f9a46e' before making global git config changes
2024-10-08T22:27:22.0792616Z Adding repository directory to the temporary git global config as a safe directory
2024-10-08T22:27:22.0796422Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-10-08T22:27:22.0857167Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-10-08T22:27:22.0893268Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-10-08T22:27:22.1302863Z Entering 'android/libs/fbjni'
2024-10-08T22:27:22.1360684Z Entering 'third_party/FP16'
2024-10-08T22:27:22.1415694Z Entering 'third_party/FXdiv'
2024-10-08T22:27:22.1468808Z Entering 'third_party/NNPACK'
2024-10-08T22:27:22.1523999Z Entering 'third_party/NVTX'
2024-10-08T22:27:22.1578612Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T22:27:22.1633816Z Entering 'third_party/XNNPACK'
2024-10-08T22:27:22.1707056Z Entering 'third_party/benchmark'
2024-10-08T22:27:22.1760860Z Entering 'third_party/cpp-httplib'
2024-10-08T22:27:22.1813217Z Entering 'third_party/cpuinfo'
2024-10-08T22:27:22.1866216Z Entering 'third_party/cudnn_frontend'
2024-10-08T22:27:22.1920026Z Entering 'third_party/cutlass'
2024-10-08T22:27:22.1980912Z Entering 'third_party/eigen'
2024-10-08T22:27:22.2036509Z Entering 'third_party/fbgemm'
2024-10-08T22:27:22.2088228Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T22:27:22.2140733Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T22:27:22.2193484Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T22:27:22.2252809Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T22:27:22.2304261Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T22:27:22.2357656Z Entering 'third_party/flatbuffers'
2024-10-08T22:27:22.2414031Z Entering 'third_party/fmt'
2024-10-08T22:27:22.2466742Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T22:27:22.2519762Z Entering 'third_party/gloo'
2024-10-08T22:27:22.2571717Z Entering 'third_party/googletest'
2024-10-08T22:27:22.2624771Z Entering 'third_party/ideep'
2024-10-08T22:27:22.2675057Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T22:27:22.2733930Z Entering 'third_party/ittapi'
2024-10-08T22:27:22.2786330Z Entering 'third_party/kineto'
2024-10-08T22:27:22.2838274Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T22:27:22.2889070Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T22:27:22.2942890Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T22:27:22.2995856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T22:27:22.3047499Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T22:27:22.3101540Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T22:27:22.3155544Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T22:27:22.3208348Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T22:27:22.3259781Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T22:27:22.3312400Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T22:27:22.3365364Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T22:27:22.3418712Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T22:27:22.3470978Z Entering 'third_party/mimalloc'
2024-10-08T22:27:22.3525038Z Entering 'third_party/nccl/nccl'
2024-10-08T22:27:22.3578341Z Entering 'third_party/nlohmann'
2024-10-08T22:27:22.3633792Z Entering 'third_party/onnx'
2024-10-08T22:27:22.3702716Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T22:27:22.3756663Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T22:27:22.3812841Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T22:27:22.3869676Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T22:27:22.3923888Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T22:27:22.3976701Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T22:27:22.4028641Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T22:27:22.4081564Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T22:27:22.4133069Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T22:27:22.4184078Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T22:27:22.4235946Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T22:27:22.4289811Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T22:27:22.4343541Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T22:27:22.4416148Z Entering 'third_party/pocketfft'
2024-10-08T22:27:22.4469930Z Entering 'third_party/protobuf'
2024-10-08T22:27:22.4526293Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T22:27:22.4578933Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T22:27:22.4633142Z Entering 'third_party/psimd'
2024-10-08T22:27:22.4686355Z Entering 'third_party/pthreadpool'
2024-10-08T22:27:22.4740669Z Entering 'third_party/pybind11'
2024-10-08T22:27:22.4794720Z Entering 'third_party/python-peachpy'
2024-10-08T22:27:22.4936878Z Entering 'third_party/sleef'
2024-10-08T22:27:22.4937775Z Entering 'third_party/tensorpipe'
2024-10-08T22:27:22.4959266Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T22:27:22.5013467Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T22:27:22.5065226Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T22:27:22.5117778Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T22:27:22.5169539Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T22:27:22.5243549Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-10-08T22:27:22.5272576Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5281588Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2024-10-08T22:27:22.5319294Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-10-08T22:27:22.5612646Z Entering 'android/libs/fbjni'
2024-10-08T22:27:22.5648815Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5682469Z Entering 'third_party/FP16'
2024-10-08T22:27:22.5718164Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5751057Z Entering 'third_party/FXdiv'
2024-10-08T22:27:22.5786278Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5818515Z Entering 'third_party/NNPACK'
2024-10-08T22:27:22.5853908Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5886233Z Entering 'third_party/NVTX'
2024-10-08T22:27:22.5921494Z http.https://github.com/.extraheader
2024-10-08T22:27:22.5954467Z Entering 'third_party/VulkanMemoryAllocator'
2024-10-08T22:27:22.5989790Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6022832Z Entering 'third_party/XNNPACK'
2024-10-08T22:27:22.6059286Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6109115Z Entering 'third_party/benchmark'
2024-10-08T22:27:22.6145123Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6177793Z Entering 'third_party/cpp-httplib'
2024-10-08T22:27:22.6214350Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6246826Z Entering 'third_party/cpuinfo'
2024-10-08T22:27:22.6282591Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6317746Z Entering 'third_party/cudnn_frontend'
2024-10-08T22:27:22.6353924Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6387141Z Entering 'third_party/cutlass'
2024-10-08T22:27:22.6422638Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6464314Z Entering 'third_party/eigen'
2024-10-08T22:27:22.6501239Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6537619Z Entering 'third_party/fbgemm'
2024-10-08T22:27:22.6573574Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6606813Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-10-08T22:27:22.6642217Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6676151Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-10-08T22:27:22.6712877Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6745883Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-10-08T22:27:22.6781154Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6824268Z Entering 'third_party/fbgemm/third_party/googletest'
2024-10-08T22:27:22.6859141Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6892724Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-10-08T22:27:22.6928350Z http.https://github.com/.extraheader
2024-10-08T22:27:22.6962504Z Entering 'third_party/flatbuffers'
2024-10-08T22:27:22.7000442Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7035823Z Entering 'third_party/fmt'
2024-10-08T22:27:22.7071243Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7104229Z Entering 'third_party/gemmlowp/gemmlowp'
2024-10-08T22:27:22.7140414Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7172939Z Entering 'third_party/gloo'
2024-10-08T22:27:22.7208591Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7241517Z Entering 'third_party/googletest'
2024-10-08T22:27:22.7277341Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7311117Z Entering 'third_party/ideep'
2024-10-08T22:27:22.7347338Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7378644Z Entering 'third_party/ideep/mkl-dnn'
2024-10-08T22:27:22.7415059Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7456225Z Entering 'third_party/ittapi'
2024-10-08T22:27:22.7492397Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7524905Z Entering 'third_party/kineto'
2024-10-08T22:27:22.7560572Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7594169Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-10-08T22:27:22.7629914Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7663443Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-10-08T22:27:22.7698920Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7733567Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-10-08T22:27:22.7769016Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7803233Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-10-08T22:27:22.7837985Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7871570Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-10-08T22:27:22.7906867Z http.https://github.com/.extraheader
2024-10-08T22:27:22.7938917Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-10-08T22:27:22.7973783Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8010039Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-10-08T22:27:22.8045683Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8078439Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-10-08T22:27:22.8114559Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8147985Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-10-08T22:27:22.8183181Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8217781Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-10-08T22:27:22.8253921Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8289657Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-10-08T22:27:22.8327782Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8361414Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-10-08T22:27:22.8397181Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8432249Z Entering 'third_party/mimalloc'
2024-10-08T22:27:22.8469043Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8503612Z Entering 'third_party/nccl/nccl'
2024-10-08T22:27:22.8541041Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8576238Z Entering 'third_party/nlohmann'
2024-10-08T22:27:22.8613386Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8649639Z Entering 'third_party/onnx'
2024-10-08T22:27:22.8686245Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8738621Z Entering 'third_party/onnx/third_party/benchmark'
2024-10-08T22:27:22.8776100Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8812699Z Entering 'third_party/onnx/third_party/pybind11'
2024-10-08T22:27:22.8849818Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8886494Z Entering 'third_party/opentelemetry-cpp'
2024-10-08T22:27:22.8924841Z http.https://github.com/.extraheader
2024-10-08T22:27:22.8961914Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-10-08T22:27:22.8998131Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9032635Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-10-08T22:27:22.9068304Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9103279Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-10-08T22:27:22.9138794Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9172952Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-10-08T22:27:22.9208781Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9245472Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-10-08T22:27:22.9281154Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9316376Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-10-08T22:27:22.9352957Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9386257Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-10-08T22:27:22.9423268Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9456560Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-10-08T22:27:22.9494439Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9532731Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-10-08T22:27:22.9569324Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9607648Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-10-08T22:27:22.9643374Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9700716Z Entering 'third_party/pocketfft'
2024-10-08T22:27:22.9738131Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9773774Z Entering 'third_party/protobuf'
2024-10-08T22:27:22.9812343Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9851646Z Entering 'third_party/protobuf/third_party/benchmark'
2024-10-08T22:27:22.9887860Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9921950Z Entering 'third_party/protobuf/third_party/googletest'
2024-10-08T22:27:22.9959205Z http.https://github.com/.extraheader
2024-10-08T22:27:22.9996534Z Entering 'third_party/psimd'
2024-10-08T22:27:23.0033984Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0068534Z Entering 'third_party/pthreadpool'
2024-10-08T22:27:23.0105838Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0142452Z Entering 'third_party/pybind11'
2024-10-08T22:27:23.0179462Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0214240Z Entering 'third_party/python-peachpy'
2024-10-08T22:27:23.0251470Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0285234Z Entering 'third_party/sleef'
2024-10-08T22:27:23.0321654Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0354658Z Entering 'third_party/tensorpipe'
2024-10-08T22:27:23.0390673Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0423624Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-10-08T22:27:23.0458342Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0492332Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-10-08T22:27:23.0528085Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0560894Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-10-08T22:27:23.0597767Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0631198Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-10-08T22:27:23.0666337Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0698889Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-10-08T22:27:23.0734612Z http.https://github.com/.extraheader
2024-10-08T22:27:23.0856255Z A job completed hook has been configured by the self-hosted runner administrator
2024-10-08T22:27:23.0876915Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2024-10-08T22:27:23.0882301Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-10-08T22:27:23.0882836Z ##[endgroup]
2024-10-08T22:27:32.3894810Z Cleaning up orphan processes