2024-12-18T00:09:40.8433967Z Current runner version: '2.321.0'
2024-12-18T00:09:40.8441560Z Runner name: 'i-0e3f9f9d03e28a547'
2024-12-18T00:09:40.8442482Z Runner group name: 'Default'
2024-12-18T00:09:40.8443569Z Machine name: 'ip-10-0-43-255'
2024-12-18T00:09:40.8448239Z ##[group]GITHUB_TOKEN Permissions
2024-12-18T00:09:40.8451159Z Actions: read
2024-12-18T00:09:40.8451830Z Attestations: read
2024-12-18T00:09:40.8452567Z Checks: read
2024-12-18T00:09:40.8453139Z Contents: read
2024-12-18T00:09:40.8453763Z Deployments: read
2024-12-18T00:09:40.8454703Z Discussions: read
2024-12-18T00:09:40.8455342Z Issues: read
2024-12-18T00:09:40.8455946Z Metadata: read
2024-12-18T00:09:40.8456570Z Packages: read
2024-12-18T00:09:40.8457190Z Pages: read
2024-12-18T00:09:40.8457803Z PullRequests: read
2024-12-18T00:09:40.8458528Z RepositoryProjects: read
2024-12-18T00:09:40.8459234Z SecurityEvents: read
2024-12-18T00:09:40.8459824Z Statuses: read
2024-12-18T00:09:40.8460513Z ##[endgroup]
2024-12-18T00:09:40.8464448Z Secret source: Actions
2024-12-18T00:09:40.8465643Z Prepare workflow directory
2024-12-18T00:09:40.8973164Z Prepare all required actions
2024-12-18T00:09:40.9013718Z Getting action download info
2024-12-18T00:09:41.2675314Z Download action repository 'pytorch/test-infra@release/2.6' (SHA:eb0adf5a84668865394af69e26428b32c8105c1c)
2024-12-18T00:09:42.9820819Z Download action repository 'pytorch/pytorch@release/2.6' (SHA:0cdf8b1d09254cfda66191d1bd01e3041c3c76f7)
2024-12-18T00:09:55.9151375Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0)
2024-12-18T00:09:56.1316862Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a)
2024-12-18T00:09:56.4064855Z Getting action download info
2024-12-18T00:09:56.5420519Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c)
2024-12-18T00:09:56.7966625Z Getting action download info
2024-12-18T00:09:56.9017951Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e)
2024-12-18T00:09:57.1107421Z Getting action download info
2024-12-18T00:09:57.2258318Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482)
2024-12-18T00:09:57.3994360Z Getting action download info
2024-12-18T00:09:57.5320413Z Download action repository 'pytorch/test-infra@main' (SHA:a07505a74641a4ff5123d635defac481ef28ef1e)
2024-12-18T00:09:58.8165713Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/release/2.6 (0cdf8b1d09254cfda66191d1bd01e3041c3c76f7)
2024-12-18T00:09:58.8167976Z ##[group] Inputs
2024-12-18T00:09:58.8168338Z   build-environment: linux-jammy-py3.9-gcc11
2024-12-18T00:09:58.8171286Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}
2024-12-18T00:09:58.8174518Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:09:58.8175246Z   sync-tag: 
2024-12-18T00:09:58.8176137Z   timeout-minutes: 240
2024-12-18T00:09:58.8176423Z   use-gha: 
2024-12-18T00:09:58.8177040Z   dashboard-tag: 
2024-12-18T00:09:58.8177420Z   s3-bucket: gha-artifacts
2024-12-18T00:09:58.8177724Z   aws-role-to-assume: 
2024-12-18T00:09:58.8178374Z   disable-monitor: false
2024-12-18T00:09:58.8178678Z ##[endgroup]
2024-12-18T00:09:58.8179085Z Complete job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:09:58.8691780Z A job started hook has been configured by the self-hosted runner administrator
2024-12-18T00:09:58.8802945Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2024-12-18T00:09:58.8812977Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:09:58.8813700Z ##[endgroup]
2024-12-18T00:10:00.0300442Z Runner Type: linux.2xlarge
2024-12-18T00:10:00.0300986Z Instance Type: c5.2xlarge
2024-12-18T00:10:00.0301297Z AMI Name: unknown
2024-12-18T00:10:00.0330028Z AMI ID: ami-0fff1b9a61dec8a5f
2024-12-18T00:10:06.2615845Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@release/2.6
2024-12-18T00:10:06.2616363Z with:
2024-12-18T00:10:06.2617091Z   github-secret: ***
2024-12-18T00:10:06.2617823Z   instructions: All testing is done inside the container, to start an interactive session run:
  docker exec -it $(docker container ps --format '{{.ID}}') bash

2024-12-18T00:10:06.2618610Z   activate-with-label: false
2024-12-18T00:10:06.2618904Z   label: with-ssh
2024-12-18T00:10:06.2619153Z   remove-existing-keys: true
2024-12-18T00:10:06.2619445Z   fail-silently: true
2024-12-18T00:10:06.2619699Z env:
2024-12-18T00:10:06.2619924Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:06.2620207Z ##[endgroup]
2024-12-18T00:10:06.3821583Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info.
2024-12-18T00:10:06.3822945Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys
2024-12-18T00:10:06.3947200Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@release/2.6
2024-12-18T00:10:06.3947699Z with:
2024-12-18T00:10:06.3947916Z   no-sudo: true
2024-12-18T00:10:06.3948200Z   submodules: recursive
2024-12-18T00:10:06.3948476Z   fetch-depth: 0
2024-12-18T00:10:06.3948726Z env:
2024-12-18T00:10:06.3948942Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:06.3949222Z ##[endgroup]
2024-12-18T00:10:06.4033273Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:10:06.4034264Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:10:06.4042949Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:10:06.4043429Z env:
2024-12-18T00:10:06.4043692Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:06.4043999Z ##[endgroup]
2024-12-18T00:10:06.4136930Z ##[group]Run retry () {
2024-12-18T00:10:06.4137256Z retry () {
2024-12-18T00:10:06.4137603Z   $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*)
2024-12-18T00:10:06.4138025Z }
2024-12-18T00:10:06.4138775Z echo "${GITHUB_WORKSPACE}"
2024-12-18T00:10:06.4139130Z if [ -z "${NO_SUDO}" ]; then
2024-12-18T00:10:06.4139495Z   retry sudo rm -rf "${GITHUB_WORKSPACE}"
2024-12-18T00:10:06.4139834Z else
2024-12-18T00:10:06.4140108Z   retry rm -rf "${GITHUB_WORKSPACE}"
2024-12-18T00:10:06.4140440Z fi
2024-12-18T00:10:06.4140692Z mkdir "${GITHUB_WORKSPACE}"
2024-12-18T00:10:06.4146476Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:10:06.4146876Z env:
2024-12-18T00:10:06.4147102Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:06.4147385Z   NO_SUDO: true
2024-12-18T00:10:06.4147630Z ##[endgroup]
2024-12-18T00:10:06.4170383Z /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:10:06.4256905Z ##[group]Run malfet/checkout@silent-checkout
2024-12-18T00:10:06.4257307Z with:
2024-12-18T00:10:06.4257575Z   ref: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:10:06.4258097Z   fetch-depth: 0
2024-12-18T00:10:06.4258357Z   submodules: recursive
2024-12-18T00:10:06.4258625Z   quiet-checkout: true
2024-12-18T00:10:06.4258913Z   repository: pytorch/pytorch
2024-12-18T00:10:06.4259339Z   token: ***
2024-12-18T00:10:06.4259579Z   ssh-strict: true
2024-12-18T00:10:06.4259849Z   persist-credentials: true
2024-12-18T00:10:06.4260139Z   clean: true
2024-12-18T00:10:06.4260387Z   sparse-checkout-cone-mode: true
2024-12-18T00:10:06.4260696Z   lfs: false
2024-12-18T00:10:06.4260937Z   set-safe-directory: true
2024-12-18T00:10:06.4261212Z env:
2024-12-18T00:10:06.4261432Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:10:06.4261702Z ##[endgroup]
2024-12-18T00:10:06.5124969Z Syncing repository: pytorch/pytorch
2024-12-18T00:10:06.5126435Z ##[group]Getting Git version info
2024-12-18T00:10:06.5126973Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-12-18T00:10:06.5127667Z [command]/usr/bin/git version
2024-12-18T00:10:06.5127968Z git version 2.40.1
2024-12-18T00:10:06.5136366Z ##[endgroup]
2024-12-18T00:10:06.5150742Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/96e0f6b7-eaf3-4f40-b30f-570fc8534d33' before making global git config changes
2024-12-18T00:10:06.5151741Z Adding repository directory to the temporary git global config as a safe directory
2024-12-18T00:10:06.5154866Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:10:06.5182875Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2024-12-18T00:10:06.5186080Z ##[group]Initializing the repository
2024-12-18T00:10:06.5188743Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:10:06.5212764Z hint: Using 'master' as the name for the initial branch. This default branch name
2024-12-18T00:10:06.5213420Z hint: is subject to change. To configure the initial branch name to use in all
2024-12-18T00:10:06.5214009Z hint: of your new repositories, which will suppress this warning, call:
2024-12-18T00:10:06.5214454Z hint: 
2024-12-18T00:10:06.5214768Z hint: 	git config --global init.defaultBranch <name>
2024-12-18T00:10:06.5215137Z hint: 
2024-12-18T00:10:06.5215536Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2024-12-18T00:10:06.5216115Z hint: 'development'. The just-created branch can be renamed via this command:
2024-12-18T00:10:06.5216570Z hint: 
2024-12-18T00:10:06.5216843Z hint: 	git branch -m <name>
2024-12-18T00:10:06.5217366Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/
2024-12-18T00:10:06.5222954Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch
2024-12-18T00:10:06.5246049Z ##[endgroup]
2024-12-18T00:10:06.5246541Z ##[group]Disabling automatic garbage collection
2024-12-18T00:10:06.5248638Z [command]/usr/bin/git config --local gc.auto 0
2024-12-18T00:10:06.5270049Z ##[endgroup]
2024-12-18T00:10:06.5270485Z ##[group]Setting up auth
2024-12-18T00:10:06.5274950Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-12-18T00:10:06.5296468Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-12-18T00:10:06.5585707Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-12-18T00:10:06.5607149Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-12-18T00:10:06.5856940Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-12-18T00:10:06.5901463Z ##[endgroup]
2024-12-18T00:10:06.5901960Z ##[group]Fetching the repository
2024-12-18T00:10:06.5907330Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/*
2024-12-18T00:10:09.4091652Z remote: Enumerating objects: 1056462        
2024-12-18T00:10:09.4092109Z remote: Enumerating objects: 1057261, done.        
2024-12-18T00:10:09.4094008Z remote: Counting objects:   0% (1/799)        
2024-12-18T00:10:09.4094689Z remote: Counting objects:   1% (8/799)        
2024-12-18T00:10:09.4095076Z remote: Counting objects:   2% (16/799)        
2024-12-18T00:10:09.4095534Z remote: Counting objects:   3% (24/799)        
2024-12-18T00:10:09.4096314Z remote: Counting objects:   4% (32/799)        
2024-12-18T00:10:09.4096696Z remote: Counting objects:   5% (40/799)        
2024-12-18T00:10:09.4097093Z remote: Counting objects:   6% (48/799)        
2024-12-18T00:10:09.4097811Z remote: Counting objects:   7% (56/799)        
2024-12-18T00:10:09.4098502Z remote: Counting objects:   8% (64/799)        
2024-12-18T00:10:09.4099104Z remote: Counting objects:   9% (72/799)        
2024-12-18T00:10:09.4099625Z remote: Counting objects:  10% (80/799)        
2024-12-18T00:10:09.4100311Z remote: Counting objects:  11% (88/799)        
2024-12-18T00:10:09.4100886Z remote: Counting objects:  12% (96/799)        
2024-12-18T00:10:09.4101480Z remote: Counting objects:  13% (104/799)        
2024-12-18T00:10:09.4102015Z remote: Counting objects:  14% (112/799)        
2024-12-18T00:10:09.4102693Z remote: Counting objects:  15% (120/799)        
2024-12-18T00:10:09.4103118Z remote: Counting objects:  16% (128/799)        
2024-12-18T00:10:09.4103757Z remote: Counting objects:  17% (136/799)        
2024-12-18T00:10:09.4104440Z remote: Counting objects:  18% (144/799)        
2024-12-18T00:10:09.4105113Z remote: Counting objects:  19% (152/799)        
2024-12-18T00:10:09.4106286Z remote: Counting objects:  20% (160/799)        
2024-12-18T00:10:09.4106735Z remote: Counting objects:  21% (168/799)        
2024-12-18T00:10:09.4107110Z remote: Counting objects:  22% (176/799)        
2024-12-18T00:10:09.4107483Z remote: Counting objects:  23% (184/799)        
2024-12-18T00:10:09.4107910Z remote: Counting objects:  24% (192/799)        
2024-12-18T00:10:09.4108340Z remote: Counting objects:  25% (200/799)        
2024-12-18T00:10:09.4108752Z remote: Counting objects:  26% (208/799)        
2024-12-18T00:10:09.4109186Z remote: Counting objects:  27% (216/799)        
2024-12-18T00:10:09.4109549Z remote: Counting objects:  28% (224/799)        
2024-12-18T00:10:09.4109920Z remote: Counting objects:  29% (232/799)        
2024-12-18T00:10:09.4110297Z remote: Counting objects:  30% (240/799)        
2024-12-18T00:10:09.4110724Z remote: Counting objects:  31% (248/799)        
2024-12-18T00:10:09.4111100Z remote: Counting objects:  32% (256/799)        
2024-12-18T00:10:09.4111480Z remote: Counting objects:  33% (264/799)        
2024-12-18T00:10:09.4111855Z remote: Counting objects:  34% (272/799)        
2024-12-18T00:10:09.4112218Z remote: Counting objects:  35% (280/799)        
2024-12-18T00:10:09.4112600Z remote: Counting objects:  36% (288/799)        
2024-12-18T00:10:09.4112975Z remote: Counting objects:  37% (296/799)        
2024-12-18T00:10:09.4113352Z remote: Counting objects:  38% (304/799)        
2024-12-18T00:10:09.4113727Z remote: Counting objects:  39% (312/799)        
2024-12-18T00:10:09.4114090Z remote: Counting objects:  40% (320/799)        
2024-12-18T00:10:09.4114467Z remote: Counting objects:  41% (328/799)        
2024-12-18T00:10:09.4114842Z remote: Counting objects:  42% (336/799)        
2024-12-18T00:10:09.4115217Z remote: Counting objects:  43% (344/799)        
2024-12-18T00:10:09.4115596Z remote: Counting objects:  44% (352/799)        
2024-12-18T00:10:09.4115962Z remote: Counting objects:  45% (360/799)        
2024-12-18T00:10:09.4116349Z remote: Counting objects:  46% (368/799)        
2024-12-18T00:10:09.4116725Z remote: Counting objects:  47% (376/799)        
2024-12-18T00:10:09.4117102Z remote: Counting objects:  48% (384/799)        
2024-12-18T00:10:09.4117480Z remote: Counting objects:  49% (392/799)        
2024-12-18T00:10:09.4118030Z remote: Counting objects:  50% (400/799)        
2024-12-18T00:10:09.4118396Z remote: Counting objects:  51% (408/799)        
2024-12-18T00:10:09.4118778Z remote: Counting objects:  52% (416/799)        
2024-12-18T00:10:09.4119157Z remote: Counting objects:  53% (424/799)        
2024-12-18T00:10:09.4119537Z remote: Counting objects:  54% (432/799)        
2024-12-18T00:10:09.4119916Z remote: Counting objects:  55% (440/799)        
2024-12-18T00:10:09.4120281Z remote: Counting objects:  56% (448/799)        
2024-12-18T00:10:09.4120656Z remote: Counting objects:  57% (456/799)        
2024-12-18T00:10:09.4121030Z remote: Counting objects:  58% (464/799)        
2024-12-18T00:10:09.4121403Z remote: Counting objects:  59% (472/799)        
2024-12-18T00:10:09.4121788Z remote: Counting objects:  60% (480/799)        
2024-12-18T00:10:09.4122149Z remote: Counting objects:  61% (488/799)        
2024-12-18T00:10:09.4122523Z remote: Counting objects:  62% (496/799)        
2024-12-18T00:10:09.4122934Z remote: Counting objects:  63% (504/799)        
2024-12-18T00:10:09.4123315Z remote: Counting objects:  64% (512/799)        
2024-12-18T00:10:09.4123784Z remote: Counting objects:  65% (520/799)        
2024-12-18T00:10:09.4124161Z remote: Counting objects:  66% (528/799)        
2024-12-18T00:10:09.4124538Z remote: Counting objects:  67% (536/799)        
2024-12-18T00:10:09.4124904Z remote: Counting objects:  68% (544/799)        
2024-12-18T00:10:09.4125278Z remote: Counting objects:  69% (552/799)        
2024-12-18T00:10:09.4125653Z remote: Counting objects:  70% (560/799)        
2024-12-18T00:10:09.4126026Z remote: Counting objects:  71% (568/799)        
2024-12-18T00:10:09.4126398Z remote: Counting objects:  72% (576/799)        
2024-12-18T00:10:09.4126843Z remote: Counting objects:  73% (584/799)        
2024-12-18T00:10:09.4127223Z remote: Counting objects:  74% (592/799)        
2024-12-18T00:10:09.4127599Z remote: Counting objects:  75% (600/799)        
2024-12-18T00:10:09.4127980Z remote: Counting objects:  76% (608/799)        
2024-12-18T00:10:09.4128353Z remote: Counting objects:  77% (616/799)        
2024-12-18T00:10:09.4128730Z remote: Counting objects:  78% (624/799)        
2024-12-18T00:10:09.4129094Z remote: Counting objects:  79% (632/799)        
2024-12-18T00:10:09.4129471Z remote: Counting objects:  80% (640/799)        
2024-12-18T00:10:09.4129845Z remote: Counting objects:  81% (648/799)        
2024-12-18T00:10:09.4130225Z remote: Counting objects:  82% (656/799)        
2024-12-18T00:10:09.4130606Z remote: Counting objects:  83% (664/799)        
2024-12-18T00:10:09.4130968Z remote: Counting objects:  84% (672/799)        
2024-12-18T00:10:09.4131349Z remote: Counting objects:  85% (680/799)        
2024-12-18T00:10:09.4131753Z remote: Counting objects:  86% (688/799)        
2024-12-18T00:10:09.4132130Z remote: Counting objects:  87% (696/799)        
2024-12-18T00:10:09.4132505Z remote: Counting objects:  88% (704/799)        
2024-12-18T00:10:09.4132872Z remote: Counting objects:  89% (712/799)        
2024-12-18T00:10:09.4133249Z remote: Counting objects:  90% (720/799)        
2024-12-18T00:10:09.4133625Z remote: Counting objects:  91% (728/799)        
2024-12-18T00:10:09.4134001Z remote: Counting objects:  92% (736/799)        
2024-12-18T00:10:09.4134377Z remote: Counting objects:  93% (744/799)        
2024-12-18T00:10:09.4134739Z remote: Counting objects:  94% (752/799)        
2024-12-18T00:10:09.4135114Z remote: Counting objects:  95% (760/799)        
2024-12-18T00:10:09.4135491Z remote: Counting objects:  96% (768/799)        
2024-12-18T00:10:09.4135863Z remote: Counting objects:  97% (776/799)        
2024-12-18T00:10:09.4136242Z remote: Counting objects:  98% (784/799)        
2024-12-18T00:10:09.4136621Z remote: Counting objects:  99% (792/799)        
2024-12-18T00:10:09.4137050Z remote: Counting objects: 100% (799/799)        
2024-12-18T00:10:09.4137456Z remote: Counting objects: 100% (799/799), done.        
2024-12-18T00:10:09.4137962Z remote: Compressing objects:   0% (1/293)        
2024-12-18T00:10:09.4271367Z remote: Compressing objects:   1% (3/293)        
2024-12-18T00:10:09.4306753Z remote: Compressing objects:   2% (6/293)        
2024-12-18T00:10:09.4378339Z remote: Compressing objects:   3% (9/293)        
2024-12-18T00:10:09.4555534Z remote: Compressing objects:   4% (12/293)        
2024-12-18T00:10:09.4963117Z remote: Compressing objects:   5% (15/293)        
2024-12-18T00:10:09.5221359Z remote: Compressing objects:   6% (18/293)        
2024-12-18T00:10:09.6047688Z remote: Compressing objects:   7% (21/293)        
2024-12-18T00:10:09.6552663Z remote: Compressing objects:   8% (24/293)        
2024-12-18T00:10:09.6985788Z remote: Compressing objects:   9% (27/293)        
2024-12-18T00:10:09.7224611Z remote: Compressing objects:  10% (30/293)        
2024-12-18T00:10:09.7346415Z remote: Compressing objects:  11% (33/293)        
2024-12-18T00:10:09.7458534Z remote: Compressing objects:  12% (36/293)        
2024-12-18T00:10:09.7523105Z remote: Compressing objects:  13% (39/293)        
2024-12-18T00:10:09.7527819Z remote: Compressing objects:  14% (42/293)        
2024-12-18T00:10:09.7530976Z remote: Compressing objects:  15% (44/293)        
2024-12-18T00:10:09.7534242Z remote: Compressing objects:  16% (47/293)        
2024-12-18T00:10:09.7538265Z remote: Compressing objects:  17% (50/293)        
2024-12-18T00:10:09.7541340Z remote: Compressing objects:  18% (53/293)        
2024-12-18T00:10:09.7544215Z remote: Compressing objects:  19% (56/293)        
2024-12-18T00:10:09.7546044Z remote: Compressing objects:  20% (59/293)        
2024-12-18T00:10:09.7550960Z remote: Compressing objects:  21% (62/293)        
2024-12-18T00:10:09.7556012Z remote: Compressing objects:  22% (65/293)        
2024-12-18T00:10:09.7558497Z remote: Compressing objects:  23% (68/293)        
2024-12-18T00:10:09.7569093Z remote: Compressing objects:  24% (71/293)        
2024-12-18T00:10:09.7576230Z remote: Compressing objects:  25% (74/293)        
2024-12-18T00:10:09.7580284Z remote: Compressing objects:  26% (77/293)        
2024-12-18T00:10:09.7583276Z remote: Compressing objects:  27% (80/293)        
2024-12-18T00:10:09.7584735Z remote: Compressing objects:  28% (83/293)        
2024-12-18T00:10:09.7586851Z remote: Compressing objects:  29% (85/293)        
2024-12-18T00:10:09.7596510Z remote: Compressing objects:  30% (88/293)        
2024-12-18T00:10:09.7597474Z remote: Compressing objects:  31% (91/293)        
2024-12-18T00:10:09.7603573Z remote: Compressing objects:  32% (94/293)        
2024-12-18T00:10:09.7605590Z remote: Compressing objects:  33% (97/293)        
2024-12-18T00:10:09.7610467Z remote: Compressing objects:  34% (100/293)        
2024-12-18T00:10:09.7616635Z remote: Compressing objects:  35% (103/293)        
2024-12-18T00:10:09.7618246Z remote: Compressing objects:  36% (106/293)        
2024-12-18T00:10:09.7621672Z remote: Compressing objects:  37% (109/293)        
2024-12-18T00:10:09.7623091Z remote: Compressing objects:  38% (112/293)        
2024-12-18T00:10:09.7628231Z remote: Compressing objects:  39% (115/293)        
2024-12-18T00:10:09.7634809Z remote: Compressing objects:  40% (118/293)        
2024-12-18T00:10:09.7635918Z remote: Compressing objects:  41% (121/293)        
2024-12-18T00:10:09.7636930Z remote: Compressing objects:  42% (124/293)        
2024-12-18T00:10:09.7642703Z remote: Compressing objects:  43% (126/293)        
2024-12-18T00:10:09.7646802Z remote: Compressing objects:  44% (129/293)        
2024-12-18T00:10:09.7647941Z remote: Compressing objects:  45% (132/293)        
2024-12-18T00:10:09.7652584Z remote: Compressing objects:  46% (135/293)        
2024-12-18T00:10:09.7654392Z remote: Compressing objects:  47% (138/293)        
2024-12-18T00:10:09.7656675Z remote: Compressing objects:  48% (141/293)        
2024-12-18T00:10:09.7658539Z remote: Compressing objects:  49% (144/293)        
2024-12-18T00:10:09.7660482Z remote: Compressing objects:  50% (147/293)        
2024-12-18T00:10:09.7662403Z remote: Compressing objects:  51% (150/293)        
2024-12-18T00:10:09.7665184Z remote: Compressing objects:  52% (153/293)        
2024-12-18T00:10:09.7666991Z remote: Compressing objects:  53% (156/293)        
2024-12-18T00:10:09.7669575Z remote: Compressing objects:  54% (159/293)        
2024-12-18T00:10:09.7672851Z remote: Compressing objects:  55% (162/293)        
2024-12-18T00:10:09.7674895Z remote: Compressing objects:  56% (165/293)        
2024-12-18T00:10:09.7676004Z remote: Compressing objects:  57% (168/293)        
2024-12-18T00:10:09.7677515Z remote: Compressing objects:  58% (170/293)        
2024-12-18T00:10:09.7681378Z remote: Compressing objects:  59% (173/293)        
2024-12-18T00:10:09.7682422Z remote: Compressing objects:  60% (176/293)        
2024-12-18T00:10:09.7684353Z remote: Compressing objects:  61% (179/293)        
2024-12-18T00:10:09.7686459Z remote: Compressing objects:  62% (182/293)        
2024-12-18T00:10:09.7692149Z remote: Compressing objects:  63% (185/293)        
2024-12-18T00:10:09.7695676Z remote: Compressing objects:  64% (188/293)        
2024-12-18T00:10:09.7699617Z remote: Compressing objects:  65% (191/293)        
2024-12-18T00:10:09.7700434Z remote: Compressing objects:  66% (194/293)        
2024-12-18T00:10:09.7703400Z remote: Compressing objects:  67% (197/293)        
2024-12-18T00:10:09.7704505Z remote: Compressing objects:  68% (200/293)        
2024-12-18T00:10:09.7708330Z remote: Compressing objects:  69% (203/293)        
2024-12-18T00:10:09.7711000Z remote: Compressing objects:  70% (206/293)        
2024-12-18T00:10:09.7712402Z remote: Compressing objects:  71% (209/293)        
2024-12-18T00:10:09.7715171Z remote: Compressing objects:  72% (211/293)        
2024-12-18T00:10:09.7716404Z remote: Compressing objects:  73% (214/293)        
2024-12-18T00:10:09.7718161Z remote: Compressing objects:  74% (217/293)        
2024-12-18T00:10:09.7719699Z remote: Compressing objects:  75% (220/293)        
2024-12-18T00:10:09.7721027Z remote: Compressing objects:  76% (223/293)        
2024-12-18T00:10:09.7721955Z remote: Compressing objects:  77% (226/293)        
2024-12-18T00:10:09.7723022Z remote: Compressing objects:  78% (229/293)        
2024-12-18T00:10:09.7723777Z remote: Compressing objects:  79% (232/293)        
2024-12-18T00:10:09.7724179Z remote: Compressing objects:  80% (235/293)        
2024-12-18T00:10:09.7725442Z remote: Compressing objects:  81% (238/293)        
2024-12-18T00:10:09.7726900Z remote: Compressing objects:  82% (241/293)        
2024-12-18T00:10:09.7728888Z remote: Compressing objects:  83% (244/293)        
2024-12-18T00:10:09.7731407Z remote: Compressing objects:  84% (247/293)        
2024-12-18T00:10:09.7733252Z remote: Compressing objects:  85% (250/293)        
2024-12-18T00:10:09.7734790Z remote: Compressing objects:  86% (252/293)        
2024-12-18T00:10:09.7736752Z remote: Compressing objects:  87% (255/293)        
2024-12-18T00:10:09.7738932Z remote: Compressing objects:  88% (258/293)        
2024-12-18T00:10:09.7740351Z remote: Compressing objects:  89% (261/293)        
2024-12-18T00:10:09.7741368Z remote: Compressing objects:  90% (264/293)        
2024-12-18T00:10:09.7742812Z remote: Compressing objects:  91% (267/293)        
2024-12-18T00:10:09.7744150Z remote: Compressing objects:  92% (270/293)        
2024-12-18T00:10:09.7782290Z remote: Compressing objects:  93% (273/293)        
2024-12-18T00:10:09.7783056Z remote: Compressing objects:  94% (276/293)        
2024-12-18T00:10:09.7783487Z remote: Compressing objects:  95% (279/293)        
2024-12-18T00:10:09.7784099Z remote: Compressing objects:  96% (282/293)        
2024-12-18T00:10:09.7784635Z remote: Compressing objects:  97% (285/293)        
2024-12-18T00:10:09.7785058Z remote: Compressing objects:  98% (288/293)        
2024-12-18T00:10:09.7785470Z remote: Compressing objects:  99% (291/293)        
2024-12-18T00:10:09.7785865Z remote: Compressing objects: 100% (293/293)        
2024-12-18T00:10:09.7786293Z remote: Compressing objects: 100% (293/293), done.        
2024-12-18T00:10:31.6557106Z remote: Total 1057261 (delta 656), reused 506 (delta 506), pack-reused 1056462 (from 4)        
2024-12-18T00:11:00.6463387Z [command]/usr/bin/git rev-parse --verify --quiet 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7^{object}
2024-12-18T00:11:00.6485771Z 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:00.6489624Z ##[endgroup]
2024-12-18T00:11:00.6490095Z ##[group]Determining the checkout info
2024-12-18T00:11:00.6490607Z ##[endgroup]
2024-12-18T00:11:00.6491013Z ##[group]Checking out the ref
2024-12-18T00:11:00.6493338Z [command]/usr/bin/git checkout --quiet --force 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:11:02.0564767Z ##[endgroup]
2024-12-18T00:11:02.0565265Z ##[group]Setting up auth for fetching submodules
2024-12-18T00:11:02.0567486Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic ***
2024-12-18T00:11:02.0612898Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf
2024-12-18T00:11:02.0634830Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com:
2024-12-18T00:11:02.0657640Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com:
2024-12-18T00:11:02.0680788Z ##[endgroup]
2024-12-18T00:11:02.0681232Z ##[group]Fetching submodules
2024-12-18T00:11:02.0683726Z [command]/usr/bin/git submodule sync --recursive
2024-12-18T00:11:02.0952395Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive
2024-12-18T00:11:02.1215427Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni'
2024-12-18T00:11:02.1217651Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16'
2024-12-18T00:11:02.1219719Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv'
2024-12-18T00:11:02.1222391Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK'
2024-12-18T00:11:02.1225245Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX'
2024-12-18T00:11:02.1228531Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator'
2024-12-18T00:11:02.1231290Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK'
2024-12-18T00:11:02.1234490Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
2024-12-18T00:11:02.1238020Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel'
2024-12-18T00:11:02.1241675Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib'
2024-12-18T00:11:02.1245233Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo'
2024-12-18T00:11:02.1248909Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend'
2024-12-18T00:11:02.1252449Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass'
2024-12-18T00:11:02.1256202Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen'
2024-12-18T00:11:02.1260030Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm'
2024-12-18T00:11:02.1264272Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers'
2024-12-18T00:11:02.1269837Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt'
2024-12-18T00:11:02.1274183Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:11:02.1278326Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo'
2024-12-18T00:11:02.1282800Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
2024-12-18T00:11:02.1287290Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep'
2024-12-18T00:11:02.1291856Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi'
2024-12-18T00:11:02.1296438Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto'
2024-12-18T00:11:02.1301155Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc'
2024-12-18T00:11:02.1305837Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl'
2024-12-18T00:11:02.1310761Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann'
2024-12-18T00:11:02.1315678Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx'
2024-12-18T00:11:02.1320994Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp'
2024-12-18T00:11:02.1326089Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft'
2024-12-18T00:11:02.1331607Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf'
2024-12-18T00:11:02.1336764Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd'
2024-12-18T00:11:02.1342567Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool'
2024-12-18T00:11:02.1347989Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
2024-12-18T00:11:02.1355018Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy'
2024-12-18T00:11:02.1360722Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef'
2024-12-18T00:11:02.1366730Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe'
2024-12-18T00:11:02.1393165Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'...
2024-12-18T00:11:02.4659659Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'...
2024-12-18T00:11:02.6655391Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'...
2024-12-18T00:11:02.9183105Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'...
2024-12-18T00:11:03.1646585Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NVTX'...
2024-12-18T00:11:03.5055111Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'...
2024-12-18T00:11:05.8963018Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'...
2024-12-18T00:11:19.7560115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'...
2024-12-18T00:11:20.1831557Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/composable_kernel'...
2024-12-18T00:11:22.3244890Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'...
2024-12-18T00:11:22.9733449Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'...
2024-12-18T00:11:23.6200096Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'...
2024-12-18T00:11:24.7666669Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'...
2024-12-18T00:11:26.8281213Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'...
2024-12-18T00:11:32.6548243Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'...
2024-12-18T00:11:34.5846142Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'...
2024-12-18T00:11:35.8645326Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'...
2024-12-18T00:11:37.2407920Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'...
2024-12-18T00:11:37.6775295Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'...
2024-12-18T00:11:38.0322900Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'...
2024-12-18T00:11:39.2200905Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'...
2024-12-18T00:11:39.6255376Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'...
2024-12-18T00:11:39.9022679Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'...
2024-12-18T00:11:41.3679219Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'...
2024-12-18T00:11:42.2926514Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'...
2024-12-18T00:11:42.6703162Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'...
2024-12-18T00:11:50.0870100Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'...
2024-12-18T00:11:52.4285565Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'...
2024-12-18T00:11:59.9516603Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'...
2024-12-18T00:12:00.2177156Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'...
2024-12-18T00:12:10.3308758Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'...
2024-12-18T00:12:10.5617568Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'...
2024-12-18T00:12:10.7719693Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'...
2024-12-18T00:12:11.9753847Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'...
2024-12-18T00:12:12.3055830Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'...
2024-12-18T00:12:12.9621617Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'...
2024-12-18T00:12:13.3943212Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f'
2024-12-18T00:12:13.4055608Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3'
2024-12-18T00:12:13.4141330Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1'
2024-12-18T00:12:13.4372698Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73'
2024-12-18T00:12:13.4697722Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1'
2024-12-18T00:12:13.5065696Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191'
2024-12-18T00:12:14.1987470Z Submodule path 'third_party/XNNPACK': checked out '4ea82e595b36106653175dcb04b2aa532660d0d8'
2024-12-18T00:12:14.2212544Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415'
2024-12-18T00:12:14.4444572Z Submodule path 'third_party/composable_kernel': checked out '50ee4267e27b875d149e642f4cebd47be1dc3b57'
2024-12-18T00:12:14.4917107Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006'
2024-12-18T00:12:14.5864657Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99'
2024-12-18T00:12:14.6191451Z Submodule path 'third_party/cudnn_frontend': checked out '936021bfed8c91dc416af1588b2c4eca631a9e45'
2024-12-18T00:12:15.1047831Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49'
2024-12-18T00:12:15.3505884Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c'
2024-12-18T00:12:15.4428971Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e'
2024-12-18T00:12:15.4446395Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:12:15.4448480Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:12:15.4450792Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:12:15.4453190Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:12:15.4455777Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:12:15.4480458Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'...
2024-12-18T00:12:16.4457019Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'...
2024-12-18T00:12:17.0452724Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'...
2024-12-18T00:12:19.2193970Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'...
2024-12-18T00:12:20.4035208Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'...
2024-12-18T00:12:20.7754141Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81'
2024-12-18T00:12:20.8689861Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3'
2024-12-18T00:12:21.2582089Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6'
2024-12-18T00:12:21.3188888Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796'
2024-12-18T00:12:21.3313164Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1'
2024-12-18T00:12:21.4578370Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b'
2024-12-18T00:12:21.4960243Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592'
2024-12-18T00:12:21.5352026Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350'
2024-12-18T00:12:21.5605791Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509'
2024-12-18T00:12:21.6032245Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59'
2024-12-18T00:12:21.6160237Z Submodule path 'third_party/ideep': checked out 'c7ccd5bdbe5434ba156f4e856dcef0601637334b'
2024-12-18T00:12:21.6174438Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn'
2024-12-18T00:12:21.6198150Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'...
2024-12-18T00:12:36.7684241Z Submodule path 'third_party/ideep/mkl-dnn': checked out '66f0cb9eb66affd2da3bf5f8d897376f04aae6af'
2024-12-18T00:12:36.7858497Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42'
2024-12-18T00:12:36.8698024Z Submodule path 'third_party/kineto': checked out '338140f58a28d599da3434ced4fd2d75dd1a213d'
2024-12-18T00:12:36.8714967Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:12:36.8716887Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:12:36.8719311Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:12:36.8745511Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'...
2024-12-18T00:12:37.8036775Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'...
2024-12-18T00:12:39.2459980Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'...
2024-12-18T00:12:40.4976561Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e'
2024-12-18T00:12:40.4992119Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:12:40.4994979Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:12:40.4997565Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:12:40.5000493Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:12:40.5003438Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:12:40.5006778Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:12:40.5009861Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:12:40.5013039Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:12:40.5039591Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'...
2024-12-18T00:12:41.4226147Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'...
2024-12-18T00:12:41.8049573Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'...
2024-12-18T00:12:43.2315083Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'...
2024-12-18T00:12:43.5535824Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'...
2024-12-18T00:12:44.0735258Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'...
2024-12-18T00:12:45.3862115Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'...
2024-12-18T00:12:53.3321589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'...
2024-12-18T00:12:53.7712584Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9'
2024-12-18T00:12:53.7886322Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400'
2024-12-18T00:12:53.8240242Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05'
2024-12-18T00:12:53.8371809Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067'
2024-12-18T00:12:53.8385731Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:12:53.8412376Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'...
2024-12-18T00:12:54.1906205Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4'
2024-12-18T00:12:54.2086080Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446'
2024-12-18T00:12:54.2475743Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850'
2024-12-18T00:12:54.3450266Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5'
2024-12-18T00:12:54.3602816Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150'
2024-12-18T00:12:54.3992779Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164'
2024-12-18T00:12:54.4565463Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347'
2024-12-18T00:12:54.4931656Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78'
2024-12-18T00:12:54.5221289Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290'
2024-12-18T00:12:54.6297724Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806'
2024-12-18T00:12:54.9717724Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c'
2024-12-18T00:12:54.9752108Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11'
2024-12-18T00:12:54.9778773Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'...
2024-12-18T00:12:56.1208399Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b'
2024-12-18T00:12:56.1866659Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878'
2024-12-18T00:12:56.1885882Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:12:56.1887803Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:12:56.1890254Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:12:56.1892718Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:12:56.1895485Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:12:56.1897990Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:12:56.1900689Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:12:56.1903312Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:12:56.1929228Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'...
2024-12-18T00:12:56.6274272Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'...
2024-12-18T00:12:57.7802334Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'...
2024-12-18T00:12:58.1089157Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'...
2024-12-18T00:13:05.5017721Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'...
2024-12-18T00:13:05.7976646Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'...
2024-12-18T00:13:06.0521231Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'...
2024-12-18T00:13:06.4146330Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'...
2024-12-18T00:13:13.3801718Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2'
2024-12-18T00:13:13.4193098Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1'
2024-12-18T00:13:13.4348854Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa'
2024-12-18T00:13:13.5392844Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d'
2024-12-18T00:13:13.5520910Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce'
2024-12-18T00:13:13.5659772Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5'
2024-12-18T00:13:13.5805498Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d'
2024-12-18T00:13:13.5820064Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:13.5822205Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:13.5846064Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'...
2024-12-18T00:13:15.8978109Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'...
2024-12-18T00:13:17.3294183Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4'
2024-12-18T00:13:17.3743817Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
2024-12-18T00:13:17.8203254Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50'
2024-12-18T00:13:17.8319947Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe'
2024-12-18T00:13:18.0999410Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a'
2024-12-18T00:13:18.1020731Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:18.1022722Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:18.1048966Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'...
2024-12-18T00:13:18.6083534Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'...
2024-12-18T00:13:19.8116764Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
2024-12-18T00:13:19.8812153Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081'
2024-12-18T00:13:19.8899741Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900'
2024-12-18T00:13:19.9016991Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8'
2024-12-18T00:13:19.9362447Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4'
2024-12-18T00:13:19.9645259Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67'
2024-12-18T00:13:20.0059329Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b'
2024-12-18T00:13:20.0314106Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e'
2024-12-18T00:13:20.0330342Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:20.0332741Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:20.0335444Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:20.0338482Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:20.0362516Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'...
2024-12-18T00:13:21.2023014Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'...
2024-12-18T00:13:21.4765808Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'...
2024-12-18T00:13:23.8688022Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'...
2024-12-18T00:13:25.2140141Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e'
2024-12-18T00:13:25.2295131Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281'
2024-12-18T00:13:25.2899728Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242'
2024-12-18T00:13:25.3203154Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef'
2024-12-18T00:13:25.3217200Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:25.3242911Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'...
2024-12-18T00:13:25.5621572Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
2024-12-18T00:13:25.5652072Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0
2024-12-18T00:13:25.5920912Z Entering 'android/libs/fbjni'
2024-12-18T00:13:25.5959312Z Entering 'third_party/FP16'
2024-12-18T00:13:25.5996532Z Entering 'third_party/FXdiv'
2024-12-18T00:13:25.6033799Z Entering 'third_party/NNPACK'
2024-12-18T00:13:25.6071342Z Entering 'third_party/NVTX'
2024-12-18T00:13:25.6108456Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:13:25.6145654Z Entering 'third_party/XNNPACK'
2024-12-18T00:13:25.6198025Z Entering 'third_party/benchmark'
2024-12-18T00:13:25.6236218Z Entering 'third_party/composable_kernel'
2024-12-18T00:13:25.6278604Z Entering 'third_party/cpp-httplib'
2024-12-18T00:13:25.6314830Z Entering 'third_party/cpuinfo'
2024-12-18T00:13:25.6354393Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:13:25.6390671Z Entering 'third_party/cutlass'
2024-12-18T00:13:25.6435862Z Entering 'third_party/eigen'
2024-12-18T00:13:25.6475330Z Entering 'third_party/fbgemm'
2024-12-18T00:13:25.6513311Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:13:25.6549933Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:13:25.6586974Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:13:25.6631452Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:13:25.6668839Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:13:25.6705588Z Entering 'third_party/flatbuffers'
2024-12-18T00:13:25.6746619Z Entering 'third_party/fmt'
2024-12-18T00:13:25.6785771Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:13:25.6823883Z Entering 'third_party/gloo'
2024-12-18T00:13:25.6863806Z Entering 'third_party/googletest'
2024-12-18T00:13:25.6902827Z Entering 'third_party/ideep'
2024-12-18T00:13:25.6940464Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:13:25.6985888Z Entering 'third_party/ittapi'
2024-12-18T00:13:25.7024113Z Entering 'third_party/kineto'
2024-12-18T00:13:25.7062672Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:13:25.7100273Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:13:25.7140354Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:13:25.7178240Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:13:25.7215330Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:13:25.7252538Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:13:25.7291298Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:13:25.7327454Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:13:25.7364235Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:13:25.7401671Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:13:25.7440301Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:13:25.7477735Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:13:25.7517580Z Entering 'third_party/mimalloc'
2024-12-18T00:13:25.7555724Z Entering 'third_party/nccl/nccl'
2024-12-18T00:13:25.7593042Z Entering 'third_party/nlohmann'
2024-12-18T00:13:25.7631629Z Entering 'third_party/onnx'
2024-12-18T00:13:25.7685864Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:13:25.7726541Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:13:25.7769147Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:13:25.7805765Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:13:25.7845660Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:13:25.7881856Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:13:25.7920428Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:13:25.7958191Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:13:25.7995342Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:13:25.8031048Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:25.8070824Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:25.8110097Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:13:25.8167692Z Entering 'third_party/pocketfft'
2024-12-18T00:13:25.8205677Z Entering 'third_party/protobuf'
2024-12-18T00:13:25.8247290Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:25.8284127Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:25.8323173Z Entering 'third_party/psimd'
2024-12-18T00:13:25.8361742Z Entering 'third_party/pthreadpool'
2024-12-18T00:13:25.8399210Z Entering 'third_party/pybind11'
2024-12-18T00:13:25.8437050Z Entering 'third_party/python-peachpy'
2024-12-18T00:13:25.8474664Z Entering 'third_party/sleef'
2024-12-18T00:13:25.8512670Z Entering 'third_party/tensorpipe'
2024-12-18T00:13:25.8550673Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:25.8588530Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:25.8625647Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:25.8663190Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:25.8699027Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:25.8749372Z ##[endgroup]
2024-12-18T00:13:25.8750623Z ##[group]Persisting credentials for submodules
2024-12-18T00:13:25.8754690Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :"
2024-12-18T00:13:25.9024226Z Entering 'android/libs/fbjni'
2024-12-18T00:13:25.9073505Z Entering 'third_party/FP16'
2024-12-18T00:13:25.9124397Z Entering 'third_party/FXdiv'
2024-12-18T00:13:25.9174309Z Entering 'third_party/NNPACK'
2024-12-18T00:13:25.9223103Z Entering 'third_party/NVTX'
2024-12-18T00:13:25.9271803Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:13:25.9320164Z Entering 'third_party/XNNPACK'
2024-12-18T00:13:25.9385630Z Entering 'third_party/benchmark'
2024-12-18T00:13:25.9435886Z Entering 'third_party/composable_kernel'
2024-12-18T00:13:25.9493289Z Entering 'third_party/cpp-httplib'
2024-12-18T00:13:25.9544059Z Entering 'third_party/cpuinfo'
2024-12-18T00:13:25.9594766Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:13:25.9647115Z Entering 'third_party/cutlass'
2024-12-18T00:13:25.9705990Z Entering 'third_party/eigen'
2024-12-18T00:13:25.9758806Z Entering 'third_party/fbgemm'
2024-12-18T00:13:25.9809489Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:13:25.9859172Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:13:25.9909495Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:13:25.9966157Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:13:26.0015035Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:13:26.0065006Z Entering 'third_party/flatbuffers'
2024-12-18T00:13:26.0117691Z Entering 'third_party/fmt'
2024-12-18T00:13:26.0167986Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:13:26.0217208Z Entering 'third_party/gloo'
2024-12-18T00:13:26.0267067Z Entering 'third_party/googletest'
2024-12-18T00:13:26.0316328Z Entering 'third_party/ideep'
2024-12-18T00:13:26.0364581Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:13:26.0420534Z Entering 'third_party/ittapi'
2024-12-18T00:13:26.0471249Z Entering 'third_party/kineto'
2024-12-18T00:13:26.0520765Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:13:26.0570968Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:13:26.0621772Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:13:26.0672983Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:13:26.0721915Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:13:26.0770388Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:13:26.0821241Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:13:26.0870010Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:13:26.0918246Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:13:26.0968738Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:13:26.1019081Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:13:26.1072830Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:13:26.1122778Z Entering 'third_party/mimalloc'
2024-12-18T00:13:26.1173712Z Entering 'third_party/nccl/nccl'
2024-12-18T00:13:26.1223745Z Entering 'third_party/nlohmann'
2024-12-18T00:13:26.1275960Z Entering 'third_party/onnx'
2024-12-18T00:13:26.1341209Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:13:26.1393016Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:13:26.1445115Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:13:26.1493850Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:13:26.1542745Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:13:26.1590488Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:13:26.1640256Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:13:26.1688443Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:13:26.1736694Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:13:26.1785008Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:26.1836698Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:26.1888060Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:13:26.1958276Z Entering 'third_party/pocketfft'
2024-12-18T00:13:26.2009530Z Entering 'third_party/protobuf'
2024-12-18T00:13:26.2062244Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:26.2111238Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:26.2163038Z Entering 'third_party/psimd'
2024-12-18T00:13:26.2213508Z Entering 'third_party/pthreadpool'
2024-12-18T00:13:26.2263480Z Entering 'third_party/pybind11'
2024-12-18T00:13:26.2313916Z Entering 'third_party/python-peachpy'
2024-12-18T00:13:26.2363980Z Entering 'third_party/sleef'
2024-12-18T00:13:26.2413889Z Entering 'third_party/tensorpipe'
2024-12-18T00:13:26.2463414Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:26.2512397Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:26.2560118Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:26.2608102Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:26.2655700Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:26.2719512Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url"
2024-12-18T00:13:26.2984347Z Entering 'android/libs/fbjni'
2024-12-18T00:13:26.3032139Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config	remote.origin.url
2024-12-18T00:13:26.3048060Z Entering 'third_party/FP16'
2024-12-18T00:13:26.3095001Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config	remote.origin.url
2024-12-18T00:13:26.3110281Z Entering 'third_party/FXdiv'
2024-12-18T00:13:26.3158882Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config	remote.origin.url
2024-12-18T00:13:26.3173971Z Entering 'third_party/NNPACK'
2024-12-18T00:13:26.3221082Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config	remote.origin.url
2024-12-18T00:13:26.3236112Z Entering 'third_party/NVTX'
2024-12-18T00:13:26.3282777Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config	remote.origin.url
2024-12-18T00:13:26.3298974Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:13:26.3345676Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config	remote.origin.url
2024-12-18T00:13:26.3360901Z Entering 'third_party/XNNPACK'
2024-12-18T00:13:26.3407130Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config	remote.origin.url
2024-12-18T00:13:26.3437108Z Entering 'third_party/benchmark'
2024-12-18T00:13:26.3484959Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:13:26.3499839Z Entering 'third_party/composable_kernel'
2024-12-18T00:13:26.3546855Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config	remote.origin.url
2024-12-18T00:13:26.3567195Z Entering 'third_party/cpp-httplib'
2024-12-18T00:13:26.3613342Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config	remote.origin.url
2024-12-18T00:13:26.3627757Z Entering 'third_party/cpuinfo'
2024-12-18T00:13:26.3674254Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config	remote.origin.url
2024-12-18T00:13:26.3689410Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:13:26.3735832Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config	remote.origin.url
2024-12-18T00:13:26.3750567Z Entering 'third_party/cutlass'
2024-12-18T00:13:26.3796341Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config	remote.origin.url
2024-12-18T00:13:26.3818924Z Entering 'third_party/eigen'
2024-12-18T00:13:26.3864307Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config	remote.origin.url
2024-12-18T00:13:26.3880908Z Entering 'third_party/fbgemm'
2024-12-18T00:13:26.3927521Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config	remote.origin.url
2024-12-18T00:13:26.3942265Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:13:26.3988859Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config	remote.origin.url
2024-12-18T00:13:26.4002649Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:13:26.4049159Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config	remote.origin.url
2024-12-18T00:13:26.4063370Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:13:26.4108946Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config	remote.origin.url
2024-12-18T00:13:26.4129780Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:13:26.4176103Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.4190227Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:13:26.4235661Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config	remote.origin.url
2024-12-18T00:13:26.4253692Z Entering 'third_party/flatbuffers'
2024-12-18T00:13:26.4300254Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config	remote.origin.url
2024-12-18T00:13:26.4318270Z Entering 'third_party/fmt'
2024-12-18T00:13:26.4365739Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config	remote.origin.url
2024-12-18T00:13:26.4380503Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:13:26.4426735Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config	remote.origin.url
2024-12-18T00:13:26.4441834Z Entering 'third_party/gloo'
2024-12-18T00:13:26.4488205Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config	remote.origin.url
2024-12-18T00:13:26.4502898Z Entering 'third_party/googletest'
2024-12-18T00:13:26.4549840Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.4564777Z Entering 'third_party/ideep'
2024-12-18T00:13:26.4611444Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config	remote.origin.url
2024-12-18T00:13:26.4625072Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:13:26.4671674Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config	remote.origin.url
2024-12-18T00:13:26.4693772Z Entering 'third_party/ittapi'
2024-12-18T00:13:26.4741136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config	remote.origin.url
2024-12-18T00:13:26.4755033Z Entering 'third_party/kineto'
2024-12-18T00:13:26.4801676Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config	remote.origin.url
2024-12-18T00:13:26.4816608Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:13:26.4863254Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config	remote.origin.url
2024-12-18T00:13:26.4876922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:13:26.4923913Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config	remote.origin.url
2024-12-18T00:13:26.4940204Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:13:26.4984840Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config	remote.origin.url
2024-12-18T00:13:26.4999641Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:13:26.5046014Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config	remote.origin.url
2024-12-18T00:13:26.5059492Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:13:26.5107557Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config	remote.origin.url
2024-12-18T00:13:26.5120245Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:13:26.5168325Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config	remote.origin.url
2024-12-18T00:13:26.5184261Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:13:26.5229736Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config	remote.origin.url
2024-12-18T00:13:26.5244623Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:13:26.5289851Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.5304330Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:13:26.5349438Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config	remote.origin.url
2024-12-18T00:13:26.5364728Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:13:26.5410130Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config	remote.origin.url
2024-12-18T00:13:26.5425943Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:13:26.5472571Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config	remote.origin.url
2024-12-18T00:13:26.5486701Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:13:26.5533248Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.5549057Z Entering 'third_party/mimalloc'
2024-12-18T00:13:26.5597529Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config	remote.origin.url
2024-12-18T00:13:26.5612034Z Entering 'third_party/nccl/nccl'
2024-12-18T00:13:26.5657353Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config	remote.origin.url
2024-12-18T00:13:26.5672232Z Entering 'third_party/nlohmann'
2024-12-18T00:13:26.5717490Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config	remote.origin.url
2024-12-18T00:13:26.5733244Z Entering 'third_party/onnx'
2024-12-18T00:13:26.5780284Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config	remote.origin.url
2024-12-18T00:13:26.5810738Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:13:26.5857818Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:13:26.5873639Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:13:26.5921786Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config	remote.origin.url
2024-12-18T00:13:26.5937529Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:13:26.5985446Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:13:26.5999655Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:13:26.6045681Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.6059852Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:13:26.6105013Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config	remote.origin.url
2024-12-18T00:13:26.6118833Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:13:26.6164301Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config	remote.origin.url
2024-12-18T00:13:26.6179824Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:13:26.6225964Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config	remote.origin.url
2024-12-18T00:13:26.6239882Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:13:26.6285466Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config	remote.origin.url
2024-12-18T00:13:26.6299290Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:13:26.6346125Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config	remote.origin.url
2024-12-18T00:13:26.6359732Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:26.6405300Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config	remote.origin.url
2024-12-18T00:13:26.6421606Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:26.6467612Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config	remote.origin.url
2024-12-18T00:13:26.6483242Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:13:26.6529051Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config	remote.origin.url
2024-12-18T00:13:26.6563273Z Entering 'third_party/pocketfft'
2024-12-18T00:13:26.6610646Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config	remote.origin.url
2024-12-18T00:13:26.6626050Z Entering 'third_party/protobuf'
2024-12-18T00:13:26.6672790Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config	remote.origin.url
2024-12-18T00:13:26.6691156Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:26.6736837Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config	remote.origin.url
2024-12-18T00:13:26.6751575Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:26.6797541Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.6814208Z Entering 'third_party/psimd'
2024-12-18T00:13:26.6861367Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config	remote.origin.url
2024-12-18T00:13:26.6876558Z Entering 'third_party/pthreadpool'
2024-12-18T00:13:26.6922405Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config	remote.origin.url
2024-12-18T00:13:26.6937614Z Entering 'third_party/pybind11'
2024-12-18T00:13:26.6984255Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:13:26.6999618Z Entering 'third_party/python-peachpy'
2024-12-18T00:13:26.7045111Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config	remote.origin.url
2024-12-18T00:13:26.7060060Z Entering 'third_party/sleef'
2024-12-18T00:13:26.7105120Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config	remote.origin.url
2024-12-18T00:13:26.7119716Z Entering 'third_party/tensorpipe'
2024-12-18T00:13:26.7166170Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config	remote.origin.url
2024-12-18T00:13:26.7180528Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:26.7225293Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config	remote.origin.url
2024-12-18T00:13:26.7240364Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:26.7285919Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config	remote.origin.url
2024-12-18T00:13:26.7300112Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:26.7345147Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config	remote.origin.url
2024-12-18T00:13:26.7359585Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:26.7431195Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config	remote.origin.url
2024-12-18T00:13:26.7444835Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:26.7490468Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config	remote.origin.url
2024-12-18T00:13:26.8286583Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:'
2024-12-18T00:13:26.8554343Z Entering 'android/libs/fbjni'
2024-12-18T00:13:26.8593268Z Entering 'third_party/FP16'
2024-12-18T00:13:26.8631477Z Entering 'third_party/FXdiv'
2024-12-18T00:13:26.8669327Z Entering 'third_party/NNPACK'
2024-12-18T00:13:26.8707781Z Entering 'third_party/NVTX'
2024-12-18T00:13:26.8745993Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:13:26.8784153Z Entering 'third_party/XNNPACK'
2024-12-18T00:13:26.8836895Z Entering 'third_party/benchmark'
2024-12-18T00:13:26.8875107Z Entering 'third_party/composable_kernel'
2024-12-18T00:13:26.8918678Z Entering 'third_party/cpp-httplib'
2024-12-18T00:13:26.8958037Z Entering 'third_party/cpuinfo'
2024-12-18T00:13:26.8997262Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:13:26.9034902Z Entering 'third_party/cutlass'
2024-12-18T00:13:26.9080373Z Entering 'third_party/eigen'
2024-12-18T00:13:26.9120617Z Entering 'third_party/fbgemm'
2024-12-18T00:13:26.9160294Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:13:26.9197743Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:13:26.9235554Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:13:26.9279596Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:13:26.9316867Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:13:26.9356750Z Entering 'third_party/flatbuffers'
2024-12-18T00:13:26.9398112Z Entering 'third_party/fmt'
2024-12-18T00:13:26.9435829Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:13:26.9474335Z Entering 'third_party/gloo'
2024-12-18T00:13:26.9512252Z Entering 'third_party/googletest'
2024-12-18T00:13:26.9551182Z Entering 'third_party/ideep'
2024-12-18T00:13:26.9588809Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:13:26.9632671Z Entering 'third_party/ittapi'
2024-12-18T00:13:26.9671110Z Entering 'third_party/kineto'
2024-12-18T00:13:26.9709006Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:13:26.9746683Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:13:26.9785950Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:13:26.9823258Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:13:26.9862195Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:13:26.9899977Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:13:26.9940290Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:13:26.9977713Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:13:27.0015893Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:13:27.0055293Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:13:27.0093647Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:13:27.0130904Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:13:27.0170335Z Entering 'third_party/mimalloc'
2024-12-18T00:13:27.0209596Z Entering 'third_party/nccl/nccl'
2024-12-18T00:13:27.0247726Z Entering 'third_party/nlohmann'
2024-12-18T00:13:27.0287031Z Entering 'third_party/onnx'
2024-12-18T00:13:27.0341788Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:13:27.0383209Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:13:27.0423567Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:13:27.0463991Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:13:27.0501369Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:13:27.0538956Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:13:27.0577108Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:13:27.0613935Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:13:27.0651821Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:13:27.0689218Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:27.0729507Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:27.0768698Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:13:27.0825045Z Entering 'third_party/pocketfft'
2024-12-18T00:13:27.0878202Z Entering 'third_party/protobuf'
2024-12-18T00:13:27.0906716Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:27.0945128Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:27.0983833Z Entering 'third_party/psimd'
2024-12-18T00:13:27.1022156Z Entering 'third_party/pthreadpool'
2024-12-18T00:13:27.1061486Z Entering 'third_party/pybind11'
2024-12-18T00:13:27.1100062Z Entering 'third_party/python-peachpy'
2024-12-18T00:13:27.1139632Z Entering 'third_party/sleef'
2024-12-18T00:13:27.1178322Z Entering 'third_party/tensorpipe'
2024-12-18T00:13:27.1216166Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:27.1253974Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:27.1290213Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:27.1327288Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:27.1363701Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:27.1416578Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:'
2024-12-18T00:13:27.1685386Z Entering 'android/libs/fbjni'
2024-12-18T00:13:27.1721895Z Entering 'third_party/FP16'
2024-12-18T00:13:27.1760942Z Entering 'third_party/FXdiv'
2024-12-18T00:13:27.1797962Z Entering 'third_party/NNPACK'
2024-12-18T00:13:27.1835514Z Entering 'third_party/NVTX'
2024-12-18T00:13:27.1873850Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T00:13:27.1911399Z Entering 'third_party/XNNPACK'
2024-12-18T00:13:27.1965696Z Entering 'third_party/benchmark'
2024-12-18T00:13:27.2006160Z Entering 'third_party/composable_kernel'
2024-12-18T00:13:27.2050380Z Entering 'third_party/cpp-httplib'
2024-12-18T00:13:27.2088797Z Entering 'third_party/cpuinfo'
2024-12-18T00:13:27.2127825Z Entering 'third_party/cudnn_frontend'
2024-12-18T00:13:27.2167193Z Entering 'third_party/cutlass'
2024-12-18T00:13:27.2212791Z Entering 'third_party/eigen'
2024-12-18T00:13:27.2253398Z Entering 'third_party/fbgemm'
2024-12-18T00:13:27.2292898Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T00:13:27.2330528Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T00:13:27.2368165Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T00:13:27.2411156Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T00:13:27.2448156Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T00:13:27.2486144Z Entering 'third_party/flatbuffers'
2024-12-18T00:13:27.2526952Z Entering 'third_party/fmt'
2024-12-18T00:13:27.2567428Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T00:13:27.2604510Z Entering 'third_party/gloo'
2024-12-18T00:13:27.2642556Z Entering 'third_party/googletest'
2024-12-18T00:13:27.2679959Z Entering 'third_party/ideep'
2024-12-18T00:13:27.2717694Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T00:13:27.2761602Z Entering 'third_party/ittapi'
2024-12-18T00:13:27.2799629Z Entering 'third_party/kineto'
2024-12-18T00:13:27.2836833Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T00:13:27.2874221Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T00:13:27.2913119Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T00:13:27.2951154Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T00:13:27.2989965Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T00:13:27.3026922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T00:13:27.3066753Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T00:13:27.3104119Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T00:13:27.3143373Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T00:13:27.3181882Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T00:13:27.3220625Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T00:13:27.3258331Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T00:13:27.3297316Z Entering 'third_party/mimalloc'
2024-12-18T00:13:27.3336571Z Entering 'third_party/nccl/nccl'
2024-12-18T00:13:27.3375118Z Entering 'third_party/nlohmann'
2024-12-18T00:13:27.3414044Z Entering 'third_party/onnx'
2024-12-18T00:13:27.3468517Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T00:13:27.3509181Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T00:13:27.3549314Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T00:13:27.3586389Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T00:13:27.3623486Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T00:13:27.3660517Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T00:13:27.3698712Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T00:13:27.3735421Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T00:13:27.3772624Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T00:13:27.3808670Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T00:13:27.3847831Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T00:13:27.3886591Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T00:13:27.3943916Z Entering 'third_party/pocketfft'
2024-12-18T00:13:27.3983089Z Entering 'third_party/protobuf'
2024-12-18T00:13:27.4050331Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T00:13:27.4087472Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T00:13:27.4127532Z Entering 'third_party/psimd'
2024-12-18T00:13:27.4167570Z Entering 'third_party/pthreadpool'
2024-12-18T00:13:27.4205294Z Entering 'third_party/pybind11'
2024-12-18T00:13:27.4243575Z Entering 'third_party/python-peachpy'
2024-12-18T00:13:27.4281458Z Entering 'third_party/sleef'
2024-12-18T00:13:27.4319234Z Entering 'third_party/tensorpipe'
2024-12-18T00:13:27.4357151Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T00:13:27.4394921Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T00:13:27.4430826Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T00:13:27.4469541Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T00:13:27.4506147Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T00:13:27.4556226Z ##[endgroup]
2024-12-18T00:13:27.4584965Z [command]/usr/bin/git log -1 --format='%H'
2024-12-18T00:13:27.4603491Z '0cdf8b1d09254cfda66191d1bd01e3041c3c76f7'
2024-12-18T00:13:27.4763924Z Prepare all required actions
2024-12-18T00:13:27.4764518Z Getting action download info
2024-12-18T00:13:27.6885671Z ##[group]Run ./.github/actions/setup-linux
2024-12-18T00:13:27.6886016Z env:
2024-12-18T00:13:27.6886246Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:27.6886521Z ##[endgroup]
2024-12-18T00:13:27.6936821Z ##[group]Run set -euo pipefail
2024-12-18T00:13:27.6937221Z set -euo pipefail
2024-12-18T00:13:27.6937513Z function get_ec2_metadata() {
2024-12-18T00:13:27.6937908Z   # Pulled from instance metadata endpoint for EC2
2024-12-18T00:13:27.6938781Z   # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html
2024-12-18T00:13:27.6939358Z   category=$1
2024-12-18T00:13:27.6939737Z   # If it is GCP runner (runner name contains gcp), do not run this
2024-12-18T00:13:27.6940189Z   runner_name_str=i-0e3f9f9d03e28a547
2024-12-18T00:13:27.6940588Z   if [[ -f /.inarc ]]; then
2024-12-18T00:13:27.6940950Z     echo "ARC Runner, no info on ec2 metadata"
2024-12-18T00:13:27.6941340Z   elif [[ $runner_name_str == *"gcp"* ]]; then
2024-12-18T00:13:27.6941826Z     echo "Runner is from Google Cloud Platform, No info on ec2 metadata"
2024-12-18T00:13:27.6942264Z   else
2024-12-18T00:13:27.6943134Z     curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}"
2024-12-18T00:13:27.6944055Z   fi
2024-12-18T00:13:27.6944287Z }
2024-12-18T00:13:27.6944551Z echo "ami-id: $(get_ec2_metadata ami-id)"
2024-12-18T00:13:27.6944990Z echo "instance-id: $(get_ec2_metadata instance-id)"
2024-12-18T00:13:27.6945481Z echo "instance-type: $(get_ec2_metadata instance-type)"
2024-12-18T00:13:27.6945908Z echo "system info $(uname -a)"
2024-12-18T00:13:27.6954517Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:27.6954912Z env:
2024-12-18T00:13:27.6955126Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:27.6955397Z ##[endgroup]
2024-12-18T00:13:27.7099497Z ami-id: ami-0fff1b9a61dec8a5f
2024-12-18T00:13:27.7195197Z instance-id: i-0e3f9f9d03e28a547
2024-12-18T00:13:27.7288885Z instance-type: c5.2xlarge
2024-12-18T00:13:27.7298858Z system info Linux ip-10-0-43-255.ec2.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
2024-12-18T00:13:27.7329379Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:13:27.7330334Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:13:27.7337159Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:27.7337568Z env:
2024-12-18T00:13:27.7337788Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:27.7338066Z ##[endgroup]
2024-12-18T00:13:27.7398120Z ##[group]Run if systemctl is-active --quiet docker; then
2024-12-18T00:13:27.7398587Z if systemctl is-active --quiet docker; then
2024-12-18T00:13:27.7398992Z     echo "Docker daemon is running...";
2024-12-18T00:13:27.7399453Z else
2024-12-18T00:13:27.7399825Z     echo "Starting docker deamon..." && sudo systemctl start docker;
2024-12-18T00:13:27.7400266Z fi
2024-12-18T00:13:27.7405833Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:27.7406228Z env:
2024-12-18T00:13:27.7406456Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:27.7406731Z ##[endgroup]
2024-12-18T00:13:27.7479156Z Docker daemon is running...
2024-12-18T00:13:27.7526374Z ##[group]Run nick-fields/retry@v3.0.0
2024-12-18T00:13:27.7526687Z with:
2024-12-18T00:13:27.7526909Z   shell: bash
2024-12-18T00:13:27.7527302Z   timeout_minutes: 5
2024-12-18T00:13:27.7527572Z   max_attempts: 3
2024-12-18T00:13:27.7527829Z   retry_wait_seconds: 30
2024-12-18T00:13:27.7530092Z   command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\")
aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
    --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"

# For LF Runners we need to make sure we also login to Meta's ECR docker registry too.
META_AWS_ACCOUNT_ID=308535385114
if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then
    aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
        --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"
fi

2024-12-18T00:13:27.7532388Z   polling_interval_seconds: 1
2024-12-18T00:13:27.7532695Z   warning_on_retry: true
2024-12-18T00:13:27.7532975Z   continue_on_error: false
2024-12-18T00:13:27.7533237Z env:
2024-12-18T00:13:27.7533466Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:27.7533747Z   AWS_RETRY_MODE: standard
2024-12-18T00:13:27.7534020Z   AWS_MAX_ATTEMPTS: 5
2024-12-18T00:13:27.7534288Z   AWS_DEFAULT_REGION: us-east-1
2024-12-18T00:13:27.7534566Z ##[endgroup]
2024-12-18T00:13:28.9464335Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:13:28.9464974Z Configure a credential helper to remove this warning. See
2024-12-18T00:13:28.9465608Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:13:28.9465998Z 
2024-12-18T00:13:28.9466117Z Login Succeeded
2024-12-18T00:13:29.8404442Z Command completed after 1 attempt(s).
2024-12-18T00:13:29.8462698Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:13:29.8463250Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:13:29.8463726Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2024-12-18T00:13:29.8470209Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:29.8470591Z env:
2024-12-18T00:13:29.8470821Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:29.8471093Z ##[endgroup]
2024-12-18T00:13:29.8578574Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:13:29.8579187Z # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T00:13:29.8579648Z # shellcheck disable=SC2046
2024-12-18T00:13:29.8580007Z docker stop $(docker ps -q) || true
2024-12-18T00:13:29.8580374Z # Prune all of the docker images
2024-12-18T00:13:29.8580707Z docker system prune -af
2024-12-18T00:13:29.8586400Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:29.8586796Z env:
2024-12-18T00:13:29.8587030Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:29.8587312Z ##[endgroup]
2024-12-18T00:13:29.8831695Z "docker stop" requires at least 1 argument.
2024-12-18T00:13:29.8832122Z See 'docker stop --help'.
2024-12-18T00:13:29.8832317Z 
2024-12-18T00:13:29.8832515Z Usage:  docker stop [OPTIONS] CONTAINER [CONTAINER...]
2024-12-18T00:13:29.8832792Z 
2024-12-18T00:13:29.8832924Z Stop one or more running containers
2024-12-18T00:13:29.9030946Z Total reclaimed space: 0B
2024-12-18T00:13:29.9068249Z ##[group]Run set +e
2024-12-18T00:13:29.9068563Z set +e
2024-12-18T00:13:29.9068806Z set -x
2024-12-18T00:13:29.9069179Z 
2024-12-18T00:13:29.9069423Z PT_DOMAIN=download.pytorch.org
2024-12-18T00:13:29.9070017Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400,
2024-12-18T00:13:29.9070787Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last
2024-12-18T00:13:29.9071335Z # one is returned at random
2024-12-18T00:13:29.9071746Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1)
2024-12-18T00:13:29.9072141Z 
2024-12-18T00:13:29.9072487Z if [ -z "${RESOLVED_IP}" ]; then
2024-12-18T00:13:29.9072939Z   echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..."
2024-12-18T00:13:29.9073480Z   RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1)
2024-12-18T00:13:29.9073879Z 
2024-12-18T00:13:29.9088670Z   if [ -z "${RESOLVED_IP}" ]; then
2024-12-18T00:13:29.9089193Z     echo "Couldn't resolve ${PT_DOMAIN}, exiting..."
2024-12-18T00:13:29.9089605Z     exit 1
2024-12-18T00:13:29.9089843Z   fi
2024-12-18T00:13:29.9090073Z fi
2024-12-18T00:13:29.9090301Z 
2024-12-18T00:13:29.9090575Z if grep -r "${PT_DOMAIN}" /etc/hosts; then
2024-12-18T00:13:29.9090960Z   # Clean up any old records first
2024-12-18T00:13:29.9091323Z   sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts
2024-12-18T00:13:29.9091661Z fi
2024-12-18T00:13:29.9091883Z 
2024-12-18T00:13:29.9092216Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts
2024-12-18T00:13:29.9092629Z cat /etc/hosts
2024-12-18T00:13:29.9098475Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:29.9098870Z env:
2024-12-18T00:13:29.9099104Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:29.9099372Z ##[endgroup]
2024-12-18T00:13:29.9122547Z + PT_DOMAIN=download.pytorch.org
2024-12-18T00:13:29.9128547Z ++ dig -4 +short download.pytorch.org
2024-12-18T00:13:29.9129225Z ++ tail -n1
2024-12-18T00:13:29.9636116Z + RESOLVED_IP=3.171.85.47
2024-12-18T00:13:29.9636609Z + '[' -z 3.171.85.47 ']'
2024-12-18T00:13:29.9636909Z + grep -r download.pytorch.org /etc/hosts
2024-12-18T00:13:29.9651584Z + echo '3.171.85.47 download.pytorch.org'
2024-12-18T00:13:29.9651984Z + sudo tee -a /etc/hosts
2024-12-18T00:13:30.1726158Z 3.171.85.47 download.pytorch.org
2024-12-18T00:13:30.1741754Z + cat /etc/hosts
2024-12-18T00:13:30.1749777Z 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
2024-12-18T00:13:30.1755547Z ::1         localhost6 localhost6.localdomain6
2024-12-18T00:13:30.1756045Z 3.171.85.47 download.pytorch.org
2024-12-18T00:13:30.1912201Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@release/2.6
2024-12-18T00:13:30.1912697Z with:
2024-12-18T00:13:30.1913359Z   docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.1914137Z   docker-build-dir: .ci/docker
2024-12-18T00:13:30.1914435Z   working-directory: .
2024-12-18T00:13:30.1914799Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.1915208Z   force-push: false
2024-12-18T00:13:30.1915436Z env:
2024-12-18T00:13:30.1915663Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:30.1915929Z ##[endgroup]
2024-12-18T00:13:30.1942805Z ##[group]Run set -ex
2024-12-18T00:13:30.1943255Z set -ex
2024-12-18T00:13:30.1943518Z 
2024-12-18T00:13:30.1943925Z # If the docker build directory or the build script doesn't exist, the action will
2024-12-18T00:13:30.1944658Z # gracefully return the docker image name as it is.  Pulling docker image in Linux
2024-12-18T00:13:30.1945237Z # job could then download the pre-built image as usual
2024-12-18T00:13:30.1945746Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then
2024-12-18T00:13:30.1946526Z   echo "skip=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1946991Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1947413Z 
2024-12-18T00:13:30.1947780Z   echo "There is no Docker build script in ${REPO_NAME} repo, skipping..."
2024-12-18T00:13:30.1948215Z   exit 0
2024-12-18T00:13:30.1948561Z else
2024-12-18T00:13:30.1948948Z   echo "skip=false" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1949475Z fi
2024-12-18T00:13:30.1949787Z 
2024-12-18T00:13:30.1950342Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then
2024-12-18T00:13:30.1951330Z   # The docker image name already includes the ECR prefix and tag, so we can just
2024-12-18T00:13:30.1952009Z   # use it as it is, but first let's extract the tag
2024-12-18T00:13:30.1952512Z   DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}')
2024-12-18T00:13:30.1953049Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1953550Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1953969Z else
2024-12-18T00:13:30.1954284Z   DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}")
2024-12-18T00:13:30.1954760Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1955409Z   echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.1955976Z fi
2024-12-18T00:13:30.1962852Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:30.1963245Z env:
2024-12-18T00:13:30.1963461Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:30.1963833Z   REPO_NAME: pytorch
2024-12-18T00:13:30.1964529Z   DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.1965287Z   DOCKER_BUILD_DIR: .ci/docker
2024-12-18T00:13:30.1965668Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.1966068Z ##[endgroup]
2024-12-18T00:13:30.1990956Z + [[ ! -d .ci/docker ]]
2024-12-18T00:13:30.1991255Z + [[ ! -f .ci/docker/build.sh ]]
2024-12-18T00:13:30.1991871Z + echo skip=false
2024-12-18T00:13:30.1992798Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]]
2024-12-18T00:13:30.1997652Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.1998431Z ++ awk -F '[:,]' '{print $2}'
2024-12-18T00:13:30.2018063Z + DOCKER_TAG=45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.2018548Z + echo docker-tag=45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.2019500Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.2050541Z ##[group]Run set +e
2024-12-18T00:13:30.2050887Z set +e
2024-12-18T00:13:30.2051128Z set -x
2024-12-18T00:13:30.2051366Z 
2024-12-18T00:13:30.2051575Z login() {
2024-12-18T00:13:30.2052065Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-12-18T00:13:30.2052595Z }
2024-12-18T00:13:30.2052815Z 
2024-12-18T00:13:30.2053036Z retry () {
2024-12-18T00:13:30.2053318Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-12-18T00:13:30.2053650Z }
2024-12-18T00:13:30.2053870Z 
2024-12-18T00:13:30.2054117Z retry login "${DOCKER_REGISTRY}"
2024-12-18T00:13:30.2054441Z 
2024-12-18T00:13:30.2054796Z START_TIME=$(date +%s)
2024-12-18T00:13:30.2055107Z # Wait up to 90 minutes
2024-12-18T00:13:30.2055486Z while [[ $(( $(date +%s) - 5400 )) -lt $START_TIME ]]; do
2024-12-18T00:13:30.2055999Z   # Check if image already exists, if it does then skip building it
2024-12-18T00:13:30.2056511Z   if docker manifest inspect "${DOCKER_IMAGE}"; then
2024-12-18T00:13:30.2056890Z     exit 0
2024-12-18T00:13:30.2057124Z   fi
2024-12-18T00:13:30.2057349Z 
2024-12-18T00:13:30.2057770Z   # NB: This flag is used by Docker build workflow to push the image to ECR, so we can
2024-12-18T00:13:30.2058454Z   # use this to differentiate between the Docker build and regular build jobs. For the
2024-12-18T00:13:30.2059136Z   # latter, it will wait for the Docker images to become available before continuing
2024-12-18T00:13:30.2059672Z   if [ "${DOCKER_PUSH:-false}" == "true" ]; then
2024-12-18T00:13:30.2060082Z     # It's a Docker build job, let's build the image
2024-12-18T00:13:30.2060446Z     break
2024-12-18T00:13:30.2060699Z   else
2024-12-18T00:13:30.2061062Z     # It's a regular build job, wait for the image to become available
2024-12-18T00:13:30.2061524Z     sleep 300
2024-12-18T00:13:30.2061788Z   fi
2024-12-18T00:13:30.2062026Z done
2024-12-18T00:13:30.2062261Z 
2024-12-18T00:13:30.2062617Z # NB: This part requires a full checkout. Otherwise, the merge base will
2024-12-18T00:13:30.2063210Z # be empty.  The default action would be to continue rebuild the image
2024-12-18T00:13:30.2063742Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then
2024-12-18T00:13:30.2064217Z   # if we're on the base branch then use the parent commit
2024-12-18T00:13:30.2064637Z   MERGE_BASE=$(git rev-parse HEAD~)
2024-12-18T00:13:30.2064968Z else
2024-12-18T00:13:30.2065301Z   # otherwise we're on a PR, so use the most recent base commit
2024-12-18T00:13:30.2065787Z   MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION")
2024-12-18T00:13:30.2066160Z fi
2024-12-18T00:13:30.2066386Z 
2024-12-18T00:13:30.2066628Z if [[ -z "${MERGE_BASE}" ]]; then
2024-12-18T00:13:30.2066985Z   echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.2067328Z 
2024-12-18T00:13:30.2067804Z   echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..."
2024-12-18T00:13:30.2068359Z   exit 0
2024-12-18T00:13:30.2068596Z fi
2024-12-18T00:13:30.2068933Z 
2024-12-18T00:13:30.2069246Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then
2024-12-18T00:13:30.2069939Z   echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit"
2024-12-18T00:13:30.2070539Z   exit 1
2024-12-18T00:13:30.2070779Z fi
2024-12-18T00:13:30.2071005Z 
2024-12-18T00:13:30.2071370Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}")
2024-12-18T00:13:30.2072040Z # If no image exists but the hash is the same as the previous hash then we should error out here
2024-12-18T00:13:30.2072647Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then
2024-12-18T00:13:30.2073338Z   echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch"
2024-12-18T00:13:30.2074120Z   echo "         Will re-build docker image to store in local cache, TTS may be longer"
2024-12-18T00:13:30.2074592Z fi
2024-12-18T00:13:30.2074815Z 
2024-12-18T00:13:30.2075077Z echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2024-12-18T00:13:30.2080676Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:30.2081153Z env:
2024-12-18T00:13:30.2081386Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:30.2081675Z   DOCKER_BUILD_DIR: .ci/docker
2024-12-18T00:13:30.2082021Z   BASE_REVISION: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:13:30.2082810Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.2083662Z   DOCKER_TAG: 45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.2084121Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.2084526Z   DOCKER_PUSH: 
2024-12-18T00:13:30.2084771Z ##[endgroup]
2024-12-18T00:13:30.2107735Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.2108381Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.2110145Z + aws ecr get-login-password --region us-east-1
2024-12-18T00:13:30.2111367Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:30.7719694Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:13:30.7720363Z Configure a credential helper to remove this warning. See
2024-12-18T00:13:30.7721183Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:13:30.7721773Z 
2024-12-18T00:13:30.7721915Z Login Succeeded
2024-12-18T00:13:30.7735297Z ++ date +%s
2024-12-18T00:13:30.7743729Z + START_TIME=1734480810
2024-12-18T00:13:30.7747524Z ++ date +%s
2024-12-18T00:13:30.7755150Z + [[ 1734475410 -lt 1734480810 ]]
2024-12-18T00:13:30.7756323Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:30.9830460Z {
2024-12-18T00:13:30.9830857Z 	"schemaVersion": 2,
2024-12-18T00:13:30.9831485Z 	"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
2024-12-18T00:13:30.9831989Z 	"config": {
2024-12-18T00:13:30.9832616Z 		"mediaType": "application/vnd.docker.container.image.v1+json",
2024-12-18T00:13:30.9833256Z 		"size": 41960,
2024-12-18T00:13:30.9833840Z 		"digest": "sha256:ba75b8db23c6110013be41fbdb3cc39e97537b627e86e17327cbf783b8db17b3"
2024-12-18T00:13:30.9834528Z 	},
2024-12-18T00:13:30.9834849Z 	"layers": [
2024-12-18T00:13:30.9835155Z 		{
2024-12-18T00:13:30.9835527Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9836260Z 			"size": 30439933,
2024-12-18T00:13:30.9836912Z 			"digest": "sha256:7478e0ac0f23f94b2f27848fbcdf804a670fbf8d4bab26df842d40a10cd33059"
2024-12-18T00:13:30.9837687Z 		},
2024-12-18T00:13:30.9837993Z 		{
2024-12-18T00:13:30.9838704Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9839776Z 			"size": 1824,
2024-12-18T00:13:30.9840197Z 			"digest": "sha256:99f9b4c5db9d26af801884278111d8c8fac3822b087561148f19196b7ed4dbeb"
2024-12-18T00:13:30.9840680Z 		},
2024-12-18T00:13:30.9840889Z 		{
2024-12-18T00:13:30.9841229Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9841671Z 			"size": 313252818,
2024-12-18T00:13:30.9842089Z 			"digest": "sha256:6b3ed191d8d67595c1a6610af8416ed009f9581ef9f5a4598ac4b9d058d1cf31"
2024-12-18T00:13:30.9842565Z 		},
2024-12-18T00:13:30.9842766Z 		{
2024-12-18T00:13:30.9843101Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9843528Z 			"size": 864,
2024-12-18T00:13:30.9844034Z 			"digest": "sha256:134f0bded43c908c026937bc7599a9d963ce7052f31c589799e1236df4105e2b"
2024-12-18T00:13:30.9844508Z 		},
2024-12-18T00:13:30.9844714Z 		{
2024-12-18T00:13:30.9845053Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9845530Z 			"size": 106,
2024-12-18T00:13:30.9845974Z 			"digest": "sha256:01b225caaa7ca0991422610f9c6627da173118e60ded6d8dd421e25e73e5b273"
2024-12-18T00:13:30.9846446Z 		},
2024-12-18T00:13:30.9846634Z 		{
2024-12-18T00:13:30.9846969Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9847510Z 			"size": 703,
2024-12-18T00:13:30.9847933Z 			"digest": "sha256:a18b532d7d58da90b6d3f5af2c0ccc73837570f551e7d394c134bbca6eb56ae5"
2024-12-18T00:13:30.9848415Z 		},
2024-12-18T00:13:30.9848604Z 		{
2024-12-18T00:13:30.9848938Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9849357Z 			"size": 1219,
2024-12-18T00:13:30.9849701Z + exit 0
2024-12-18T00:13:30.9850095Z 			"digest": "sha256:97a7f64b3a5e2c59b64126f4e81609e990e4c01e9cc4303854ea6a673d51e1b3"
2024-12-18T00:13:30.9850552Z 		},
2024-12-18T00:13:30.9850753Z 		{
2024-12-18T00:13:30.9851087Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9851513Z 			"size": 484,
2024-12-18T00:13:30.9851931Z 			"digest": "sha256:34c0201c19b2476a61a21e315e19d82603d2f577daaa2f1dec75d6733c418f83"
2024-12-18T00:13:30.9852392Z 		},
2024-12-18T00:13:30.9852593Z 		{
2024-12-18T00:13:30.9852932Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9853368Z 			"size": 110326299,
2024-12-18T00:13:30.9853807Z 			"digest": "sha256:0839e3e1edb9a84cdd1bde8243c5d65ec6987a01606d8e18fba9e886bca9b4b0"
2024-12-18T00:13:30.9854275Z 		},
2024-12-18T00:13:30.9854477Z 		{
2024-12-18T00:13:30.9854809Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9855233Z 			"size": 4149,
2024-12-18T00:13:30.9855655Z 			"digest": "sha256:f0173a8cb7e931d44cc4358da30da75f64e82ae2140e8f0dd42fa24e435180dc"
2024-12-18T00:13:30.9856118Z 		},
2024-12-18T00:13:30.9856319Z 		{
2024-12-18T00:13:30.9856655Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9857075Z 			"size": 1860,
2024-12-18T00:13:30.9857488Z 			"digest": "sha256:6cae394dd1d995ac33b35e7bda638c4b447821b37655aaf7c615b0248d59015a"
2024-12-18T00:13:30.9857995Z 		},
2024-12-18T00:13:30.9858199Z 		{
2024-12-18T00:13:30.9858523Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9858952Z 			"size": 700,
2024-12-18T00:13:30.9859367Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9859838Z 		},
2024-12-18T00:13:30.9860046Z 		{
2024-12-18T00:13:30.9860374Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9860802Z 			"size": 479,
2024-12-18T00:13:30.9861226Z 			"digest": "sha256:8aa13ceb0248e8192f67bb3d91d029939f839d55712b01585e9eb801d1b0903a"
2024-12-18T00:13:30.9861703Z 		},
2024-12-18T00:13:30.9861908Z 		{
2024-12-18T00:13:30.9862237Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9862668Z 			"size": 2836740749,
2024-12-18T00:13:30.9863188Z 			"digest": "sha256:b745a625ea1af10f0dfa59914c98579f2ad1d1c63662b30ba464f7d14558e4ec"
2024-12-18T00:13:30.9863671Z 		},
2024-12-18T00:13:30.9863874Z 		{
2024-12-18T00:13:30.9864201Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9864625Z 			"size": 32,
2024-12-18T00:13:30.9865041Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9865525Z 		},
2024-12-18T00:13:30.9865723Z 		{
2024-12-18T00:13:30.9866045Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9866463Z 			"size": 380,
2024-12-18T00:13:30.9866883Z 			"digest": "sha256:cf09f2e36d07c4acf350967d2d0ff56c40e8a09fac8ff27c6f48e5ae1b652eeb"
2024-12-18T00:13:30.9867365Z 		},
2024-12-18T00:13:30.9867563Z 		{
2024-12-18T00:13:30.9867881Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9868303Z 			"size": 232173,
2024-12-18T00:13:30.9868719Z 			"digest": "sha256:221d65fe0e21c759945c5fc02e5e238928f2cccd386d7d9977bff251677ad9d9"
2024-12-18T00:13:30.9869195Z 		},
2024-12-18T00:13:30.9869401Z 		{
2024-12-18T00:13:30.9869722Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9870148Z 			"size": 232,
2024-12-18T00:13:30.9870553Z 			"digest": "sha256:90c7367fa6c05203f0204598474fe481101262e85731d73960ad47753f842fa8"
2024-12-18T00:13:30.9871084Z 		},
2024-12-18T00:13:30.9871288Z 		{
2024-12-18T00:13:30.9871612Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9872037Z 			"size": 3220515,
2024-12-18T00:13:30.9872457Z 			"digest": "sha256:161e4cd16162fa23ed4e736363b58fbea91355e57457740236d19d1cda4bcacd"
2024-12-18T00:13:30.9872929Z 		},
2024-12-18T00:13:30.9873134Z 		{
2024-12-18T00:13:30.9873454Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9873878Z 			"size": 2004,
2024-12-18T00:13:30.9874284Z 			"digest": "sha256:51246848698796dd8824c85afdc432b78c307754e622ed3316d1dce2594c2e98"
2024-12-18T00:13:30.9874749Z 		},
2024-12-18T00:13:30.9874953Z 		{
2024-12-18T00:13:30.9875275Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9875698Z 			"size": 105,
2024-12-18T00:13:30.9876122Z 			"digest": "sha256:2975d72db4cca26c101aaaebf551c05b75a71722ddb8c87563dd6ef53b7f7b9f"
2024-12-18T00:13:30.9876607Z 		},
2024-12-18T00:13:30.9876810Z 		{
2024-12-18T00:13:30.9877130Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9877549Z 			"size": 565,
2024-12-18T00:13:30.9877954Z 			"digest": "sha256:04400a611323a91dff36d82f7524075e9592f15e2465fb49c902689e02980172"
2024-12-18T00:13:30.9878421Z 		},
2024-12-18T00:13:30.9878622Z 		{
2024-12-18T00:13:30.9878944Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9879366Z 			"size": 32,
2024-12-18T00:13:30.9879784Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9880263Z 		},
2024-12-18T00:13:30.9880452Z 		{
2024-12-18T00:13:30.9880788Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9881208Z 			"size": 104,
2024-12-18T00:13:30.9881623Z 			"digest": "sha256:ba1d531b36056c0edff55441e06153de8a2604365f1221d653a3acc08dabc87f"
2024-12-18T00:13:30.9882097Z 		},
2024-12-18T00:13:30.9882289Z 		{
2024-12-18T00:13:30.9882619Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9883039Z 			"size": 504,
2024-12-18T00:13:30.9883461Z 			"digest": "sha256:df682a7f38c40d64b5e9ae1b6f5f2eb49bf21dd7edbc20ed191c87bdacacf8c1"
2024-12-18T00:13:30.9884037Z 		},
2024-12-18T00:13:30.9884224Z 		{
2024-12-18T00:13:30.9884560Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9884982Z 			"size": 101109899,
2024-12-18T00:13:30.9885417Z 			"digest": "sha256:7789d1d9a4800a88d04ed1a98f689ca8c52d6afb6c3976ae0195da7abec3b8ed"
2024-12-18T00:13:30.9885898Z 		},
2024-12-18T00:13:30.9886084Z 		{
2024-12-18T00:13:30.9886510Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9886940Z 			"size": 109,
2024-12-18T00:13:30.9887369Z 			"digest": "sha256:fe86d66e51a7a2e6c90b8f6b5a70cb1b4bcb8640857bf2f1737eaf503139c7ad"
2024-12-18T00:13:30.9887854Z 		},
2024-12-18T00:13:30.9888042Z 		{
2024-12-18T00:13:30.9888383Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9888809Z 			"size": 491,
2024-12-18T00:13:30.9889219Z 			"digest": "sha256:d91d0050d566ab780d1bad702108cd853e121595f52879cd07307a5b7f8ea454"
2024-12-18T00:13:30.9889689Z 		},
2024-12-18T00:13:30.9889874Z 		{
2024-12-18T00:13:30.9890207Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9890630Z 			"size": 338,
2024-12-18T00:13:30.9891052Z 			"digest": "sha256:e3a5e5066e67d01a7b40d51e7c53c11019dea4ecad985a8d0dc3dc67ca70dcb4"
2024-12-18T00:13:30.9891530Z 		},
2024-12-18T00:13:30.9891718Z 		{
2024-12-18T00:13:30.9892056Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9892485Z 			"size": 103,
2024-12-18T00:13:30.9892903Z 			"digest": "sha256:833e1ad1721aac3e95c044a3c4845c0de7b897a3341d2a291b93720bd744ad05"
2024-12-18T00:13:30.9893381Z 		},
2024-12-18T00:13:30.9893570Z 		{
2024-12-18T00:13:30.9894023Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9894564Z 			"size": 1473,
2024-12-18T00:13:30.9894985Z 			"digest": "sha256:2e47d4f203a168af2fa38cc02f85c4765e46ea47337b8e469624a915d5c7b759"
2024-12-18T00:13:30.9895463Z 		},
2024-12-18T00:13:30.9895654Z 		{
2024-12-18T00:13:30.9895993Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9896424Z 			"size": 448881696,
2024-12-18T00:13:30.9896862Z 			"digest": "sha256:ba61dc3263a45593df0df6197c945d7cebb70780288a64ce44778d6f732ebfc6"
2024-12-18T00:13:30.9897343Z 		},
2024-12-18T00:13:30.9897537Z 		{
2024-12-18T00:13:30.9897869Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9898291Z 			"size": 164,
2024-12-18T00:13:30.9898786Z 			"digest": "sha256:aba6c0f8cfc889fc01a9f833e6d0a3b1ac3cd3464e816811d025c100c4b57fd8"
2024-12-18T00:13:30.9899297Z 		},
2024-12-18T00:13:30.9899484Z 		{
2024-12-18T00:13:30.9899821Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9900246Z 			"size": 423,
2024-12-18T00:13:30.9900662Z 			"digest": "sha256:8a5b8ffb1a25c04f68c583c957b9001bdd8aa47a090a6d521c6af71bef2cc29a"
2024-12-18T00:13:30.9901139Z 		},
2024-12-18T00:13:30.9901327Z 		{
2024-12-18T00:13:30.9901658Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9902081Z 			"size": 32,
2024-12-18T00:13:30.9902497Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9902977Z 		},
2024-12-18T00:13:30.9903164Z 		{
2024-12-18T00:13:30.9903501Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9903924Z 			"size": 111,
2024-12-18T00:13:30.9904345Z 			"digest": "sha256:0d227ff5c87e792256d768a146ced335e5d5c4d330617ee4e787fd442ac573bc"
2024-12-18T00:13:30.9904821Z 		},
2024-12-18T00:13:30.9905012Z 		{
2024-12-18T00:13:30.9905347Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9905768Z 			"size": 475,
2024-12-18T00:13:30.9906184Z 			"digest": "sha256:88ca106a70350461491ef212eb18fddf198fb6eae313d4a6d4e307c641802aed"
2024-12-18T00:13:30.9906661Z 		},
2024-12-18T00:13:30.9906849Z 		{
2024-12-18T00:13:30.9907182Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9907606Z 			"size": 32,
2024-12-18T00:13:30.9908020Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9908500Z 		},
2024-12-18T00:13:30.9908688Z 		{
2024-12-18T00:13:30.9909024Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9909445Z 			"size": 112,
2024-12-18T00:13:30.9909945Z 			"digest": "sha256:1d5f1bb5e2adc31c159f38e661143441213603554fed1353dbe285d1362199b2"
2024-12-18T00:13:30.9910426Z 		},
2024-12-18T00:13:30.9910619Z 		{
2024-12-18T00:13:30.9910958Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9911385Z 			"size": 565,
2024-12-18T00:13:30.9911795Z 			"digest": "sha256:54482636fb369edf856429b9858987ef2b1c155ea071b91705e613de6a76e2e4"
2024-12-18T00:13:30.9912272Z 		},
2024-12-18T00:13:30.9912461Z 		{
2024-12-18T00:13:30.9912792Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9913214Z 			"size": 43164410,
2024-12-18T00:13:30.9913645Z 			"digest": "sha256:25fd8ec17dbac7311e5642175a6919bb55f277edbd30773f1bd328e2c07ca6dd"
2024-12-18T00:13:30.9914123Z 		},
2024-12-18T00:13:30.9914311Z 		{
2024-12-18T00:13:30.9914641Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9915062Z 			"size": 106,
2024-12-18T00:13:30.9915480Z 			"digest": "sha256:d9b7184b25fa5ba66311c7d51719eb15cd58a706a38df2c71f3d800235ffb40e"
2024-12-18T00:13:30.9915956Z 		},
2024-12-18T00:13:30.9916147Z 		{
2024-12-18T00:13:30.9916479Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9916900Z 			"size": 296,
2024-12-18T00:13:30.9917313Z 			"digest": "sha256:a3161fc6f7f1b48ed628663f58d452249d7f3b91f9782f10abaf8b3ccc9bef22"
2024-12-18T00:13:30.9917856Z 		},
2024-12-18T00:13:30.9918043Z 		{
2024-12-18T00:13:30.9918376Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9918797Z 			"size": 32,
2024-12-18T00:13:30.9919217Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9919694Z 		},
2024-12-18T00:13:30.9919882Z 		{
2024-12-18T00:13:30.9920213Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9920635Z 			"size": 106,
2024-12-18T00:13:30.9921038Z 			"digest": "sha256:a5c771445223f395aba1c15100bf14954f2308176970fc90106f6f955180e50b"
2024-12-18T00:13:30.9921501Z 		},
2024-12-18T00:13:30.9921693Z 		{
2024-12-18T00:13:30.9922036Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9922459Z 			"size": 425,
2024-12-18T00:13:30.9922870Z 			"digest": "sha256:ef13954e836fa6c66410b690b3aceb88514886592c1a86111525dfae1aa0cfef"
2024-12-18T00:13:30.9923340Z 		},
2024-12-18T00:13:30.9923535Z 		{
2024-12-18T00:13:30.9923948Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9924373Z 			"size": 19308715,
2024-12-18T00:13:30.9924803Z 			"digest": "sha256:3ad11112ed644d132501d781f2aa3c4c0ad4d7ffa2425853a06bb9f189e131dd"
2024-12-18T00:13:30.9925276Z 		},
2024-12-18T00:13:30.9925466Z 		{
2024-12-18T00:13:30.9925813Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9926237Z 			"size": 108,
2024-12-18T00:13:30.9926652Z 			"digest": "sha256:217e79f06cdca7b54285010edd1d1f090041472d4e1f834eb4585c05b9297cd0"
2024-12-18T00:13:30.9927114Z 		},
2024-12-18T00:13:30.9927319Z 		{
2024-12-18T00:13:30.9927665Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9928091Z 			"size": 644,
2024-12-18T00:13:30.9928519Z 			"digest": "sha256:016c3af2b5ea4aeb71bde31af26f9a8512470962e48cbaae3a4f06fb69c7344c"
2024-12-18T00:13:30.9928995Z 		},
2024-12-18T00:13:30.9929203Z 		{
2024-12-18T00:13:30.9929544Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9930007Z 			"size": 700,
2024-12-18T00:13:30.9930415Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9930884Z 		},
2024-12-18T00:13:30.9931073Z 		{
2024-12-18T00:13:30.9931412Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9931832Z 			"size": 142,
2024-12-18T00:13:30.9932256Z 			"digest": "sha256:ea3ba6dc5d33eef450b3f02e25fec80615f6c3c510bf5cf91b982a8f48dc7eb2"
2024-12-18T00:13:30.9932732Z 		},
2024-12-18T00:13:30.9932930Z 		{
2024-12-18T00:13:30.9933262Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9933764Z 			"size": 136,
2024-12-18T00:13:30.9934175Z 			"digest": "sha256:3e21197363582ab81b92d1a916d365624d44259b15f48abfbdc912b7308758ea"
2024-12-18T00:13:30.9934631Z 		},
2024-12-18T00:13:30.9934831Z 		{
2024-12-18T00:13:30.9935165Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9935591Z 			"size": 32,
2024-12-18T00:13:30.9936011Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9936483Z 		},
2024-12-18T00:13:30.9936682Z 		{
2024-12-18T00:13:30.9937016Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9937437Z 			"size": 195,
2024-12-18T00:13:30.9937862Z 			"digest": "sha256:142b9ab7f81f0301b624f197d12da20bcbf3397dc3aaefaf59cc40a0acf614e0"
2024-12-18T00:13:30.9938496Z 		},
2024-12-18T00:13:30.9938702Z 		{
2024-12-18T00:13:30.9939040Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9939465Z 			"size": 1402,
2024-12-18T00:13:30.9939894Z 			"digest": "sha256:8fab0d26d5622c4cc78d754ec3af4a8fbe7e18ac7fa773af67cf092435a32e73"
2024-12-18T00:13:30.9940363Z 		},
2024-12-18T00:13:30.9940564Z 		{
2024-12-18T00:13:30.9940895Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9941453Z 			"size": 700,
2024-12-18T00:13:30.9941863Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9942318Z 		},
2024-12-18T00:13:30.9942523Z 		{
2024-12-18T00:13:30.9942862Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9943288Z 			"size": 137,
2024-12-18T00:13:30.9943707Z 			"digest": "sha256:a7792d7941ff03ef1b4bcc927753df7d85c1fb9b79f78da4e05558bc6e0dfd0b"
2024-12-18T00:13:30.9944172Z 		},
2024-12-18T00:13:30.9944374Z 		{
2024-12-18T00:13:30.9944708Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9945128Z 			"size": 4134303801,
2024-12-18T00:13:30.9945554Z 			"digest": "sha256:19f9786e817528f0646113207a687ad908dd7447b67e0ec001a471ab27522ba8"
2024-12-18T00:13:30.9946005Z 		},
2024-12-18T00:13:30.9946206Z 		{
2024-12-18T00:13:30.9946539Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9946958Z 			"size": 156,
2024-12-18T00:13:30.9947377Z 			"digest": "sha256:95cf8d950d0a8233cd88d836382f6fd5f1ff98f9e690fa972b998ac794f668d6"
2024-12-18T00:13:30.9947839Z 		},
2024-12-18T00:13:30.9948039Z 		{
2024-12-18T00:13:30.9948370Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9948790Z 			"size": 1402,
2024-12-18T00:13:30.9949217Z 			"digest": "sha256:8fab0d26d5622c4cc78d754ec3af4a8fbe7e18ac7fa773af67cf092435a32e73"
2024-12-18T00:13:30.9949688Z 		},
2024-12-18T00:13:30.9949892Z 		{
2024-12-18T00:13:30.9950228Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9950646Z 			"size": 700,
2024-12-18T00:13:30.9951059Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9951510Z 		},
2024-12-18T00:13:30.9951708Z 		{
2024-12-18T00:13:30.9952038Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9952459Z 			"size": 140,
2024-12-18T00:13:30.9952869Z 			"digest": "sha256:da70495326cb983c5851ab3d9e84313164ba09c3e1c15d098f01e919bc31e5e6"
2024-12-18T00:13:30.9953329Z 		},
2024-12-18T00:13:30.9953528Z 		{
2024-12-18T00:13:30.9953863Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9954284Z 			"size": 32,
2024-12-18T00:13:30.9954702Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9955170Z 		},
2024-12-18T00:13:30.9955376Z 		{
2024-12-18T00:13:30.9955710Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9956133Z 			"size": 161,
2024-12-18T00:13:30.9956547Z 			"digest": "sha256:b42f0c5083b29c6456f26a9f6d0dfd6b4904493ac71e5af4c78f897a4a78c413"
2024-12-18T00:13:30.9957104Z 		},
2024-12-18T00:13:30.9957309Z 		{
2024-12-18T00:13:30.9971931Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9972452Z 			"size": 680,
2024-12-18T00:13:30.9972887Z 			"digest": "sha256:59555bf5155934a4c5cf29ad2bce3eb3d391d1507e03b9afd03a1034eebafe83"
2024-12-18T00:13:30.9973398Z 		},
2024-12-18T00:13:30.9973604Z 		{
2024-12-18T00:13:30.9973947Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9974361Z 			"size": 700,
2024-12-18T00:13:30.9974772Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9975244Z 		},
2024-12-18T00:13:30.9975445Z 		{
2024-12-18T00:13:30.9975771Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9976184Z 			"size": 138,
2024-12-18T00:13:30.9976609Z 			"digest": "sha256:fd368c9493e625c55fa72f6c84b4a350c99fbfb3b097dce60cceb45fce27af55"
2024-12-18T00:13:30.9977093Z 		},
2024-12-18T00:13:30.9977298Z 		{
2024-12-18T00:13:30.9977630Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9978039Z 			"size": 32,
2024-12-18T00:13:30.9978454Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9979060Z 		},
2024-12-18T00:13:30.9979262Z 		{
2024-12-18T00:13:30.9979594Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9980001Z 			"size": 159,
2024-12-18T00:13:30.9980409Z 			"digest": "sha256:eeba4480f3363505eb3c94692cf63c55b2e92601604e6282fd73cb741ad94135"
2024-12-18T00:13:30.9980880Z 		},
2024-12-18T00:13:30.9981079Z 		{
2024-12-18T00:13:30.9981411Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9981820Z 			"size": 907,
2024-12-18T00:13:30.9982236Z 			"digest": "sha256:23872424bbb0e170ebf967174efc23cfa2718fc7801a66aca1aec5a9fab6e1ab"
2024-12-18T00:13:30.9982714Z 		},
2024-12-18T00:13:30.9982915Z 		{
2024-12-18T00:13:30.9983252Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9983663Z 			"size": 700,
2024-12-18T00:13:30.9984067Z 			"digest": "sha256:02463c0b1de0235716572fa5252d0c7d5ac42961d6e1364f4e9905d2810d016d"
2024-12-18T00:13:30.9984533Z 		},
2024-12-18T00:13:30.9984733Z 		{
2024-12-18T00:13:30.9985068Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9985479Z 			"size": 135,
2024-12-18T00:13:30.9985887Z 			"digest": "sha256:aa3c5e8778112bc12e2223c552cb35e062cf580e873e1d240b253f527065997a"
2024-12-18T00:13:30.9986359Z 		},
2024-12-18T00:13:30.9986559Z 		{
2024-12-18T00:13:30.9986891Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9987301Z 			"size": 32,
2024-12-18T00:13:30.9987722Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9988199Z 		},
2024-12-18T00:13:30.9988398Z 		{
2024-12-18T00:13:30.9988734Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9989146Z 			"size": 159,
2024-12-18T00:13:30.9989557Z 			"digest": "sha256:7069d9cf23ac57480d5de3be688d22e94f96e91f08ab25a6515f31e95071b419"
2024-12-18T00:13:30.9990029Z 		},
2024-12-18T00:13:30.9990227Z 		{
2024-12-18T00:13:30.9990560Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9990975Z 			"size": 1519,
2024-12-18T00:13:30.9991382Z 			"digest": "sha256:05e4316d907ec40a483078f09c6b60033f92418eb013c63827ae495e2f08052c"
2024-12-18T00:13:30.9991848Z 		},
2024-12-18T00:13:30.9992046Z 		{
2024-12-18T00:13:30.9992378Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9992785Z 			"size": 32,
2024-12-18T00:13:30.9993202Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9993681Z 		},
2024-12-18T00:13:30.9993877Z 		{
2024-12-18T00:13:30.9994206Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9994697Z 			"size": 137,
2024-12-18T00:13:30.9995119Z 			"digest": "sha256:68fad68dd1962fe1b7848933a121dba3e42f24bfce82f33842272bceb005d9f2"
2024-12-18T00:13:30.9995596Z 		},
2024-12-18T00:13:30.9995794Z 		{
2024-12-18T00:13:30.9996127Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9996542Z 			"size": 379,
2024-12-18T00:13:30.9996958Z 			"digest": "sha256:aae57a8763e18b8f0b04691e4ee259627424c1e99940df6e2d792fd4bec344d8"
2024-12-18T00:13:30.9997431Z 		},
2024-12-18T00:13:30.9997630Z 		{
2024-12-18T00:13:30.9997963Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:30.9998376Z 			"size": 32,
2024-12-18T00:13:30.9998902Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:30.9999390Z 		},
2024-12-18T00:13:30.9999596Z 		{
2024-12-18T00:13:30.9999929Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0000337Z 			"size": 104,
2024-12-18T00:13:31.0000755Z 			"digest": "sha256:d0b74f061e3ae344d82d99f2768a7302e69f57372b5d7e7a78affe0ab26516e5"
2024-12-18T00:13:31.0001229Z 		},
2024-12-18T00:13:31.0001428Z 		{
2024-12-18T00:13:31.0001763Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0002177Z 			"size": 1931,
2024-12-18T00:13:31.0002704Z 			"digest": "sha256:e90b13a95dd7bacbff95b02eac0b70842234bda3b03a472f3eefd1417a3882e7"
2024-12-18T00:13:31.0003197Z 		},
2024-12-18T00:13:31.0003402Z 		{
2024-12-18T00:13:31.0003819Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0004239Z 			"size": 197395631,
2024-12-18T00:13:31.0004683Z 			"digest": "sha256:ba692f76a3d83a54eb95a66772bbcafa7400dfe6a9d1aed65ee8dc8b949a9f27"
2024-12-18T00:13:31.0005172Z 		},
2024-12-18T00:13:31.0005378Z 		{
2024-12-18T00:13:31.0005714Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0006124Z 			"size": 106,
2024-12-18T00:13:31.0006549Z 			"digest": "sha256:b22d4aaf13863f9a27cbe6b91fea8f3ae725f1728031fb861d64da51b5ae00f6"
2024-12-18T00:13:31.0007032Z 		},
2024-12-18T00:13:31.0007233Z 		{
2024-12-18T00:13:31.0007565Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0007976Z 			"size": 164,
2024-12-18T00:13:31.0008378Z 			"digest": "sha256:212816d8ea816ba1365cb681004827f875c957e670fd91b83a79a92bd832dd16"
2024-12-18T00:13:31.0008846Z 		},
2024-12-18T00:13:31.0009046Z 		{
2024-12-18T00:13:31.0009376Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0009786Z 			"size": 7943,
2024-12-18T00:13:31.0010196Z 			"digest": "sha256:1d707d05231062a13fe7180fc5825619eff56d4e732b4be1a4bf9f26075ffe00"
2024-12-18T00:13:31.0010669Z 		},
2024-12-18T00:13:31.0010867Z 		{
2024-12-18T00:13:31.0011186Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0011607Z 			"size": 8066,
2024-12-18T00:13:31.0012028Z 			"digest": "sha256:7bde8a5319084e224c6afbdc3b05ea1fb10d0e67b0c96bc4d2f935f5afd5f568"
2024-12-18T00:13:31.0012518Z 		},
2024-12-18T00:13:31.0012716Z 		{
2024-12-18T00:13:31.0013033Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0013453Z 			"size": 303,
2024-12-18T00:13:31.0013878Z 			"digest": "sha256:fa2e62eb409d03eeb4c0399450bbfe0c08d47cd8a3eb069b680b6afa4fb4d4f7"
2024-12-18T00:13:31.0014365Z 		},
2024-12-18T00:13:31.0014566Z 		{
2024-12-18T00:13:31.0014884Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0015305Z 			"size": 32,
2024-12-18T00:13:31.0015721Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:31.0016204Z 		},
2024-12-18T00:13:31.0016407Z 		{
2024-12-18T00:13:31.0016730Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0017156Z 			"size": 108,
2024-12-18T00:13:31.0017560Z 			"digest": "sha256:c321a0735855403c37c79f3a5ce24e0304381510a1222c76e083bc50ed5e4e23"
2024-12-18T00:13:31.0018025Z 		},
2024-12-18T00:13:31.0018309Z 		{
2024-12-18T00:13:31.0018635Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0019063Z 			"size": 54145661,
2024-12-18T00:13:31.0019494Z 			"digest": "sha256:a2109a0ad5a98d339a44fb7a90829c2ff7b29ccfb98a05562351ea8eb542f50f"
2024-12-18T00:13:31.0019984Z 		},
2024-12-18T00:13:31.0020189Z 		{
2024-12-18T00:13:31.0020511Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2024-12-18T00:13:31.0020935Z 			"size": 32,
2024-12-18T00:13:31.0021355Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2024-12-18T00:13:31.0021836Z 		}
2024-12-18T00:13:31.0022040Z 	]
2024-12-18T00:13:31.0022226Z }
2024-12-18T00:13:31.0070878Z ##[group]Run set -eux
2024-12-18T00:13:31.0071178Z set -eux
2024-12-18T00:13:31.0072075Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin
2024-12-18T00:13:31.0078672Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:31.0079059Z env:
2024-12-18T00:13:31.0079276Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:31.0079546Z ##[endgroup]
2024-12-18T00:13:31.0106148Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token
2024-12-18T00:13:31.0107300Z + jq --raw-output .SecretString
2024-12-18T00:13:31.0108082Z + jq -r .docker_hub_readonly_token
2024-12-18T00:13:31.0109218Z + docker login --username pytorchbot --password-stdin
2024-12-18T00:13:31.6373068Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:13:31.6373832Z Configure a credential helper to remove this warning. See
2024-12-18T00:13:31.6374827Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:13:31.6375221Z 
2024-12-18T00:13:31.6375319Z Login Succeeded
2024-12-18T00:13:31.6474865Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/}
2024-12-18T00:13:31.6475273Z tag=${ECR_DOCKER_IMAGE##*/}
2024-12-18T00:13:31.6475691Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}"
2024-12-18T00:13:31.6481461Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:31.6481855Z env:
2024-12-18T00:13:31.6482098Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:31.6482813Z   ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:31.6483547Z ##[endgroup]
2024-12-18T00:13:31.6508378Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.9-gcc11-45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:31.6572315Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@release/2.6
2024-12-18T00:13:31.6572805Z with:
2024-12-18T00:13:31.6573447Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:31.6574256Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:31.6574655Z env:
2024-12-18T00:13:31.6574878Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:31.6575152Z ##[endgroup]
2024-12-18T00:13:31.6608732Z ##[group]Run set -x
2024-12-18T00:13:31.6609026Z set -x
2024-12-18T00:13:31.6609293Z set +e
2024-12-18T00:13:31.6609516Z 
2024-12-18T00:13:31.6609741Z login() {
2024-12-18T00:13:31.6610230Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2024-12-18T00:13:31.6610762Z }
2024-12-18T00:13:31.6610983Z 
2024-12-18T00:13:31.6611251Z retry () {
2024-12-18T00:13:31.6611541Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2024-12-18T00:13:31.6611858Z }
2024-12-18T00:13:31.6612081Z 
2024-12-18T00:13:31.6612329Z retry login "${DOCKER_REGISTRY}"
2024-12-18T00:13:31.6612652Z 
2024-12-18T00:13:31.6612872Z set -e
2024-12-18T00:13:31.6613213Z # ignore output since only exit code is used for conditional
2024-12-18T00:13:31.6613715Z # only pull docker image if it's not available locally
2024-12-18T00:13:31.6614270Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then
2024-12-18T00:13:31.6614793Z   retry docker pull "${DOCKER_IMAGE}"
2024-12-18T00:13:31.6615128Z fi
2024-12-18T00:13:31.6620568Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:13:31.6620960Z env:
2024-12-18T00:13:31.6621193Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:13:31.6621896Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:31.6622714Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:31.6623118Z ##[endgroup]
2024-12-18T00:13:31.6645118Z + set +e
2024-12-18T00:13:31.6645658Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:31.6646315Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:31.6648491Z + aws ecr get-login-password --region us-east-1
2024-12-18T00:13:31.6649789Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2024-12-18T00:13:32.2152766Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2024-12-18T00:13:32.2153447Z Configure a credential helper to remove this warning. See
2024-12-18T00:13:32.2154313Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2024-12-18T00:13:32.2154713Z 
2024-12-18T00:13:32.2154812Z Login Succeeded
2024-12-18T00:13:32.2165728Z + set -e
2024-12-18T00:13:32.2166451Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:32.2288613Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:32.2289779Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:13:32.4742945Z 45e1356b47a284893081276eff3000b7b534f3b1: Pulling from pytorch/pytorch-linux-jammy-py3.9-gcc11
2024-12-18T00:13:32.4748836Z 7478e0ac0f23: Pulling fs layer
2024-12-18T00:13:32.4749420Z 99f9b4c5db9d: Pulling fs layer
2024-12-18T00:13:32.4750447Z 6b3ed191d8d6: Pulling fs layer
2024-12-18T00:13:32.4751603Z 134f0bded43c: Pulling fs layer
2024-12-18T00:13:32.4752904Z 01b225caaa7c: Pulling fs layer
2024-12-18T00:13:32.4753775Z a18b532d7d58: Pulling fs layer
2024-12-18T00:13:32.4754349Z 97a7f64b3a5e: Pulling fs layer
2024-12-18T00:13:32.4754895Z 34c0201c19b2: Pulling fs layer
2024-12-18T00:13:32.4755423Z 0839e3e1edb9: Pulling fs layer
2024-12-18T00:13:32.4755931Z f0173a8cb7e9: Pulling fs layer
2024-12-18T00:13:32.4756470Z 6cae394dd1d9: Pulling fs layer
2024-12-18T00:13:32.4756993Z 02463c0b1de0: Pulling fs layer
2024-12-18T00:13:32.4757542Z 8aa13ceb0248: Pulling fs layer
2024-12-18T00:13:32.4758042Z b745a625ea1a: Pulling fs layer
2024-12-18T00:13:32.4758573Z 4f4fb700ef54: Pulling fs layer
2024-12-18T00:13:32.4759086Z 0839e3e1edb9: Waiting
2024-12-18T00:13:32.4759550Z 134f0bded43c: Waiting
2024-12-18T00:13:32.4760010Z cf09f2e36d07: Pulling fs layer
2024-12-18T00:13:32.4760332Z 01b225caaa7c: Waiting
2024-12-18T00:13:32.4760583Z 97a7f64b3a5e: Waiting
2024-12-18T00:13:32.4760950Z 221d65fe0e21: Pulling fs layer
2024-12-18T00:13:32.4761283Z a18b532d7d58: Waiting
2024-12-18T00:13:32.4761531Z 90c7367fa6c0: Pulling fs layer
2024-12-18T00:13:32.4761877Z 161e4cd16162: Pulling fs layer
2024-12-18T00:13:32.4762160Z f0173a8cb7e9: Waiting
2024-12-18T00:13:32.4762458Z 512468486987: Pulling fs layer
2024-12-18T00:13:32.4762747Z 2975d72db4cc: Pulling fs layer
2024-12-18T00:13:32.4763017Z 6cae394dd1d9: Waiting
2024-12-18T00:13:32.4763277Z 04400a611323: Pulling fs layer
2024-12-18T00:13:32.4763638Z 8aa13ceb0248: Waiting
2024-12-18T00:13:32.4763893Z b745a625ea1a: Waiting
2024-12-18T00:13:32.4764193Z 02463c0b1de0: Waiting
2024-12-18T00:13:32.4764456Z ba1d531b3605: Pulling fs layer
2024-12-18T00:13:32.4764738Z df682a7f38c4: Pulling fs layer
2024-12-18T00:13:32.4765022Z 221d65fe0e21: Waiting
2024-12-18T00:13:32.4765288Z 7789d1d9a480: Pulling fs layer
2024-12-18T00:13:32.4765565Z 161e4cd16162: Waiting
2024-12-18T00:13:32.4765814Z 90c7367fa6c0: Waiting
2024-12-18T00:13:32.4766108Z fe86d66e51a7: Pulling fs layer
2024-12-18T00:13:32.4766403Z d91d0050d566: Pulling fs layer
2024-12-18T00:13:32.4766725Z e3a5e5066e67: Pulling fs layer
2024-12-18T00:13:32.4767023Z 833e1ad1721a: Pulling fs layer
2024-12-18T00:13:32.4767300Z 512468486987: Waiting
2024-12-18T00:13:32.4767545Z 2e47d4f203a1: Pulling fs layer
2024-12-18T00:13:32.4767824Z 04400a611323: Waiting
2024-12-18T00:13:32.4768116Z 2975d72db4cc: Waiting
2024-12-18T00:13:32.4768381Z ba61dc3263a4: Pulling fs layer
2024-12-18T00:13:32.4768665Z ba1d531b3605: Waiting
2024-12-18T00:13:32.4768916Z aba6c0f8cfc8: Pulling fs layer
2024-12-18T00:13:32.4769201Z df682a7f38c4: Waiting
2024-12-18T00:13:32.4769502Z 8a5b8ffb1a25: Pulling fs layer
2024-12-18T00:13:32.4769806Z 7789d1d9a480: Waiting
2024-12-18T00:13:32.4770064Z 0d227ff5c87e: Pulling fs layer
2024-12-18T00:13:32.4770561Z fe86d66e51a7: Waiting
2024-12-18T00:13:32.4770812Z d91d0050d566: Waiting
2024-12-18T00:13:32.4771076Z 88ca106a7035: Pulling fs layer
2024-12-18T00:13:32.4771361Z aba6c0f8cfc8: Waiting
2024-12-18T00:13:32.4771629Z e3a5e5066e67: Waiting
2024-12-18T00:13:32.4771907Z 8a5b8ffb1a25: Waiting
2024-12-18T00:13:32.4772176Z 1d5f1bb5e2ad: Pulling fs layer
2024-12-18T00:13:32.4772478Z 54482636fb36: Pulling fs layer
2024-12-18T00:13:32.4772786Z 34c0201c19b2: Waiting
2024-12-18T00:13:32.4773058Z 25fd8ec17dba: Pulling fs layer
2024-12-18T00:13:32.4773344Z 833e1ad1721a: Waiting
2024-12-18T00:13:32.4773608Z d9b7184b25fa: Pulling fs layer
2024-12-18T00:13:32.4773898Z a3161fc6f7f1: Pulling fs layer
2024-12-18T00:13:32.4774178Z 1d5f1bb5e2ad: Waiting
2024-12-18T00:13:32.4774417Z 25fd8ec17dba: Waiting
2024-12-18T00:13:32.4774662Z 54482636fb36: Waiting
2024-12-18T00:13:32.4774914Z a5c771445223: Pulling fs layer
2024-12-18T00:13:32.4775190Z ba61dc3263a4: Waiting
2024-12-18T00:13:32.4775448Z ef13954e836f: Pulling fs layer
2024-12-18T00:13:32.4775730Z 3ad11112ed64: Pulling fs layer
2024-12-18T00:13:32.4776014Z 0d227ff5c87e: Waiting
2024-12-18T00:13:32.4776276Z 217e79f06cdc: Pulling fs layer
2024-12-18T00:13:32.4776567Z 016c3af2b5ea: Pulling fs layer
2024-12-18T00:13:32.4776838Z d9b7184b25fa: Waiting
2024-12-18T00:13:32.4777148Z a3161fc6f7f1: Waiting
2024-12-18T00:13:32.4777514Z a5c771445223: Waiting
2024-12-18T00:13:32.4777778Z ea3ba6dc5d33: Pulling fs layer
2024-12-18T00:13:32.4778072Z 3e2119736358: Pulling fs layer
2024-12-18T00:13:32.4778336Z ef13954e836f: Waiting
2024-12-18T00:13:32.4778585Z 3ad11112ed64: Waiting
2024-12-18T00:13:32.4778869Z 217e79f06cdc: Waiting
2024-12-18T00:13:32.4779257Z 142b9ab7f81f: Pulling fs layer
2024-12-18T00:13:32.4779724Z 016c3af2b5ea: Waiting
2024-12-18T00:13:32.4780131Z 8fab0d26d562: Pulling fs layer
2024-12-18T00:13:32.4780611Z ea3ba6dc5d33: Waiting
2024-12-18T00:13:32.4781006Z a7792d7941ff: Pulling fs layer
2024-12-18T00:13:32.4781468Z 19f9786e8175: Pulling fs layer
2024-12-18T00:13:32.4781882Z 142b9ab7f81f: Waiting
2024-12-18T00:13:32.4782137Z 95cf8d950d0a: Pulling fs layer
2024-12-18T00:13:32.4782466Z a7792d7941ff: Waiting
2024-12-18T00:13:32.4782712Z 3e2119736358: Waiting
2024-12-18T00:13:32.4782969Z da70495326cb: Pulling fs layer
2024-12-18T00:13:32.4783261Z b42f0c5083b2: Pulling fs layer
2024-12-18T00:13:32.4783539Z 59555bf51559: Pulling fs layer
2024-12-18T00:13:32.4783838Z fd368c9493e6: Pulling fs layer
2024-12-18T00:13:32.4784128Z eeba4480f336: Pulling fs layer
2024-12-18T00:13:32.4784466Z 23872424bbb0: Pulling fs layer
2024-12-18T00:13:32.4784742Z aa3c5e877811: Pulling fs layer
2024-12-18T00:13:32.4785059Z 59555bf51559: Waiting
2024-12-18T00:13:32.4785309Z fd368c9493e6: Waiting
2024-12-18T00:13:32.4785608Z 7069d9cf23ac: Pulling fs layer
2024-12-18T00:13:32.4785923Z aa3c5e877811: Waiting
2024-12-18T00:13:32.4786168Z 05e4316d907e: Pulling fs layer
2024-12-18T00:13:32.4786446Z b42f0c5083b2: Waiting
2024-12-18T00:13:32.4786699Z 23872424bbb0: Waiting
2024-12-18T00:13:32.4786953Z eeba4480f336: Waiting
2024-12-18T00:13:32.4787201Z 7069d9cf23ac: Waiting
2024-12-18T00:13:32.4787538Z 68fad68dd196: Pulling fs layer
2024-12-18T00:13:32.4788018Z aae57a8763e1: Pulling fs layer
2024-12-18T00:13:32.4788505Z d0b74f061e3a: Pulling fs layer
2024-12-18T00:13:32.4788949Z 68fad68dd196: Waiting
2024-12-18T00:13:32.4789344Z aae57a8763e1: Waiting
2024-12-18T00:13:32.4789740Z e90b13a95dd7: Pulling fs layer
2024-12-18T00:13:32.4790082Z ba692f76a3d8: Pulling fs layer
2024-12-18T00:13:32.4790376Z b22d4aaf1386: Pulling fs layer
2024-12-18T00:13:32.4790689Z 212816d8ea81: Pulling fs layer
2024-12-18T00:13:32.4790981Z 1d707d052310: Pulling fs layer
2024-12-18T00:13:32.4791249Z b22d4aaf1386: Waiting
2024-12-18T00:13:32.4791515Z 7bde8a531908: Pulling fs layer
2024-12-18T00:13:32.4791805Z e90b13a95dd7: Waiting
2024-12-18T00:13:32.4792071Z fa2e62eb409d: Pulling fs layer
2024-12-18T00:13:32.4792365Z c321a0735855: Pulling fs layer
2024-12-18T00:13:32.4792641Z a2109a0ad5a9: Pulling fs layer
2024-12-18T00:13:32.4793051Z 212816d8ea81: Waiting
2024-12-18T00:13:32.4793303Z fa2e62eb409d: Waiting
2024-12-18T00:13:32.4793556Z 7bde8a531908: Waiting
2024-12-18T00:13:32.4793790Z 1d707d052310: Waiting
2024-12-18T00:13:32.4794037Z c321a0735855: Waiting
2024-12-18T00:13:32.5491749Z 99f9b4c5db9d: Verifying Checksum
2024-12-18T00:13:32.5492269Z 99f9b4c5db9d: Download complete
2024-12-18T00:13:32.6418820Z 134f0bded43c: Verifying Checksum
2024-12-18T00:13:32.6419244Z 134f0bded43c: Download complete
2024-12-18T00:13:32.7293525Z 01b225caaa7c: Verifying Checksum
2024-12-18T00:13:32.7293994Z 01b225caaa7c: Download complete
2024-12-18T00:13:32.8112871Z a18b532d7d58: Verifying Checksum
2024-12-18T00:13:32.8113312Z a18b532d7d58: Download complete
2024-12-18T00:13:32.8365518Z 7478e0ac0f23: Verifying Checksum
2024-12-18T00:13:32.8366150Z 7478e0ac0f23: Download complete
2024-12-18T00:13:32.8818229Z 97a7f64b3a5e: Verifying Checksum
2024-12-18T00:13:32.8818842Z 97a7f64b3a5e: Download complete
2024-12-18T00:13:32.9110094Z 34c0201c19b2: Verifying Checksum
2024-12-18T00:13:32.9110513Z 34c0201c19b2: Download complete
2024-12-18T00:13:32.9865431Z f0173a8cb7e9: Download complete
2024-12-18T00:13:33.0483941Z 6cae394dd1d9: Download complete
2024-12-18T00:13:33.1268101Z 02463c0b1de0: Download complete
2024-12-18T00:13:33.1990652Z 8aa13ceb0248: Verifying Checksum
2024-12-18T00:13:33.1991303Z 8aa13ceb0248: Download complete
2024-12-18T00:13:33.7874400Z 7478e0ac0f23: Pull complete
2024-12-18T00:13:33.8126311Z 99f9b4c5db9d: Pull complete
2024-12-18T00:13:34.0599288Z 0839e3e1edb9: Verifying Checksum
2024-12-18T00:13:34.0599927Z 0839e3e1edb9: Download complete
2024-12-18T00:13:34.0893406Z 4f4fb700ef54: Download complete
2024-12-18T00:13:34.1728368Z cf09f2e36d07: Verifying Checksum
2024-12-18T00:13:34.1728858Z cf09f2e36d07: Download complete
2024-12-18T00:13:34.2543808Z 221d65fe0e21: Download complete
2024-12-18T00:13:34.3454477Z 90c7367fa6c0: Verifying Checksum
2024-12-18T00:13:34.3454882Z 90c7367fa6c0: Download complete
2024-12-18T00:13:34.4503210Z 161e4cd16162: Download complete
2024-12-18T00:13:34.5298209Z 512468486987: Verifying Checksum
2024-12-18T00:13:34.5298629Z 512468486987: Download complete
2024-12-18T00:13:34.6041683Z 2975d72db4cc: Verifying Checksum
2024-12-18T00:13:34.6042080Z 2975d72db4cc: Download complete
2024-12-18T00:13:34.7107904Z 04400a611323: Download complete
2024-12-18T00:13:34.7812666Z ba1d531b3605: Verifying Checksum
2024-12-18T00:13:34.7813149Z ba1d531b3605: Download complete
2024-12-18T00:13:34.8686638Z df682a7f38c4: Verifying Checksum
2024-12-18T00:13:34.8687029Z df682a7f38c4: Download complete
2024-12-18T00:13:35.6647690Z 6b3ed191d8d6: Verifying Checksum
2024-12-18T00:13:35.6648137Z 6b3ed191d8d6: Download complete
2024-12-18T00:13:35.7346950Z fe86d66e51a7: Download complete
2024-12-18T00:13:35.8210181Z d91d0050d566: Verifying Checksum
2024-12-18T00:13:35.8210585Z d91d0050d566: Download complete
2024-12-18T00:13:35.8951454Z e3a5e5066e67: Verifying Checksum
2024-12-18T00:13:35.8952002Z e3a5e5066e67: Download complete
2024-12-18T00:13:35.9460149Z 7789d1d9a480: Verifying Checksum
2024-12-18T00:13:35.9460526Z 7789d1d9a480: Download complete
2024-12-18T00:13:35.9557663Z 833e1ad1721a: Download complete
2024-12-18T00:13:36.2304635Z 2e47d4f203a1: Verifying Checksum
2024-12-18T00:13:36.2305170Z 2e47d4f203a1: Download complete
2024-12-18T00:13:36.3098746Z aba6c0f8cfc8: Verifying Checksum
2024-12-18T00:13:36.3099419Z aba6c0f8cfc8: Download complete
2024-12-18T00:13:36.3843398Z 8a5b8ffb1a25: Verifying Checksum
2024-12-18T00:13:36.3844106Z 8a5b8ffb1a25: Download complete
2024-12-18T00:13:36.4659143Z 0d227ff5c87e: Verifying Checksum
2024-12-18T00:13:36.4659736Z 0d227ff5c87e: Download complete
2024-12-18T00:13:36.5484306Z 88ca106a7035: Download complete
2024-12-18T00:13:36.6105542Z 1d5f1bb5e2ad: Download complete
2024-12-18T00:13:36.6989858Z 54482636fb36: Download complete
2024-12-18T00:13:37.1813421Z 25fd8ec17dba: Verifying Checksum
2024-12-18T00:13:37.1813988Z 25fd8ec17dba: Download complete
2024-12-18T00:13:37.2618086Z d9b7184b25fa: Verifying Checksum
2024-12-18T00:13:37.2618998Z d9b7184b25fa: Download complete
2024-12-18T00:13:37.3237527Z a3161fc6f7f1: Download complete
2024-12-18T00:13:37.4120261Z a5c771445223: Download complete
2024-12-18T00:13:37.4960560Z ef13954e836f: Verifying Checksum
2024-12-18T00:13:37.4961160Z ef13954e836f: Download complete
2024-12-18T00:13:37.7444840Z 3ad11112ed64: Verifying Checksum
2024-12-18T00:13:37.7445438Z 3ad11112ed64: Download complete
2024-12-18T00:13:37.8127517Z 217e79f06cdc: Download complete
2024-12-18T00:13:37.8905943Z 016c3af2b5ea: Verifying Checksum
2024-12-18T00:13:37.8906381Z 016c3af2b5ea: Download complete
2024-12-18T00:13:37.9660507Z ea3ba6dc5d33: Download complete
2024-12-18T00:13:38.0509096Z 3e2119736358: Verifying Checksum
2024-12-18T00:13:38.0509688Z 3e2119736358: Download complete
2024-12-18T00:13:38.1292713Z 142b9ab7f81f: Verifying Checksum
2024-12-18T00:13:38.1293327Z 142b9ab7f81f: Download complete
2024-12-18T00:13:38.2271797Z 8fab0d26d562: Download complete
2024-12-18T00:13:38.3200787Z a7792d7941ff: Download complete
2024-12-18T00:13:40.5046688Z ba61dc3263a4: Verifying Checksum
2024-12-18T00:13:40.5047219Z ba61dc3263a4: Download complete
2024-12-18T00:13:40.6321536Z 95cf8d950d0a: Download complete
2024-12-18T00:13:40.7092432Z da70495326cb: Verifying Checksum
2024-12-18T00:13:40.7093027Z da70495326cb: Download complete
2024-12-18T00:13:40.7892692Z b42f0c5083b2: Verifying Checksum
2024-12-18T00:13:40.7893593Z b42f0c5083b2: Download complete
2024-12-18T00:13:40.8737297Z 59555bf51559: Verifying Checksum
2024-12-18T00:13:40.8737924Z 59555bf51559: Download complete
2024-12-18T00:13:40.9675429Z fd368c9493e6: Download complete
2024-12-18T00:13:41.0549482Z eeba4480f336: Verifying Checksum
2024-12-18T00:13:41.0550060Z eeba4480f336: Download complete
2024-12-18T00:13:41.1569110Z 23872424bbb0: Verifying Checksum
2024-12-18T00:13:41.1569594Z 23872424bbb0: Download complete
2024-12-18T00:13:41.2361436Z aa3c5e877811: Verifying Checksum
2024-12-18T00:13:41.2362074Z aa3c5e877811: Download complete
2024-12-18T00:13:41.3232244Z 7069d9cf23ac: Verifying Checksum
2024-12-18T00:13:41.4239327Z 7069d9cf23ac: Download complete
2024-12-18T00:13:41.4239856Z 05e4316d907e: Verifying Checksum
2024-12-18T00:13:41.4240482Z 05e4316d907e: Download complete
2024-12-18T00:13:41.4958666Z 68fad68dd196: Verifying Checksum
2024-12-18T00:13:41.4959115Z 68fad68dd196: Download complete
2024-12-18T00:13:41.5813201Z aae57a8763e1: Verifying Checksum
2024-12-18T00:13:41.5813751Z aae57a8763e1: Download complete
2024-12-18T00:13:41.6479161Z d0b74f061e3a: Verifying Checksum
2024-12-18T00:13:41.6479760Z d0b74f061e3a: Download complete
2024-12-18T00:13:41.7129924Z e90b13a95dd7: Verifying Checksum
2024-12-18T00:13:41.7130548Z e90b13a95dd7: Download complete
2024-12-18T00:13:44.3187199Z ba692f76a3d8: Verifying Checksum
2024-12-18T00:13:44.3187621Z ba692f76a3d8: Download complete
2024-12-18T00:13:44.3951024Z b22d4aaf1386: Verifying Checksum
2024-12-18T00:13:44.3951610Z b22d4aaf1386: Download complete
2024-12-18T00:13:44.4804242Z 212816d8ea81: Verifying Checksum
2024-12-18T00:13:44.4804647Z 212816d8ea81: Download complete
2024-12-18T00:13:44.5545801Z 1d707d052310: Verifying Checksum
2024-12-18T00:13:44.5546244Z 1d707d052310: Download complete
2024-12-18T00:13:44.6418776Z 7bde8a531908: Verifying Checksum
2024-12-18T00:13:44.6419197Z 7bde8a531908: Download complete
2024-12-18T00:13:44.7173518Z fa2e62eb409d: Download complete
2024-12-18T00:13:44.8082747Z c321a0735855: Verifying Checksum
2024-12-18T00:13:44.8083118Z c321a0735855: Download complete
2024-12-18T00:13:45.4307261Z a2109a0ad5a9: Verifying Checksum
2024-12-18T00:13:45.4307908Z a2109a0ad5a9: Download complete
2024-12-18T00:13:45.6402175Z 6b3ed191d8d6: Pull complete
2024-12-18T00:13:45.7632958Z 134f0bded43c: Pull complete
2024-12-18T00:13:45.8783568Z 01b225caaa7c: Pull complete
2024-12-18T00:13:45.9838477Z a18b532d7d58: Pull complete
2024-12-18T00:13:46.1119988Z 97a7f64b3a5e: Pull complete
2024-12-18T00:13:46.2482835Z 34c0201c19b2: Pull complete
2024-12-18T00:14:09.3332380Z 0839e3e1edb9: Pull complete
2024-12-18T00:14:09.4401181Z f0173a8cb7e9: Pull complete
2024-12-18T00:14:09.6079875Z 6cae394dd1d9: Pull complete
2024-12-18T00:14:09.7927643Z 02463c0b1de0: Pull complete
2024-12-18T00:14:10.0032411Z 8aa13ceb0248: Pull complete
2024-12-18T00:14:17.3606907Z b745a625ea1a: Verifying Checksum
2024-12-18T00:14:17.3607383Z b745a625ea1a: Download complete
2024-12-18T00:14:33.9093062Z 19f9786e8175: Verifying Checksum
2024-12-18T00:14:33.9093455Z 19f9786e8175: Download complete
2024-12-18T00:15:57.1633183Z b745a625ea1a: Pull complete
2024-12-18T00:15:57.3501391Z 4f4fb700ef54: Pull complete
2024-12-18T00:15:57.5359884Z cf09f2e36d07: Pull complete
2024-12-18T00:15:57.7242174Z 221d65fe0e21: Pull complete
2024-12-18T00:15:57.9202523Z 90c7367fa6c0: Pull complete
2024-12-18T00:15:58.2438228Z 161e4cd16162: Pull complete
2024-12-18T00:15:58.3554774Z 512468486987: Pull complete
2024-12-18T00:15:58.4274112Z 2975d72db4cc: Pull complete
2024-12-18T00:15:58.4676432Z 04400a611323: Pull complete
2024-12-18T00:15:58.5422240Z ba1d531b3605: Pull complete
2024-12-18T00:15:58.6486036Z df682a7f38c4: Pull complete
2024-12-18T00:16:02.4723307Z 7789d1d9a480: Pull complete
2024-12-18T00:16:02.4979526Z fe86d66e51a7: Pull complete
2024-12-18T00:16:02.5177750Z d91d0050d566: Pull complete
2024-12-18T00:16:02.5392380Z e3a5e5066e67: Pull complete
2024-12-18T00:16:02.5576591Z 833e1ad1721a: Pull complete
2024-12-18T00:16:02.5823091Z 2e47d4f203a1: Pull complete
2024-12-18T00:16:10.8828507Z ba61dc3263a4: Pull complete
2024-12-18T00:16:10.8997215Z aba6c0f8cfc8: Pull complete
2024-12-18T00:16:10.9153712Z 8a5b8ffb1a25: Pull complete
2024-12-18T00:16:10.9492411Z 0d227ff5c87e: Pull complete
2024-12-18T00:16:10.9642327Z 88ca106a7035: Pull complete
2024-12-18T00:16:11.0409320Z 1d5f1bb5e2ad: Pull complete
2024-12-18T00:16:11.1070849Z 54482636fb36: Pull complete
2024-12-18T00:16:13.7004591Z 25fd8ec17dba: Pull complete
2024-12-18T00:16:13.8822171Z d9b7184b25fa: Pull complete
2024-12-18T00:16:14.0644789Z a3161fc6f7f1: Pull complete
2024-12-18T00:16:14.4727680Z a5c771445223: Pull complete
2024-12-18T00:16:14.5949031Z ef13954e836f: Pull complete
2024-12-18T00:16:15.4537411Z 3ad11112ed64: Pull complete
2024-12-18T00:16:15.5525966Z 217e79f06cdc: Pull complete
2024-12-18T00:16:15.6185588Z 016c3af2b5ea: Pull complete
2024-12-18T00:16:15.9443501Z ea3ba6dc5d33: Pull complete
2024-12-18T00:16:16.0293752Z 3e2119736358: Pull complete
2024-12-18T00:16:16.1090957Z 142b9ab7f81f: Pull complete
2024-12-18T00:16:16.1591684Z 8fab0d26d562: Pull complete
2024-12-18T00:16:16.3753380Z a7792d7941ff: Pull complete
2024-12-18T00:18:23.3252831Z 19f9786e8175: Pull complete
2024-12-18T00:18:23.4938264Z 95cf8d950d0a: Pull complete
2024-12-18T00:18:24.0836983Z da70495326cb: Pull complete
2024-12-18T00:18:24.2404105Z b42f0c5083b2: Pull complete
2024-12-18T00:18:24.2568366Z 59555bf51559: Pull complete
2024-12-18T00:18:24.2884200Z fd368c9493e6: Pull complete
2024-12-18T00:18:24.3199255Z eeba4480f336: Pull complete
2024-12-18T00:18:24.3380655Z 23872424bbb0: Pull complete
2024-12-18T00:18:24.3777393Z aa3c5e877811: Pull complete
2024-12-18T00:18:24.4111105Z 7069d9cf23ac: Pull complete
2024-12-18T00:18:24.4288107Z 05e4316d907e: Pull complete
2024-12-18T00:18:24.4592808Z 68fad68dd196: Pull complete
2024-12-18T00:18:24.4762287Z aae57a8763e1: Pull complete
2024-12-18T00:18:24.5122101Z d0b74f061e3a: Pull complete
2024-12-18T00:18:24.5270511Z e90b13a95dd7: Pull complete
2024-12-18T00:18:29.8057367Z ba692f76a3d8: Pull complete
2024-12-18T00:18:29.8220355Z b22d4aaf1386: Pull complete
2024-12-18T00:18:29.8424042Z 212816d8ea81: Pull complete
2024-12-18T00:18:29.8633997Z 1d707d052310: Pull complete
2024-12-18T00:18:29.8815596Z 7bde8a531908: Pull complete
2024-12-18T00:18:29.8973980Z fa2e62eb409d: Pull complete
2024-12-18T00:18:29.9339037Z c321a0735855: Pull complete
2024-12-18T00:18:31.8677037Z a2109a0ad5a9: Pull complete
2024-12-18T00:18:32.0683803Z Digest: sha256:8ce44960e47173a8d6260b111dd55523c2bac3a784dcddfb2273090443b4b985
2024-12-18T00:18:32.0833741Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:18:32.0873329Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:18:32.0918289Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:18:32.0919270Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2024-12-18T00:18:32.0928394Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:32.0928956Z env:
2024-12-18T00:18:32.0929222Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:32.0929504Z ##[endgroup]
2024-12-18T00:18:32.1064485Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-12-18T00:18:32.1065104Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84
2024-12-18T00:18:32.1065629Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 &
2024-12-18T00:18:32.1066124Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}"
2024-12-18T00:18:32.1072306Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:32.1072701Z env:
2024-12-18T00:18:32.1072931Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:32.1073197Z ##[endgroup]
2024-12-18T00:18:32.7809088Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T00:18:33.1961056Z Collecting psutil==5.9.1
2024-12-18T00:18:33.2348015Z   Downloading psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB)
2024-12-18T00:18:33.2881030Z Collecting nvidia-ml-py==11.525.84
2024-12-18T00:18:33.2916931Z   Downloading nvidia_ml_py-11.525.84-py3-none-any.whl (34 kB)
2024-12-18T00:18:33.3832233Z Installing collected packages: psutil, nvidia-ml-py
2024-12-18T00:18:33.5489375Z Successfully installed nvidia-ml-py-11.525.84 psutil-5.9.1
2024-12-18T00:18:33.7519624Z Prepare all required actions
2024-12-18T00:18:33.7520501Z Getting action download info
2024-12-18T00:18:33.9041602Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6)
2024-12-18T00:18:34.1771658Z Download action repository 'actions/download-artifact@v4' (SHA:fa0a91b85d4f404e444e00e005971372dc801d16)
2024-12-18T00:18:34.6151891Z ##[group]Run ./.github/actions/download-build-artifacts
2024-12-18T00:18:34.6152284Z with:
2024-12-18T00:18:34.6152536Z   name: linux-jammy-py3.9-gcc11
2024-12-18T00:18:34.6152847Z   s3-bucket: gha-artifacts
2024-12-18T00:18:34.6153111Z env:
2024-12-18T00:18:34.6153337Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:34.6153613Z ##[endgroup]
2024-12-18T00:18:34.6223390Z ##[group]Run seemethere/download-artifact-s3@v4
2024-12-18T00:18:34.6223786Z with:
2024-12-18T00:18:34.6224025Z   name: linux-jammy-py3.9-gcc11
2024-12-18T00:18:34.6224332Z   s3-bucket: gha-artifacts
2024-12-18T00:18:34.6224684Z   region: us-east-1
2024-12-18T00:18:34.6224923Z env:
2024-12-18T00:18:34.6225133Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:34.6225407Z ##[endgroup]
2024-12-18T00:18:35.1217708Z (node:39967) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-12-18T00:18:35.1218599Z 
2024-12-18T00:18:35.1218985Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-12-18T00:18:35.1219922Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-12-18T00:18:35.1220907Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-12-18T00:18:35.4163443Z Found 1 objects with prefix pytorch/pytorch/12383255652/linux-jammy-py3.9-gcc11/
2024-12-18T00:18:35.4164716Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-12-18T00:18:39.3488338Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2024-12-18T00:18:39.3494819Z Artifact download has finished successfully
2024-12-18T00:18:39.3813807Z ##[group]Run unzip -o artifacts.zip
2024-12-18T00:18:39.3814172Z unzip -o artifacts.zip
2024-12-18T00:18:39.3819903Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:39.3820301Z env:
2024-12-18T00:18:39.3820537Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:39.3820819Z ##[endgroup]
2024-12-18T00:18:39.4125901Z Archive:  artifacts.zip
2024-12-18T00:18:39.4126470Z    creating: dist/
2024-12-18T00:18:40.3894149Z   inflating: dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl  
2024-12-18T00:18:40.3894669Z    creating: build/custom_test_artifacts/
2024-12-18T00:18:40.3895083Z    creating: build/custom_test_artifacts/custom-op-build/
2024-12-18T00:18:40.3895582Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/
2024-12-18T00:18:40.3896186Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/
2024-12-18T00:18:40.3898645Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:18:40.3899349Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/
2024-12-18T00:18:40.3900025Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:18:40.3900752Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:18:40.3901457Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:18:40.3903004Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:18:40.3904244Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:18:40.3904975Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:18:40.3905698Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:18:40.3907598Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:18:40.3908491Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:18:40.3909877Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:18:40.3910727Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:18:40.3912211Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:18:40.3913186Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:18:40.3913917Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/
2024-12-18T00:18:40.3914597Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:18:40.3915293Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/
2024-12-18T00:18:40.3916053Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts  
2024-12-18T00:18:40.3916909Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make  
2024-12-18T00:18:40.3917735Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make  
2024-12-18T00:18:40.3918484Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt  
2024-12-18T00:18:40.3919271Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake  
2024-12-18T00:18:40.3920073Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make  
2024-12-18T00:18:40.3920867Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake  
2024-12-18T00:18:40.3921848Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make  
2024-12-18T00:18:40.3922636Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make  
2024-12-18T00:18:40.3938870Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d  
2024-12-18T00:18:40.4069414Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o  
2024-12-18T00:18:40.4070160Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/
2024-12-18T00:18:40.4071092Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts  
2024-12-18T00:18:40.4072169Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make  
2024-12-18T00:18:40.4073160Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make  
2024-12-18T00:18:40.4074068Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt  
2024-12-18T00:18:40.4075043Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake  
2024-12-18T00:18:40.4075879Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make  
2024-12-18T00:18:40.4076722Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake  
2024-12-18T00:18:40.4077558Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make  
2024-12-18T00:18:40.4078381Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make  
2024-12-18T00:18:40.4098540Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d  
2024-12-18T00:18:40.4174273Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o  
2024-12-18T00:18:40.4175365Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:18:40.4176242Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:18:40.4177069Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks  
2024-12-18T00:18:40.4177781Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2  
2024-12-18T00:18:40.4178557Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:18:40.4179286Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt  
2024-12-18T00:18:40.4179948Z   inflating: build/custom_test_artifacts/custom-op-build/Makefile  
2024-12-18T00:18:40.4180565Z   inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake  
2024-12-18T00:18:40.4293438Z   inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so  
2024-12-18T00:18:40.4352515Z   inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops  
2024-12-18T00:18:40.4353138Z    creating: build/custom_test_artifacts/jit-hook-build/
2024-12-18T00:18:40.4353661Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/
2024-12-18T00:18:40.4354249Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/
2024-12-18T00:18:40.4356544Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:18:40.4357379Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/
2024-12-18T00:18:40.4358118Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:18:40.4358839Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:18:40.4359539Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:18:40.4360668Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:18:40.4361632Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:18:40.4362421Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:18:40.4363135Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:18:40.4364366Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:18:40.4365795Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:18:40.4367184Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:18:40.4368148Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:18:40.4369137Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:18:40.4370196Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:18:40.4371048Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/
2024-12-18T00:18:40.4371817Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:18:40.4372636Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/
2024-12-18T00:18:40.4373546Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts  
2024-12-18T00:18:40.4374517Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make  
2024-12-18T00:18:40.4375526Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make  
2024-12-18T00:18:40.4376556Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt  
2024-12-18T00:18:40.4377405Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake  
2024-12-18T00:18:40.4378223Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make  
2024-12-18T00:18:40.4379027Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake  
2024-12-18T00:18:40.4379849Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make  
2024-12-18T00:18:40.4380651Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make  
2024-12-18T00:18:40.4395101Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d  
2024-12-18T00:18:40.4454558Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o  
2024-12-18T00:18:40.4455602Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:18:40.4456548Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:18:40.4457309Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks  
2024-12-18T00:18:40.4458043Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2  
2024-12-18T00:18:40.4458685Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:18:40.4459445Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt  
2024-12-18T00:18:40.4460130Z   inflating: build/custom_test_artifacts/jit-hook-build/Makefile  
2024-12-18T00:18:40.4460790Z   inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake  
2024-12-18T00:18:40.4508087Z   inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks  
2024-12-18T00:18:40.4508738Z    creating: build/custom_test_artifacts/custom-backend-build/
2024-12-18T00:18:40.4509493Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/
2024-12-18T00:18:40.4510214Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/
2024-12-18T00:18:40.4512145Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml  
2024-12-18T00:18:40.4513049Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/
2024-12-18T00:18:40.4513824Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake  
2024-12-18T00:18:40.4514637Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/
2024-12-18T00:18:40.4515392Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/
2024-12-18T00:18:40.4516376Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c  
2024-12-18T00:18:40.4517489Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out  
2024-12-18T00:18:40.4518352Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/
2024-12-18T00:18:40.4519134Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/
2024-12-18T00:18:40.4520212Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2024-12-18T00:18:40.4521459Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out  
2024-12-18T00:18:40.4522916Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin  
2024-12-18T00:18:40.4524010Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake  
2024-12-18T00:18:40.4525191Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin  
2024-12-18T00:18:40.4526340Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake  
2024-12-18T00:18:40.4527231Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/
2024-12-18T00:18:40.4528124Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache  
2024-12-18T00:18:40.4529002Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/
2024-12-18T00:18:40.4529967Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts  
2024-12-18T00:18:40.4531059Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make  
2024-12-18T00:18:40.4532070Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make  
2024-12-18T00:18:40.4532915Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt  
2024-12-18T00:18:40.4533803Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake  
2024-12-18T00:18:40.4534694Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make  
2024-12-18T00:18:40.4535706Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake  
2024-12-18T00:18:40.4536588Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make  
2024-12-18T00:18:40.4537459Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make  
2024-12-18T00:18:40.4538581Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d  
2024-12-18T00:18:40.4649128Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o  
2024-12-18T00:18:40.4650446Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/
2024-12-18T00:18:40.4651477Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts  
2024-12-18T00:18:40.4652686Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make  
2024-12-18T00:18:40.4653798Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make  
2024-12-18T00:18:40.4654697Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt  
2024-12-18T00:18:40.4655623Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake  
2024-12-18T00:18:40.4656562Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make  
2024-12-18T00:18:40.4657499Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake  
2024-12-18T00:18:40.4658435Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make  
2024-12-18T00:18:40.4659354Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make  
2024-12-18T00:18:40.4672798Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d  
2024-12-18T00:18:40.4723512Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o  
2024-12-18T00:18:40.4724827Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:18:40.4725786Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt  
2024-12-18T00:18:40.4726858Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks  
2024-12-18T00:18:40.4727578Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2  
2024-12-18T00:18:40.4728379Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake  
2024-12-18T00:18:40.4729260Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt  
2024-12-18T00:18:40.4729885Z   inflating: build/custom_test_artifacts/custom-backend-build/Makefile  
2024-12-18T00:18:40.4730507Z   inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake  
2024-12-18T00:18:40.4825588Z   inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so  
2024-12-18T00:18:40.4866279Z   inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend  
2024-12-18T00:18:40.4866802Z    creating: build/lib/
2024-12-18T00:18:40.4867156Z   inflating: build/lib/libclog.a     
2024-12-18T00:18:40.4876650Z   inflating: build/lib/libpthreadpool.a  
2024-12-18T00:18:40.4884718Z   inflating: build/lib/libcpuinfo.a  
2024-12-18T00:18:40.4892212Z   inflating: build/lib/libcpuinfo_internals.a  
2024-12-18T00:18:40.4958814Z   inflating: build/lib/libgtest.a    
2024-12-18T00:18:40.5037513Z   inflating: build/lib/libprotobuf-lite.a  
2024-12-18T00:18:40.5044901Z   inflating: build/lib/libittnotify.a  
2024-12-18T00:18:40.5114281Z   inflating: build/lib/libbenchmark.a  
2024-12-18T00:18:40.5140765Z   inflating: build/lib/libtensorpipe_uv.a  
2024-12-18T00:18:40.5201822Z   inflating: build/lib/libasmjit.a   
2024-12-18T00:18:40.5310095Z   inflating: build/lib/libgloo.a     
2024-12-18T00:18:40.5739216Z   inflating: build/lib/libprotobuf.a  
2024-12-18T00:18:40.5758969Z   inflating: build/lib/libfmt.a      
2024-12-18T00:18:40.5760175Z   inflating: build/lib/libtorch_global_deps.so  
2024-12-18T00:18:40.5855331Z   inflating: build/lib/libc10.so     
2024-12-18T00:18:40.5857490Z   inflating: build/lib/libnnpack_reference_layers.a  
2024-12-18T00:18:40.5875489Z   inflating: build/lib/libpytorch_qnnpack.a  
2024-12-18T00:18:40.6347545Z   inflating: build/lib/libprotoc.a   
2024-12-18T00:18:40.6363669Z   inflating: build/lib/libgmock.a    
2024-12-18T00:18:40.6364434Z   inflating: build/lib/libgtest_main.a  
2024-12-18T00:18:40.6364988Z   inflating: build/lib/libbenchmark_main.a  
2024-12-18T00:18:40.6382257Z   inflating: build/lib/libnnpack.a   
2024-12-18T00:18:41.5789390Z   inflating: build/lib/libdnnl.a     
2024-12-18T00:18:41.6313286Z   inflating: build/lib/libtensorpipe.a  
2024-12-18T00:18:41.6314243Z   inflating: build/lib/libgmock_main.a  
2024-12-18T00:18:41.7293973Z   inflating: build/lib/libfbgemm.a   
2024-12-18T00:18:41.7569598Z   inflating: build/lib/libkineto.a   
2024-12-18T00:18:41.7608638Z   inflating: build/lib/libonnx_proto.a  
2024-12-18T00:18:41.8295307Z   inflating: build/lib/libonnx.a     
2024-12-18T00:18:41.8474559Z   inflating: build/lib/libmicrokernels-prod.a  
2024-12-18T00:18:41.8559716Z   inflating: build/lib/libXNNPACK.a  
2024-12-18T00:18:41.9463456Z   inflating: build/lib/libmicrokernels-all.a  
2024-12-18T00:18:44.2485751Z   inflating: build/lib/libtorch_cpu.so  
2024-12-18T00:18:44.2486594Z   inflating: build/lib/libtorch.so   
2024-12-18T00:18:44.2490911Z   inflating: build/lib/libunbox_lib.a  
2024-12-18T00:18:44.2494518Z   inflating: build/lib/libshm.so     
2024-12-18T00:18:44.2512333Z   inflating: build/lib/libjitbackend_test.so  
2024-12-18T00:18:44.2535829Z   inflating: build/lib/libbackend_with_compiler.so  
2024-12-18T00:18:44.2558909Z   inflating: build/lib/libaoti_custom_ops.so  
2024-12-18T00:18:44.2631590Z   inflating: build/lib/libtorchbind_test.so  
2024-12-18T00:18:44.4464803Z   inflating: build/lib/libtorch_python.so  
2024-12-18T00:18:44.4497792Z   inflating: build/lib/libnnapi_backend.so  
2024-12-18T00:18:44.4498441Z    creating: build/bin/
2024-12-18T00:18:44.4498921Z    creating: build/bin/CMakeFiles/
2024-12-18T00:18:44.4500089Z   inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake  
2024-12-18T00:18:44.4501061Z  extracting: build/bin/CMakeFiles/progress.marks  
2024-12-18T00:18:44.4501750Z   inflating: build/bin/Makefile      
2024-12-18T00:18:44.4502373Z   inflating: build/bin/cmake_install.cmake  
2024-12-18T00:18:44.4503033Z   inflating: build/bin/CTestTestfile.cmake  
2024-12-18T00:18:44.4556352Z   inflating: build/bin/c10_CompileTimeFunctionPointer_test  
2024-12-18T00:18:44.4611186Z   inflating: build/bin/c10_DeviceGuard_test  
2024-12-18T00:18:44.4666780Z   inflating: build/bin/c10_Device_test  
2024-12-18T00:18:44.4729539Z   inflating: build/bin/c10_DispatchKeySet_test  
2024-12-18T00:18:44.4782276Z   inflating: build/bin/c10_StreamGuard_test  
2024-12-18T00:18:44.4840377Z   inflating: build/bin/c10_Scalar_test  
2024-12-18T00:18:44.4894740Z   inflating: build/bin/c10_SymInt_test  
2024-12-18T00:18:44.4952524Z   inflating: build/bin/c10_InlineDeviceGuard_test  
2024-12-18T00:18:44.5011969Z   inflating: build/bin/c10_InlineStreamGuard_test  
2024-12-18T00:18:44.5071659Z   inflating: build/bin/c10_SizesAndStrides_test  
2024-12-18T00:18:44.5124913Z   inflating: build/bin/c10_ArrayRef_test  
2024-12-18T00:18:44.5181687Z   inflating: build/bin/c10_Bitset_test  
2024-12-18T00:18:44.5255640Z   inflating: build/bin/c10_cow_test  
2024-12-18T00:18:44.5308075Z   inflating: build/bin/c10_ConstexprCrc_test  
2024-12-18T00:18:44.5361829Z   inflating: build/bin/c10_DeadlockDetection_test  
2024-12-18T00:18:44.5416061Z   inflating: build/bin/c10_Half_test  
2024-12-18T00:18:44.5475768Z   inflating: build/bin/c10_LeftRight_test  
2024-12-18T00:18:44.5532975Z   inflating: build/bin/c10_NetworkFlow_test  
2024-12-18T00:18:44.5592276Z   inflating: build/bin/c10_Metaprogramming_test  
2024-12-18T00:18:44.5651395Z   inflating: build/bin/c10_ThreadLocal_test  
2024-12-18T00:18:44.5705033Z   inflating: build/bin/c10_Synchronized_test  
2024-12-18T00:18:44.5760066Z   inflating: build/bin/c10_TypeIndex_test  
2024-12-18T00:18:44.5812598Z   inflating: build/bin/c10_TypeTraits_test  
2024-12-18T00:18:44.5867938Z   inflating: build/bin/c10_accumulate_test  
2024-12-18T00:18:44.5922584Z   inflating: build/bin/c10_TypeList_test  
2024-12-18T00:18:44.5982059Z   inflating: build/bin/c10_bfloat16_test  
2024-12-18T00:18:44.6036258Z   inflating: build/bin/c10_bit_cast_test  
2024-12-18T00:18:44.6096734Z   inflating: build/bin/c10_complex_math_test  
2024-12-18T00:18:44.6156009Z   inflating: build/bin/c10_complex_test  
2024-12-18T00:18:44.6209326Z   inflating: build/bin/c10_error_test  
2024-12-18T00:18:44.6265907Z   inflating: build/bin/c10_exception_test  
2024-12-18T00:18:44.6319838Z   inflating: build/bin/c10_flags_test  
2024-12-18T00:18:44.6374405Z   inflating: build/bin/c10_generic_math_test  
2024-12-18T00:18:44.6539145Z   inflating: build/bin/c10_intrusive_ptr_test  
2024-12-18T00:18:44.6593053Z   inflating: build/bin/c10_irange_test  
2024-12-18T00:18:44.6650413Z   inflating: build/bin/c10_lazy_test  
2024-12-18T00:18:44.6710847Z   inflating: build/bin/c10_logging_test  
2024-12-18T00:18:44.6789298Z   inflating: build/bin/c10_optional_test  
2024-12-18T00:18:44.6854723Z   inflating: build/bin/c10_ordered_preserving_dict_test  
2024-12-18T00:18:44.6911255Z   inflating: build/bin/c10_registry_test  
2024-12-18T00:18:44.7066859Z   inflating: build/bin/c10_small_vector_test  
2024-12-18T00:18:44.7122036Z   inflating: build/bin/c10_string_util_test  
2024-12-18T00:18:44.7177299Z   inflating: build/bin/c10_ssize_test  
2024-12-18T00:18:44.7240453Z   inflating: build/bin/c10_string_view_test  
2024-12-18T00:18:44.7294426Z   inflating: build/bin/c10_tempfile_test  
2024-12-18T00:18:44.7342206Z   inflating: build/bin/c10_intrusive_ptr_benchmark  
2024-12-18T00:18:44.7402521Z   inflating: build/bin/c10_typeid_test  
2024-12-18T00:18:44.7841382Z   inflating: build/bin/protoc-3.13.0.0  
2024-12-18T00:18:44.8280333Z   inflating: build/bin/protoc        
2024-12-18T00:18:44.8663665Z   inflating: build/bin/vec_test_all_types_DEFAULT  
2024-12-18T00:18:44.9062476Z   inflating: build/bin/vec_test_all_types_AVX512  
2024-12-18T00:18:44.9472273Z   inflating: build/bin/vec_test_all_types_AVX2  
2024-12-18T00:18:44.9529186Z   inflating: build/bin/FileStoreTest  
2024-12-18T00:18:44.9588591Z   inflating: build/bin/HashStoreTest  
2024-12-18T00:18:44.9648881Z   inflating: build/bin/TCPStoreTest  
2024-12-18T00:18:44.9705327Z   inflating: build/bin/BackoffTest   
2024-12-18T00:18:44.9775480Z   inflating: build/bin/ProcessGroupGlooTest  
2024-12-18T00:18:44.9779076Z   inflating: build/bin/example_allreduce  
2024-12-18T00:18:44.9782046Z   inflating: build/bin/parallel_benchmark  
2024-12-18T00:18:44.9841303Z   inflating: build/bin/test_dist_autograd  
2024-12-18T00:18:44.9912023Z   inflating: build/bin/test_cpp_rpc  
2024-12-18T00:18:44.9981850Z   inflating: build/bin/test_mobile_nnc  
2024-12-18T00:18:45.0059199Z   inflating: build/bin/Dict_test     
2024-12-18T00:18:45.0115402Z   inflating: build/bin/Dimname_test  
2024-12-18T00:18:45.0184283Z   inflating: build/bin/MaybeOwned_test  
2024-12-18T00:18:45.0193180Z   inflating: build/bin/aot_model_compiler_test  
2024-12-18T00:18:45.0253963Z   inflating: build/bin/NamedTensor_test  
2024-12-18T00:18:45.0315787Z   inflating: build/bin/apply_utils_test  
2024-12-18T00:18:45.0373444Z   inflating: build/bin/static_runtime_bench  
2024-12-18T00:18:45.0623663Z   inflating: build/bin/static_runtime_test  
2024-12-18T00:18:45.0686289Z   inflating: build/bin/atest         
2024-12-18T00:18:45.0753323Z   inflating: build/bin/basic         
2024-12-18T00:18:45.0812304Z   inflating: build/bin/broadcast_test  
2024-12-18T00:18:45.0867065Z   inflating: build/bin/cpu_allocator_test  
2024-12-18T00:18:45.1205025Z   inflating: build/bin/test_lazy     
2024-12-18T00:18:45.1266856Z   inflating: build/bin/cpu_generator_test  
2024-12-18T00:18:45.1323340Z   inflating: build/bin/cpu_profiling_allocator_test  
2024-12-18T00:18:45.1377204Z   inflating: build/bin/dispatch_key_set_test  
2024-12-18T00:18:45.1431203Z   inflating: build/bin/dlconvertor_test  
2024-12-18T00:18:45.1492180Z   inflating: build/bin/extension_backend_test  
2024-12-18T00:18:45.1551628Z   inflating: build/bin/half_test     
2024-12-18T00:18:45.1645705Z   inflating: build/bin/cpu_rng_test  
2024-12-18T00:18:45.1699134Z   inflating: build/bin/lazy_tensor_test  
2024-12-18T00:18:45.1797481Z   inflating: build/bin/ivalue_test   
2024-12-18T00:18:45.1854393Z   inflating: build/bin/math_kernel_test  
2024-12-18T00:18:45.1911579Z   inflating: build/bin/memory_format_test  
2024-12-18T00:18:45.1968200Z   inflating: build/bin/memory_overlapping_test  
2024-12-18T00:18:45.2027624Z   inflating: build/bin/native_test   
2024-12-18T00:18:45.2082539Z   inflating: build/bin/operator_name_test  
2024-12-18T00:18:45.2136522Z   inflating: build/bin/operators_test  
2024-12-18T00:18:45.2192335Z   inflating: build/bin/packedtensoraccessor_test  
2024-12-18T00:18:45.2254089Z   inflating: build/bin/quantized_test  
2024-12-18T00:18:45.2308119Z   inflating: build/bin/reportMemoryUsage_test  
2024-12-18T00:18:45.2365087Z   inflating: build/bin/mobile_memory_cleanup  
2024-12-18T00:18:45.2425804Z   inflating: build/bin/scalar_tensor_test  
2024-12-18T00:18:45.2487799Z   inflating: build/bin/scalar_test   
2024-12-18T00:18:45.2542026Z   inflating: build/bin/StorageUtils_test  
2024-12-18T00:18:45.2595468Z   inflating: build/bin/reduce_ops_test  
2024-12-18T00:18:45.2665586Z   inflating: build/bin/pow_test      
2024-12-18T00:18:45.2720773Z   inflating: build/bin/stride_properties_test  
2024-12-18T00:18:45.2801808Z   inflating: build/bin/tensor_iterator_test  
2024-12-18T00:18:45.2859634Z   inflating: build/bin/test_parallel  
2024-12-18T00:18:45.2862286Z   inflating: build/bin/thread_init_test  
2024-12-18T00:18:45.2920587Z   inflating: build/bin/type_ptr_test  
2024-12-18T00:18:45.2976654Z   inflating: build/bin/undefined_tensor_test  
2024-12-18T00:18:45.2978237Z   inflating: build/bin/verify_api_visibility  
2024-12-18T00:18:45.3051379Z   inflating: build/bin/legacy_vmap_test  
2024-12-18T00:18:45.3105414Z   inflating: build/bin/weakref_test  
2024-12-18T00:18:45.3160398Z   inflating: build/bin/wrapdim_test  
2024-12-18T00:18:45.3214768Z   inflating: build/bin/xla_tensor_test  
2024-12-18T00:18:45.3277532Z   inflating: build/bin/IListRef_test  
2024-12-18T00:18:45.3385937Z   inflating: build/bin/List_test     
2024-12-18T00:18:45.3454919Z   inflating: build/bin/KernelFunction_test  
2024-12-18T00:18:45.3576913Z   inflating: build/bin/kernel_function_legacy_test  
2024-12-18T00:18:45.3674388Z   inflating: build/bin/kernel_function_test  
2024-12-18T00:18:45.3801148Z   inflating: build/bin/kernel_lambda_legacy_test  
2024-12-18T00:18:45.3904512Z   inflating: build/bin/kernel_lambda_test  
2024-12-18T00:18:45.3968787Z   inflating: build/bin/kernel_stackbased_test  
2024-12-18T00:18:45.4066289Z   inflating: build/bin/make_boxed_from_unboxed_functor_test  
2024-12-18T00:18:45.4120349Z   inflating: build/bin/CppSignature_test  
2024-12-18T00:18:45.4172701Z   inflating: build/bin/op_allowlist_test  
2024-12-18T00:18:45.4239963Z   inflating: build/bin/inline_container_test  
2024-12-18T00:18:45.4298454Z   inflating: build/bin/backend_fallback_test  
2024-12-18T00:18:45.4602531Z   inflating: build/bin/op_registration_test  
2024-12-18T00:18:45.4664950Z   inflating: build/bin/type_test     
2024-12-18T00:18:45.5759013Z   inflating: build/bin/test_api      
2024-12-18T00:18:45.5815212Z   inflating: build/bin/test_edge_op_registration  
2024-12-18T00:18:45.5827768Z   inflating: build/bin/tutorial_tensorexpr  
2024-12-18T00:18:45.5831972Z   inflating: build/bin/torch_shm_manager  
2024-12-18T00:18:45.6603735Z   inflating: build/bin/test_tensorexpr  
2024-12-18T00:18:45.7163326Z   inflating: build/bin/test_jit      
2024-12-18T00:18:45.7163670Z    creating: .additional_ci_files/
2024-12-18T00:18:45.7249959Z   inflating: .additional_ci_files/test-times.json  
2024-12-18T00:18:45.7591833Z   inflating: .additional_ci_files/test-class-times.json  
2024-12-18T00:18:45.7619481Z ##[group]Run rm artifacts.zip
2024-12-18T00:18:45.7619810Z rm artifacts.zip
2024-12-18T00:18:45.7626604Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:45.7626985Z env:
2024-12-18T00:18:45.7627218Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:45.7627495Z ##[endgroup]
2024-12-18T00:18:45.8032653Z ##[group]Run df -H
2024-12-18T00:18:45.8032935Z df -H
2024-12-18T00:18:45.8042706Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:45.8043120Z env:
2024-12-18T00:18:45.8043358Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:45.8043641Z ##[endgroup]
2024-12-18T00:18:45.8262387Z Filesystem        Size  Used Avail Use% Mounted on
2024-12-18T00:18:45.8263013Z devtmpfs          4.2M     0  4.2M   0% /dev
2024-12-18T00:18:45.8263598Z tmpfs             8.2G     0  8.2G   0% /dev/shm
2024-12-18T00:18:45.8264136Z tmpfs             3.3G  488k  3.3G   1% /run
2024-12-18T00:18:45.8264664Z /dev/nvme0n1p1    161G   37G  125G  23% /
2024-12-18T00:18:45.8265143Z tmpfs             8.2G   13k  8.2G   1% /tmp
2024-12-18T00:18:45.8265591Z /dev/nvme0n1p128   11M  1.4M  9.2M  13% /boot/efi
2024-12-18T00:18:45.8428251Z Prepare all required actions
2024-12-18T00:18:45.8429282Z Getting action download info
2024-12-18T00:18:46.0002382Z ##[group]Run ./.github/actions/download-td-artifacts
2024-12-18T00:18:46.0002761Z with:
2024-12-18T00:18:46.0002982Z env:
2024-12-18T00:18:46.0003212Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.0003479Z ##[endgroup]
2024-12-18T00:18:46.0178949Z ##[group]Run seemethere/download-artifact-s3@v4
2024-12-18T00:18:46.0179313Z with:
2024-12-18T00:18:46.0179541Z   name: td_results
2024-12-18T00:18:46.0179797Z   s3-bucket: gha-artifacts
2024-12-18T00:18:46.0180082Z   region: us-east-1
2024-12-18T00:18:46.0180314Z env:
2024-12-18T00:18:46.0180534Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.0180807Z ##[endgroup]
2024-12-18T00:18:46.4755073Z (node:39988) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2024-12-18T00:18:46.4755587Z 
2024-12-18T00:18:46.4755876Z Please migrate your code to use AWS SDK for JavaScript (v3).
2024-12-18T00:18:46.4756459Z For more information, check the migration guide at https://a.co/7PzMCcy
2024-12-18T00:18:46.4757035Z (Use `node --trace-warnings ...` to show where the warning was created)
2024-12-18T00:18:46.5792721Z Found 1 objects with prefix pytorch/pytorch/12383255652/td_results/
2024-12-18T00:18:46.5793510Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-12-18T00:18:46.6306570Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json
2024-12-18T00:18:46.6311592Z Artifact download has finished successfully
2024-12-18T00:18:46.6627135Z ##[group]Run mkdir -p .additional_ci_files
2024-12-18T00:18:46.6627531Z mkdir -p .additional_ci_files
2024-12-18T00:18:46.6627978Z mv td_results.json .additional_ci_files/td_results.json || true
2024-12-18T00:18:46.6634012Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:46.6634422Z env:
2024-12-18T00:18:46.6634690Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.6634966Z ##[endgroup]
2024-12-18T00:18:46.6768144Z ##[group]Run .github/scripts/parse_ref.py
2024-12-18T00:18:46.6768548Z .github/scripts/parse_ref.py
2024-12-18T00:18:46.6774227Z shell: /usr/bin/bash -e {0}
2024-12-18T00:18:46.6774520Z env:
2024-12-18T00:18:46.6774753Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.6775019Z ##[endgroup]
2024-12-18T00:18:46.7052920Z Prepare all required actions
2024-12-18T00:18:46.7102379Z ##[group]Run ./.github/actions/get-workflow-job-id
2024-12-18T00:18:46.7102753Z with:
2024-12-18T00:18:46.7103195Z   github-token: ***
2024-12-18T00:18:46.7103434Z env:
2024-12-18T00:18:46.7103661Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.7103937Z ##[endgroup]
2024-12-18T00:18:46.7133086Z ##[group]Run set -eux
2024-12-18T00:18:46.7133376Z set -eux
2024-12-18T00:18:46.7133821Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2024-12-18T00:18:46.7140390Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:46.7140928Z env:
2024-12-18T00:18:46.7141149Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:46.7141710Z   GITHUB_TOKEN: ***
2024-12-18T00:18:46.7141969Z ##[endgroup]
2024-12-18T00:18:46.7165371Z + python3 .github/scripts/get_workflow_job_id.py 12383255652 i-0e3f9f9d03e28a547
2024-12-18T00:18:49.1829359Z setting job-id=34566861385
2024-12-18T00:18:49.1830003Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:18:49.2022570Z Prepare all required actions
2024-12-18T00:18:49.2023011Z Getting action download info
2024-12-18T00:18:49.3953908Z ##[group]Run ./.github/actions/filter-test-configs
2024-12-18T00:18:49.3954278Z with:
2024-12-18T00:18:49.3954695Z   github-token: ***
2024-12-18T00:18:49.3957484Z   test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}
2024-12-18T00:18:49.3960452Z   job-name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:18:49.3960912Z env:
2024-12-18T00:18:49.3961125Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:49.3961403Z ##[endgroup]
2024-12-18T00:18:49.4001543Z ##[group]Run nick-fields/retry@v3.0.0
2024-12-18T00:18:49.4001890Z with:
2024-12-18T00:18:49.4002124Z   shell: bash
2024-12-18T00:18:49.4002375Z   timeout_minutes: 10
2024-12-18T00:18:49.4002659Z   max_attempts: 5
2024-12-18T00:18:49.4002937Z   retry_wait_seconds: 30
2024-12-18T00:18:49.4003764Z   command: set -eux
# PyYAML 6.0 doesn't work with MacOS x86 anymore
# This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2
python3 -m pip install requests==2.27.1 pyyaml==6.0.1

2024-12-18T00:18:49.4004753Z   polling_interval_seconds: 1
2024-12-18T00:18:49.4005065Z   warning_on_retry: true
2024-12-18T00:18:49.4005350Z   continue_on_error: false
2024-12-18T00:18:49.4005628Z env:
2024-12-18T00:18:49.4005844Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:49.4006336Z   GITHUB_TOKEN: ***
2024-12-18T00:18:49.4006593Z ##[endgroup]
2024-12-18T00:18:49.5130766Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1
2024-12-18T00:18:49.7570083Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T00:18:49.8944676Z Collecting requests==2.27.1
2024-12-18T00:18:49.9332853Z   Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB)
2024-12-18T00:18:50.1170215Z Collecting pyyaml==6.0.1
2024-12-18T00:18:50.1214651Z   Downloading PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB)
2024-12-18T00:18:50.1579769Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10)
2024-12-18T00:18:50.1583307Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10)
2024-12-18T00:18:50.2018647Z Collecting certifi>=2017.4.17
2024-12-18T00:18:50.2064808Z   Downloading certifi-2024.12.14-py3-none-any.whl (164 kB)
2024-12-18T00:18:50.5074143Z Collecting charset-normalizer~=2.0.0
2024-12-18T00:18:50.5124870Z   Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB)
2024-12-18T00:18:50.5928456Z Installing collected packages: charset-normalizer, certifi, requests, pyyaml
2024-12-18T00:18:50.7160926Z Successfully installed certifi-2024.12.14 charset-normalizer-2.0.12 pyyaml-6.0.1 requests-2.27.1
2024-12-18T00:18:51.4875380Z Command completed after 1 attempt(s).
2024-12-18T00:18:51.4946933Z ##[group]Run set -x
2024-12-18T00:18:51.4947228Z set -x
2024-12-18T00:18:51.4947469Z 
2024-12-18T00:18:51.4947862Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-12-18T00:18:51.4948361Z # in runner workspace
2024-12-18T00:18:51.4948956Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py"
2024-12-18T00:18:51.4954860Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:51.4955252Z env:
2024-12-18T00:18:51.4955484Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:51.4955751Z ##[endgroup]
2024-12-18T00:18:51.4980003Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py
2024-12-18T00:18:51.5220249Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}"
2024-12-18T00:18:51.5220715Z echo "Workflow: ${GITHUB_WORKFLOW}"
2024-12-18T00:18:51.5221074Z echo "Job name: ${JOB_NAME}"
2024-12-18T00:18:51.5221379Z 
2024-12-18T00:18:51.5221757Z # Use relative path here as this could be checked out anywhere, not necessarily
2024-12-18T00:18:51.5222240Z # in runner workspace
2024-12-18T00:18:51.5222678Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \
2024-12-18T00:18:51.5223183Z   --workflow "${GITHUB_WORKFLOW}" \
2024-12-18T00:18:51.5223533Z   --job-name "${JOB_NAME}" \
2024-12-18T00:18:51.5226363Z   --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}" \
2024-12-18T00:18:51.5229190Z   --selected-test-configs "" \
2024-12-18T00:18:51.5229538Z   --pr-number "${PR_NUMBER}" \
2024-12-18T00:18:51.5229861Z   --tag "${TAG}" \
2024-12-18T00:18:51.5230167Z   --event-name "${EVENT_NAME}" \
2024-12-18T00:18:51.5230489Z   --schedule "${SCHEDULE}" \
2024-12-18T00:18:51.5230814Z   --branch "${HEAD_BRANCH}"
2024-12-18T00:18:51.5236761Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:51.5237158Z env:
2024-12-18T00:18:51.5237385Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:51.5237874Z   GITHUB_TOKEN: ***
2024-12-18T00:18:51.5238260Z   JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:18:51.5238973Z   PR_NUMBER: 
2024-12-18T00:18:51.5239207Z   TAG: 
2024-12-18T00:18:51.5239435Z   EVENT_NAME: push
2024-12-18T00:18:51.5239681Z   SCHEDULE: 
2024-12-18T00:18:51.5239916Z   HEAD_BRANCH: 
2024-12-18T00:18:51.5240159Z ##[endgroup]
2024-12-18T00:18:51.5263132Z Workflow: pull
2024-12-18T00:18:51.5263561Z Job name: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:18:52.3711263Z ##[group]Run echo "Filtered matrix:"
2024-12-18T00:18:52.3711629Z echo "Filtered matrix:"
2024-12-18T00:18:52.3714641Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "default", "shard": 5, "num_shards": 5, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "numpy_2_x", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}]}"
2024-12-18T00:18:52.3717542Z 
2024-12-18T00:18:52.3717754Z echo
2024-12-18T00:18:52.3718049Z echo "Is the current job unstable? False"
2024-12-18T00:18:52.3718403Z 
2024-12-18T00:18:52.3718622Z echo
2024-12-18T00:18:52.3718905Z echo "Is keep-going label set? False"
2024-12-18T00:18:52.3719230Z 
2024-12-18T00:18:52.3719445Z echo
2024-12-18T00:18:52.3719693Z echo "Renabled issues? "
2024-12-18T00:18:52.3725682Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:52.3726079Z env:
2024-12-18T00:18:52.3726320Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:52.3726587Z ##[endgroup]
2024-12-18T00:18:52.3750015Z Filtered matrix:
2024-12-18T00:18:52.3753764Z {include: [{config: default, shard: 1, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 2, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 3, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 4, num_shards: 5, runner: linux.2xlarge}, {config: default, shard: 5, num_shards: 5, runner: linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: linux.2xlarge}, {config: numpy_2_x, shard: 1, num_shards: 1, runner: linux.2xlarge}]}
2024-12-18T00:18:52.3756403Z 
2024-12-18T00:18:52.3756521Z Is the current job unstable? False
2024-12-18T00:18:52.3756749Z 
2024-12-18T00:18:52.3756864Z Is keep-going label set? False
2024-12-18T00:18:52.3757068Z 
2024-12-18T00:18:52.3757168Z Renabled issues? 
2024-12-18T00:18:52.3868275Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-12-18T00:18:52.3868819Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2024-12-18T00:18:52.3874492Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T00:18:52.3874885Z env:
2024-12-18T00:18:52.3875118Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:52.3875395Z   JOB_TIMEOUT: 240
2024-12-18T00:18:52.3875625Z ##[endgroup]
2024-12-18T00:18:52.4025825Z ##[group]Run set -x
2024-12-18T00:18:52.4026198Z set -x
2024-12-18T00:18:52.4026427Z 
2024-12-18T00:18:52.4026701Z if [[ $TEST_CONFIG == 'multigpu' ]]; then
2024-12-18T00:18:52.4027127Z   TEST_COMMAND=.ci/pytorch/multigpu-test.sh
2024-12-18T00:18:52.4027549Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then
2024-12-18T00:18:52.4027931Z   TEST_COMMAND=.ci/onnx/test.sh
2024-12-18T00:18:52.4028240Z else
2024-12-18T00:18:52.4028512Z   TEST_COMMAND=.ci/pytorch/test.sh
2024-12-18T00:18:52.4028842Z fi
2024-12-18T00:18:52.4029071Z 
2024-12-18T00:18:52.4029430Z # detached container should get cleaned up by teardown_ec2_linux
2024-12-18T00:18:52.4029977Z # TODO: Stop building test binaries as part of the build phase
2024-12-18T00:18:52.4030459Z # Used for GPU_FLAG since that doesn't play nice
2024-12-18T00:18:52.4030921Z # shellcheck disable=SC2086,SC2090
2024-12-18T00:18:52.4031409Z container_name=$(docker run \
2024-12-18T00:18:52.4031724Z   ${GPU_FLAG:-} \
2024-12-18T00:18:52.4032046Z   ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \
2024-12-18T00:18:52.4032405Z   -e BUILD_ENVIRONMENT \
2024-12-18T00:18:52.4032719Z   -e PR_NUMBER \
2024-12-18T00:18:52.4033007Z   -e GITHUB_ACTIONS \
2024-12-18T00:18:52.4033297Z   -e GITHUB_REPOSITORY \
2024-12-18T00:18:52.4033608Z   -e GITHUB_WORKFLOW \
2024-12-18T00:18:52.4033912Z   -e GITHUB_JOB \
2024-12-18T00:18:52.4034196Z   -e GITHUB_RUN_ID \
2024-12-18T00:18:52.4034488Z   -e GITHUB_RUN_NUMBER \
2024-12-18T00:18:52.4034793Z   -e GITHUB_RUN_ATTEMPT \
2024-12-18T00:18:52.4035102Z   -e JOB_ID \
2024-12-18T00:18:52.4035371Z   -e JOB_NAME \
2024-12-18T00:18:52.4035649Z   -e BASE_SHA \
2024-12-18T00:18:52.4035921Z   -e BRANCH \
2024-12-18T00:18:52.4036175Z   -e SHA1 \
2024-12-18T00:18:52.4036451Z   -e AWS_DEFAULT_REGION \
2024-12-18T00:18:52.4036762Z   -e IN_WHEEL_TEST \
2024-12-18T00:18:52.4037053Z   -e SHARD_NUMBER \
2024-12-18T00:18:52.4037346Z   -e TEST_CONFIG \
2024-12-18T00:18:52.4037623Z   -e NUM_TEST_SHARDS \
2024-12-18T00:18:52.4037929Z   -e REENABLED_ISSUES \
2024-12-18T00:18:52.4038247Z   -e CONTINUE_THROUGH_ERROR \
2024-12-18T00:18:52.4038846Z   -e VERBOSE_TEST_LOGS \
2024-12-18T00:18:52.4039163Z   -e TEST_SHOWLOCALS \
2024-12-18T00:18:52.4039454Z   -e NO_TEST_TIMEOUT \
2024-12-18T00:18:52.4039752Z   -e NO_TD \
2024-12-18T00:18:52.4040026Z   -e TD_DISTRIBUTED \
2024-12-18T00:18:52.4040321Z   -e PR_LABELS \
2024-12-18T00:18:52.4040632Z   -e MAX_JOBS="$(nproc --ignore=2)" \
2024-12-18T00:18:52.4040970Z   -e SCCACHE_BUCKET \
2024-12-18T00:18:52.4041274Z   -e SCCACHE_REGION \
2024-12-18T00:18:52.4041582Z   -e SCCACHE_S3_KEY_PREFIX \
2024-12-18T00:18:52.4041899Z   -e XLA_CUDA \
2024-12-18T00:18:52.4042208Z   -e XLA_CLANG_CACHE_S3_BUCKET_NAME \
2024-12-18T00:18:52.4042592Z   -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \
2024-12-18T00:18:52.4042972Z   -e PYTORCH_TEST_RERUN_DISABLED_TESTS \
2024-12-18T00:18:52.4043357Z   -e SKIP_SCCACHE_INITIALIZATION=1 \
2024-12-18T00:18:52.4043715Z   -e HUGGING_FACE_HUB_TOKEN \
2024-12-18T00:18:52.4044119Z   -e SCRIBE_GRAPHQL_ACCESS_TOKEN \
2024-12-18T00:18:52.4044462Z   -e DASHBOARD_TAG \
2024-12-18T00:18:52.4044741Z   -e IS_A100_RUNNER \
2024-12-18T00:18:52.4045052Z   -e ARTIFACTS_FILE_SUFFIX \
2024-12-18T00:18:52.4045432Z   --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \
2024-12-18T00:18:52.4045854Z   --security-opt seccomp=unconfined \
2024-12-18T00:18:52.4046388Z   --cap-add=SYS_PTRACE \
2024-12-18T00:18:52.4046694Z   --ipc=host \
2024-12-18T00:18:52.4046979Z   --shm-size="${SHM_SIZE}" \
2024-12-18T00:18:52.4047522Z   --tty \
2024-12-18T00:18:52.4047778Z   --detach \
2024-12-18T00:18:52.4048059Z   --name="${container_name}" \
2024-12-18T00:18:52.4048373Z   --user jenkins \
2024-12-18T00:18:52.4048741Z   -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \
2024-12-18T00:18:52.4049158Z   -w /var/lib/jenkins/workspace \
2024-12-18T00:18:52.4049492Z   "${DOCKER_IMAGE}"
2024-12-18T00:18:52.4049769Z )
2024-12-18T00:18:52.4050075Z # Propagate download.pytorch.org IP to container
2024-12-18T00:18:52.4050747Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts"
2024-12-18T00:18:52.4051481Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}"
2024-12-18T00:18:52.4052198Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}"
2024-12-18T00:18:52.4058153Z shell: /usr/bin/bash -e {0}
2024-12-18T00:18:52.4058450Z env:
2024-12-18T00:18:52.4058682Z   GIT_DEFAULT_BRANCH: main
2024-12-18T00:18:52.4058989Z   BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11
2024-12-18T00:18:52.4059327Z   PR_NUMBER: 
2024-12-18T00:18:52.4059585Z   GITHUB_REPOSITORY: pytorch/pytorch
2024-12-18T00:18:52.4059915Z   GITHUB_WORKFLOW: pull
2024-12-18T00:18:52.4060183Z   GITHUB_JOB: test
2024-12-18T00:18:52.4060427Z   GITHUB_RUN_ID: 12383255652
2024-12-18T00:18:52.4060716Z   GITHUB_RUN_NUMBER: 276594
2024-12-18T00:18:52.4060998Z   GITHUB_RUN_ATTEMPT: 1
2024-12-18T00:18:52.4061261Z   JOB_ID: 34566861385
2024-12-18T00:18:52.4061665Z   JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:18:52.4062113Z   BRANCH: release/2.6
2024-12-18T00:18:52.4062411Z   SHA1: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:18:52.4062812Z   BASE_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:18:52.4063184Z   TEST_CONFIG: distributed
2024-12-18T00:18:52.4063464Z   SHARD_NUMBER: 2
2024-12-18T00:18:52.4063693Z   NUM_TEST_SHARDS: 2
2024-12-18T00:18:52.4063948Z   REENABLED_ISSUES: 
2024-12-18T00:18:52.4064217Z   CONTINUE_THROUGH_ERROR: False
2024-12-18T00:18:52.4064512Z   VERBOSE_TEST_LOGS: False
2024-12-18T00:18:52.4064790Z   TEST_SHOWLOCALS: False
2024-12-18T00:18:52.4065054Z   NO_TEST_TIMEOUT: False
2024-12-18T00:18:52.4065318Z   NO_TD: False
2024-12-18T00:18:52.4065561Z   TD_DISTRIBUTED: False
2024-12-18T00:18:52.4065890Z   SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2
2024-12-18T00:18:52.4066264Z   SCCACHE_REGION: us-east-1
2024-12-18T00:18:52.4066544Z   SCCACHE_S3_KEY_PREFIX: pull
2024-12-18T00:18:52.4066833Z   SHM_SIZE: 1g
2024-12-18T00:18:52.4067493Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:18:52.4068213Z   XLA_CUDA: 
2024-12-18T00:18:52.4068594Z   XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:18:52.4069098Z   PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0
2024-12-18T00:18:52.4069449Z   PYTORCH_TEST_RERUN_DISABLED_TESTS: 0
2024-12-18T00:18:52.4069773Z   DASHBOARD_TAG: 
2024-12-18T00:18:52.4070283Z   HUGGING_FACE_HUB_TOKEN: ***
2024-12-18T00:18:52.4070736Z   SCRIBE_GRAPHQL_ACCESS_TOKEN: ***
2024-12-18T00:18:52.4071046Z   IS_A100_RUNNER: 0
2024-12-18T00:18:52.4071450Z   ARTIFACTS_FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T00:18:52.4071922Z ##[endgroup]
2024-12-18T00:18:52.4095525Z + [[ distributed == \m\u\l\t\i\g\p\u ]]
2024-12-18T00:18:52.4095901Z + [[ linux-jammy-py3.9-gcc11 == *onnx* ]]
2024-12-18T00:18:52.4096248Z + TEST_COMMAND=.ci/pytorch/test.sh
2024-12-18T00:18:52.4103746Z +++ nproc --ignore=2
2024-12-18T00:18:52.4263549Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_REGION -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --env-file=/tmp/github_env_12383255652 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T00:19:00.1357841Z + container_name=0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T00:19:00.1359823Z + grep download.pytorch.org /etc/hosts
2024-12-18T00:19:00.1361887Z + docker exec -i 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a sudo bash -c '/bin/cat >> /etc/hosts'
2024-12-18T00:19:00.3198143Z + echo DOCKER_CONTAINER_ID=0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T00:19:00.3199889Z ++ echo dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl
2024-12-18T00:19:00.3202045Z + docker exec -t 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a sh -c 'python3 -m pip install dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh'
2024-12-18T00:19:01.1923323Z Processing ./dist/torch-2.6.0a0+git0cdf8b1-cp39-cp39-linux_x86_64.whl (from torch==2.6.0a0+git0cdf8b1)
2024-12-18T00:19:01.6546379Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.16.1)
2024-12-18T00:19:01.6549620Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (4.12.2)
2024-12-18T00:19:01.6552647Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2.8.8)
2024-12-18T00:19:01.6556288Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.1.4)
2024-12-18T00:19:01.6560030Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (2024.10.0)
2024-12-18T00:19:01.6566307Z Requirement already satisfied: sympy==1.13.1 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.13.1)
2024-12-18T00:19:01.6593487Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy==1.13.1->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.3.0)
2024-12-18T00:19:01.6608372Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.3.0)
2024-12-18T00:19:01.6631180Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (1.22.4)
2024-12-18T00:19:01.7028586Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.6.0a0+git0cdf8b1->torch==2.6.0a0+git0cdf8b1) (3.0.2)
2024-12-18T00:19:02.2874939Z Installing collected packages: torch
2024-12-18T00:19:10.4417469Z Successfully installed torch-2.6.0a0+git0cdf8b1
2024-12-18T00:19:10.5208612Z + export TERM=vt100
2024-12-18T00:19:10.5208898Z + TERM=vt100
2024-12-18T00:19:10.5211349Z ++ dirname .ci/pytorch/test.sh
2024-12-18T00:19:10.5225766Z + source .ci/pytorch/common.sh
2024-12-18T00:19:10.5231581Z +++ dirname .ci/pytorch/common.sh
2024-12-18T00:19:10.5238042Z ++ source .ci/pytorch/common_utils.sh
2024-12-18T00:19:10.5242290Z +++ declare -f -t trap_add
2024-12-18T00:19:10.5245950Z ++ set -ex
2024-12-18T00:19:10.5246292Z ++ [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-12-18T00:19:10.5246698Z ++ BUILD_TEST_LIBTORCH=0
2024-12-18T00:19:10.5247488Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]]
2024-12-18T00:19:10.5247893Z + [[ -d /var/lib/jenkins/workspace ]]
2024-12-18T00:19:10.5249743Z ++ stat -c %u /var/lib/jenkins/workspace
2024-12-18T00:19:10.5276435Z + WORKSPACE_ORIGINAL_OWNER_ID=1000
2024-12-18T00:19:10.5277043Z + trap_add cleanup_workspace EXIT
2024-12-18T00:19:10.5277411Z + trap_add_cmd=cleanup_workspace
2024-12-18T00:19:10.5277728Z + shift
2024-12-18T00:19:10.5278199Z + for trap_add_name in "$@"
2024-12-18T00:19:10.5283087Z +++ trap -p EXIT
2024-12-18T00:19:10.5285251Z ++ eval 'extract_trap_cmd '
2024-12-18T00:19:10.5285644Z +++ extract_trap_cmd
2024-12-18T00:19:10.5285915Z +++ printf '%s\n' ''
2024-12-18T00:19:10.5286220Z ++ printf '%s\n' cleanup_workspace
2024-12-18T00:19:10.5287526Z + trap -- '
2024-12-18T00:19:10.5287824Z cleanup_workspace' EXIT
2024-12-18T00:19:10.5288154Z + sudo chown -R jenkins /var/lib/jenkins/workspace
2024-12-18T00:19:10.9827926Z + git config --global --add safe.directory /var/lib/jenkins/workspace
2024-12-18T00:19:11.0036482Z + echo 'Environment variables:'
2024-12-18T00:19:11.0036835Z Environment variables:
2024-12-18T00:19:11.0037082Z + env
2024-12-18T00:19:11.0053296Z INSTALLED_DB=yes
2024-12-18T00:19:11.0053851Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:19:11.0054319Z CONTINUE_THROUGH_ERROR=False
2024-12-18T00:19:11.0054694Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11
2024-12-18T00:19:11.0055096Z HOSTNAME=0eebb67298eb
2024-12-18T00:19:11.0055693Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0056338Z GITHUB_ACTION=__self
2024-12-18T00:19:11.0056621Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-12-18T00:19:11.0056939Z GITHUB_RUN_NUMBER=276594
2024-12-18T00:19:11.0057205Z TEST_CONFIG=distributed
2024-12-18T00:19:11.0057495Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-12-18T00:19:11.0057842Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-12-18T00:19:11.0058212Z IS_A100_RUNNER=0
2024-12-18T00:19:11.0058704Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2024-12-18T00:19:11.0059018Z GITHUB_TRIGGERING_ACTOR=malfet
2024-12-18T00:19:11.0059304Z GITHUB_REF_TYPE=branch
2024-12-18T00:19:11.0059584Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-12-18T00:19:11.0059919Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0060268Z XLA_CUDA=
2024-12-18T00:19:11.0060610Z HUGGING_FACE_HUB_TOKEN=***
2024-12-18T00:19:11.0062117Z ***
2024-12-18T00:19:11.0062346Z GITHUB_REPOSITORY_ID=65600975
2024-12-18T00:19:11.0062645Z GITHUB_ACTIONS=true
2024-12-18T00:19:11.0062929Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0063354Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0063908Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6
2024-12-18T00:19:11.0064419Z UCC_HOME=/usr
2024-12-18T00:19:11.0064643Z VERBOSE_TEST_LOGS=False
2024-12-18T00:19:11.0064920Z GITHUB_REF=refs/heads/release/2.6
2024-12-18T00:19:11.0065217Z SHARD_NUMBER=2
2024-12-18T00:19:11.0065462Z GITHUB_REF_PROTECTED=true
2024-12-18T00:19:11.0065739Z HOME=/var/lib/jenkins
2024-12-18T00:19:11.0066021Z GITHUB_API_URL=https://api.github.com
2024-12-18T00:19:11.0066368Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-12-18T00:19:11.0066672Z UCX_COMMIT=
2024-12-18T00:19:11.0066906Z SCCACHE_S3_KEY_PREFIX=pull
2024-12-18T00:19:11.0067185Z NUM_TEST_SHARDS=2
2024-12-18T00:19:11.0067410Z UCX_HOME=/usr
2024-12-18T00:19:11.0068198Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0068996Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:19:11.0069764Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0070585Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-12-18T00:19:11.0071088Z GITHUB_EVENT_NAME=push
2024-12-18T00:19:11.0071353Z DASHBOARD_TAG=
2024-12-18T00:19:11.0071594Z GITHUB_RUN_ID=12383255652
2024-12-18T00:19:11.0072235Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0072914Z GITHUB_ACTOR=malfet
2024-12-18T00:19:11.0073145Z PR_NUMBER=
2024-12-18T00:19:11.0073367Z DESIRED_CUDA=
2024-12-18T00:19:11.0073632Z GITHUB_RUN_ATTEMPT=1
2024-12-18T00:19:11.0074021Z ANACONDA_PYTHON_VERSION=3.9
2024-12-18T00:19:11.0074375Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-12-18T00:19:11.0074726Z TERM=vt100
2024-12-18T00:19:11.0074957Z INSTALLED_VISION=yes
2024-12-18T00:19:11.0075218Z BRANCH=release/2.6
2024-12-18T00:19:11.0075478Z SCCACHE_REGION=us-east-1
2024-12-18T00:19:11.0075765Z OPENSSL_ROOT_DIR=/opt/openssl
2024-12-18T00:19:11.0076050Z CUDA_PATH=/usr/local/cuda
2024-12-18T00:19:11.0076581Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-12-18T00:19:11.0077170Z GITHUB_SERVER_URL=https://github.com
2024-12-18T00:19:11.0077482Z UCC_COMMIT=
2024-12-18T00:19:11.0077708Z REENABLED_ISSUES=
2024-12-18T00:19:11.0077934Z DOCS=yes
2024-12-18T00:19:11.0078146Z SHLVL=1
2024-12-18T00:19:11.0078355Z MAX_JOBS=6
2024-12-18T00:19:11.0078584Z GITHUB_ACTOR_ID=2453524
2024-12-18T00:19:11.0078939Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0079334Z GITHUB_REF_NAME=release/2.6
2024-12-18T00:19:11.0079759Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:19:11.0080204Z GITHUB_JOB=test
2024-12-18T00:19:11.0080445Z NO_TEST_TIMEOUT=False
2024-12-18T00:19:11.0080706Z TD_DISTRIBUTED=False
2024-12-18T00:19:11.0080969Z GITHUB_REPOSITORY=pytorch/pytorch
2024-12-18T00:19:11.0081277Z GITHUB_RETENTION_DAYS=90
2024-12-18T00:19:11.0081554Z OPENSSL_DIR=/opt/openssl
2024-12-18T00:19:11.0081831Z GITHUB_ACTION_REPOSITORY=
2024-12-18T00:19:11.0082603Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:19:11.0083408Z GITHUB_BASE_REF=
2024-12-18T00:19:11.0083654Z INSTALLED_ACL=
2024-12-18T00:19:11.0084117Z ARTIFACTS_FILE_SUFFIX=test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T00:19:11.0084555Z CI=true
2024-12-18T00:19:11.0084790Z GITHUB_REPOSITORY_OWNER=pytorch
2024-12-18T00:19:11.0085069Z JOB_ID=34566861385
2024-12-18T00:19:11.0085324Z INSTALLED_PROTOBUF=yes
2024-12-18T00:19:11.0085591Z GITHUB_HEAD_REF=
2024-12-18T00:19:11.0085833Z GITHUB_ACTION_REF=
2024-12-18T00:19:11.0086125Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-12-18T00:19:11.0086490Z TEST_SHOWLOCALS=False
2024-12-18T00:19:11.0086754Z GITHUB_WORKFLOW=pull
2024-12-18T00:19:11.0087022Z DEBIAN_FRONTEND=noninteractive
2024-12-18T00:19:11.0087660Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0088306Z NO_TD=False
2024-12-18T00:19:11.0088535Z SKIP_SCCACHE_INITIALIZATION=1
2024-12-18T00:19:11.0088824Z _=/usr/bin/env
2024-12-18T00:19:11.0089168Z ++ python -c 'import site; print(site.getsitepackages()[0])'
2024-12-18T00:19:11.0305254Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch
2024-12-18T00:19:11.0306474Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin
2024-12-18T00:19:11.0307343Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib
2024-12-18T00:19:11.0307962Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test
2024-12-18T00:19:11.0308423Z + BUILD_DIR=build
2024-12-18T00:19:11.0308687Z + BUILD_RENAMED_DIR=build_renamed
2024-12-18T00:19:11.0308999Z + BUILD_BIN_DIR=build/bin
2024-12-18T00:19:11.0309262Z + SHARD_NUMBER=2
2024-12-18T00:19:11.0309509Z + NUM_TEST_SHARDS=2
2024-12-18T00:19:11.0309811Z + export VALGRIND=ON
2024-12-18T00:19:11.0310118Z + VALGRIND=ON
2024-12-18T00:19:11.0310534Z + [[ linux-jammy-py3.9-gcc11 == *clang9* ]]
2024-12-18T00:19:11.0311156Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]]
2024-12-18T00:19:11.0311475Z + [[ 0 == \1 ]]
2024-12-18T00:19:11.0311714Z + [[ False == \1 ]]
2024-12-18T00:19:11.0311982Z + [[ linux-jammy-py3.9-gcc11 != *bazel* ]]
2024-12-18T00:19:11.0312329Z ++ realpath build/custom_test_artifacts
2024-12-18T00:19:11.0337009Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts
2024-12-18T00:19:11.0337640Z + [[ -n '' ]]
2024-12-18T00:19:11.0338068Z + echo 'Environment variables'
2024-12-18T00:19:11.0338584Z Environment variables
2024-12-18T00:19:11.0338846Z + env
2024-12-18T00:19:11.0344184Z INSTALLED_DB=yes
2024-12-18T00:19:11.0344883Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T00:19:11.0345627Z CONTINUE_THROUGH_ERROR=False
2024-12-18T00:19:11.0346180Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11
2024-12-18T00:19:11.0346744Z HOSTNAME=0eebb67298eb
2024-12-18T00:19:11.0347353Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0347983Z GITHUB_ACTION=__self
2024-12-18T00:19:11.0348268Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2024-12-18T00:19:11.0348655Z GITHUB_RUN_NUMBER=276594
2024-12-18T00:19:11.0348933Z TEST_CONFIG=distributed
2024-12-18T00:19:11.0349220Z GITHUB_REPOSITORY_OWNER_ID=21003710
2024-12-18T00:19:11.0349554Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2024-12-18T00:19:11.0349895Z IS_A100_RUNNER=0
2024-12-18T00:19:11.0350411Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2024-12-18T00:19:11.0350722Z GITHUB_TRIGGERING_ACTOR=malfet
2024-12-18T00:19:11.0351022Z GITHUB_REF_TYPE=branch
2024-12-18T00:19:11.0351282Z TORCH_CUDA_ARCH_LIST=Maxwell
2024-12-18T00:19:11.0351614Z BASE_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0351962Z XLA_CUDA=
2024-12-18T00:19:11.0352354Z HUGGING_FACE_HUB_TOKEN=***
2024-12-18T00:19:11.0352923Z ***
2024-12-18T00:19:11.0353162Z GITHUB_REPOSITORY_ID=65600975
2024-12-18T00:19:11.0353460Z GITHUB_ACTIONS=true
2024-12-18T00:19:11.0353753Z SHA1=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0354138Z GITHUB_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0354694Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/release/2.6
2024-12-18T00:19:11.0355201Z UCC_HOME=/usr
2024-12-18T00:19:11.0355449Z VERBOSE_TEST_LOGS=False
2024-12-18T00:19:11.0355901Z GITHUB_REF=refs/heads/release/2.6
2024-12-18T00:19:11.0356209Z SHARD_NUMBER=2
2024-12-18T00:19:11.0356468Z GITHUB_REF_PROTECTED=true
2024-12-18T00:19:11.0356744Z HOME=/var/lib/jenkins
2024-12-18T00:19:11.0357036Z GITHUB_API_URL=https://api.github.com
2024-12-18T00:19:11.0357370Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2024-12-18T00:19:11.0357674Z UCX_COMMIT=
2024-12-18T00:19:11.0357908Z SCCACHE_S3_KEY_PREFIX=pull
2024-12-18T00:19:11.0358186Z NUM_TEST_SHARDS=2
2024-12-18T00:19:11.0358431Z UCX_HOME=/usr
2024-12-18T00:19:11.0359001Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0359796Z JOB_NAME=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T00:19:11.0360574Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0361393Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2024-12-18T00:19:11.0361903Z GITHUB_EVENT_NAME=push
2024-12-18T00:19:11.0362379Z DASHBOARD_TAG=
2024-12-18T00:19:11.0362620Z GITHUB_RUN_ID=12383255652
2024-12-18T00:19:11.0363275Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0364059Z GITHUB_ACTOR=malfet
2024-12-18T00:19:11.0364308Z PR_NUMBER=
2024-12-18T00:19:11.0364534Z DESIRED_CUDA=
2024-12-18T00:19:11.0364760Z GITHUB_RUN_ATTEMPT=1
2024-12-18T00:19:11.0365016Z VALGRIND=ON
2024-12-18T00:19:11.0365254Z ANACONDA_PYTHON_VERSION=3.9
2024-12-18T00:19:11.0365604Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2024-12-18T00:19:11.0365968Z TERM=vt100
2024-12-18T00:19:11.0366186Z INSTALLED_VISION=yes
2024-12-18T00:19:11.0366451Z BRANCH=release/2.6
2024-12-18T00:19:11.0366713Z SCCACHE_REGION=us-east-1
2024-12-18T00:19:11.0367002Z OPENSSL_ROOT_DIR=/opt/openssl
2024-12-18T00:19:11.0367287Z CUDA_PATH=/usr/local/cuda
2024-12-18T00:19:11.0367828Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2024-12-18T00:19:11.0368538Z GITHUB_SERVER_URL=https://github.com
2024-12-18T00:19:11.0368852Z UCC_COMMIT=
2024-12-18T00:19:11.0369079Z REENABLED_ISSUES=
2024-12-18T00:19:11.0369306Z DOCS=yes
2024-12-18T00:19:11.0369525Z SHLVL=1
2024-12-18T00:19:11.0369740Z MAX_JOBS=6
2024-12-18T00:19:11.0369969Z GITHUB_ACTOR_ID=2453524
2024-12-18T00:19:11.0370327Z GITHUB_WORKFLOW_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T00:19:11.0370722Z GITHUB_REF_NAME=release/2.6
2024-12-18T00:19:11.0371150Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2024-12-18T00:19:11.0371593Z GITHUB_JOB=test
2024-12-18T00:19:11.0371841Z NO_TEST_TIMEOUT=False
2024-12-18T00:19:11.0372112Z TD_DISTRIBUTED=False
2024-12-18T00:19:11.0372381Z GITHUB_REPOSITORY=pytorch/pytorch
2024-12-18T00:19:11.0372707Z GITHUB_RETENTION_DAYS=90
2024-12-18T00:19:11.0372989Z OPENSSL_DIR=/opt/openssl
2024-12-18T00:19:11.0373275Z GITHUB_ACTION_REPOSITORY=
2024-12-18T00:19:11.0374072Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:19:11.0374882Z GITHUB_BASE_REF=
2024-12-18T00:19:11.0375136Z INSTALLED_ACL=
2024-12-18T00:19:11.0375514Z ARTIFACTS_FILE_SUFFIX=test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T00:19:11.0375962Z CI=true
2024-12-18T00:19:11.0376202Z GITHUB_REPOSITORY_OWNER=pytorch
2024-12-18T00:19:11.0376484Z JOB_ID=34566861385
2024-12-18T00:19:11.0376739Z INSTALLED_PROTOBUF=yes
2024-12-18T00:19:11.0377011Z GITHUB_HEAD_REF=
2024-12-18T00:19:11.0377264Z GITHUB_ACTION_REF=
2024-12-18T00:19:11.0377575Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2024-12-18T00:19:11.0377931Z TEST_SHOWLOCALS=False
2024-12-18T00:19:11.0378191Z GITHUB_WORKFLOW=pull
2024-12-18T00:19:11.0378459Z DEBIAN_FRONTEND=noninteractive
2024-12-18T00:19:11.0379094Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_284004ed-fa01-4427-b5fc-dfe041d4f8b1
2024-12-18T00:19:11.0379751Z NO_TD=False
2024-12-18T00:19:11.0379981Z SKIP_SCCACHE_INITIALIZATION=1
2024-12-18T00:19:11.0380267Z _=/usr/bin/env
2024-12-18T00:19:11.0380507Z + echo 'Testing pytorch'
2024-12-18T00:19:11.0380782Z Testing pytorch
2024-12-18T00:19:11.0381050Z + export LANG=C.UTF-8
2024-12-18T00:19:11.0397962Z + LANG=C.UTF-8
2024-12-18T00:19:11.0398443Z + PR_NUMBER=
2024-12-18T00:19:11.0398900Z + [[ distributed == \d\e\f\a\u\l\t ]]
2024-12-18T00:19:11.0399410Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]]
2024-12-18T00:19:11.0399776Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-12-18T00:19:11.0400115Z + [[ distributed == \s\l\o\w ]]
2024-12-18T00:19:11.0400454Z + [[ linux-jammy-py3.9-gcc11 == *slow-gradcheck* ]]
2024-12-18T00:19:11.0400840Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]]
2024-12-18T00:19:11.0401171Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-12-18T00:19:11.0401515Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]]
2024-12-18T00:19:11.0401853Z + [[ distributed == *crossref* ]]
2024-12-18T00:19:11.0402330Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-12-18T00:19:11.0402690Z + [[ linux-jammy-py3.9-gcc11 == *xpu* ]]
2024-12-18T00:19:11.0403052Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]]
2024-12-18T00:19:11.0403391Z + pip_install --user ninja==1.10.2
2024-12-18T00:19:11.0403798Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2024-12-18T00:19:11.0404391Z + python3 -m pip install --progress-bar off --user ninja==1.10.2
2024-12-18T00:19:11.4690260Z Collecting ninja==1.10.2
2024-12-18T00:19:11.4805079Z   Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB)
2024-12-18T00:19:11.4922846Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB)
2024-12-18T00:19:11.9529065Z Installing collected packages: ninja
2024-12-18T00:19:11.9621641Z   WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH.
2024-12-18T00:19:11.9623354Z   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
2024-12-18T00:19:12.0072837Z Successfully installed ninja-1.10.2
2024-12-18T00:19:12.1059421Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:19:12.1061045Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:19:12.1062006Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]]
2024-12-18T00:19:12.1062348Z + install_tlparse
2024-12-18T00:19:12.1062626Z + pip_install --user tlparse==0.3.25
2024-12-18T00:19:12.1063046Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2024-12-18T00:19:12.1063558Z + python3 -m pip install --progress-bar off --user tlparse==0.3.25
2024-12-18T00:19:12.5689708Z Collecting tlparse==0.3.25
2024-12-18T00:19:12.5822572Z   Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB)
2024-12-18T00:19:12.6424131Z Downloading tlparse-0.3.25-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB)
2024-12-18T00:19:13.1941337Z Installing collected packages: tlparse
2024-12-18T00:19:13.2686413Z Successfully installed tlparse-0.3.25
2024-12-18T00:19:13.3510833Z ++ python -m site --user-base
2024-12-18T00:19:13.3795699Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-12-18T00:19:13.3796969Z + [[ linux-jammy-py3.9-gcc11 == *asan* ]]
2024-12-18T00:19:13.3797336Z + [[ linux-jammy-py3.9-gcc11 == *-debug* ]]
2024-12-18T00:19:13.3797686Z + [[ linux-jammy-py3.9-gcc11 != *-bazel-* ]]
2024-12-18T00:19:13.3798281Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass'
2024-12-18T00:19:13.3799123Z We are not in debug mode: linux-jammy-py3.9-gcc11. Expect the assertion to pass
2024-12-18T00:19:13.3799628Z + cd test
2024-12-18T00:19:13.3799989Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)'
2024-12-18T00:19:16.0735541Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]]
2024-12-18T00:19:16.0735989Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]]
2024-12-18T00:19:16.0739112Z + DYNAMO_BENCHMARK_FLAGS=()
2024-12-18T00:19:16.0739877Z + [[ distributed == *pr_time_benchmarks* ]]
2024-12-18T00:19:16.0740523Z + [[ distributed == *dynamo_eager* ]]
2024-12-18T00:19:16.0741112Z + [[ distributed == *aot_eager* ]]
2024-12-18T00:19:16.0741706Z + [[ distributed == *aot_inductor* ]]
2024-12-18T00:19:16.0742302Z + [[ distributed == *inductor* ]]
2024-12-18T00:19:16.0742866Z + [[ distributed == *dynamic* ]]
2024-12-18T00:19:16.0743414Z + [[ distributed == *cpu* ]]
2024-12-18T00:19:16.0743969Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda)
2024-12-18T00:19:16.0764762Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]]
2024-12-18T00:19:16.0765211Z + [[ linux-jammy-py3.9-gcc11 == *-bazel-* ]]
2024-12-18T00:19:16.0766889Z + cd test
2024-12-18T00:19:16.0767668Z + python -c 'import torch; print(torch.__config__.show())'
2024-12-18T00:19:17.3207219Z PyTorch built with:
2024-12-18T00:19:17.3207551Z   - GCC 11.4
2024-12-18T00:19:17.3207784Z   - C++ Version: 201703
2024-12-18T00:19:17.3208377Z   - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-12-18T00:19:17.3209118Z   - Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-12-18T00:19:17.3209579Z   - OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-12-18T00:19:17.3209934Z   - LAPACK is enabled (usually provided by MKL)
2024-12-18T00:19:17.3210287Z   - NNPACK is enabled
2024-12-18T00:19:17.3210562Z   - CPU capability usage: AVX512
2024-12-18T00:19:17.3215713Z   - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=0cdf8b1d09254cfda66191d1bd01e3041c3c76f7, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.6.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 
2024-12-18T00:19:17.3221462Z 
2024-12-18T00:19:17.5752598Z + cd test
2024-12-18T00:19:17.5753024Z + python -c 'import torch; print(torch.__config__.parallel_info())'
2024-12-18T00:19:18.8112657Z ATen/Parallel:
2024-12-18T00:19:18.8113140Z 	at::get_num_threads() : 4
2024-12-18T00:19:18.8113605Z 	at::get_num_interop_threads() : 4
2024-12-18T00:19:18.8114068Z OpenMP 201511 (a.k.a. OpenMP 4.5)
2024-12-18T00:19:18.8114527Z 	omp_get_max_threads() : 4
2024-12-18T00:19:18.8115399Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2024-12-18T00:19:18.8116314Z 	mkl_get_max_threads() : 4
2024-12-18T00:19:18.8116910Z Intel(R) MKL-DNN v3.5.3 (Git Hash 66f0cb9eb66affd2da3bf5f8d897376f04aae6af)
2024-12-18T00:19:18.8117589Z std::thread::hardware_concurrency() : 8
2024-12-18T00:19:18.8118121Z Environment variables:
2024-12-18T00:19:18.8118540Z 	OMP_NUM_THREADS : [not set]
2024-12-18T00:19:18.8118967Z 	MKL_NUM_THREADS : [not set]
2024-12-18T00:19:18.8119394Z ATen parallel backend: OpenMP
2024-12-18T00:19:18.8119683Z 
2024-12-18T00:19:19.0566364Z + [[ distributed == *numpy_2* ]]
2024-12-18T00:19:19.0566870Z + [[ linux-jammy-py3.9-gcc11 == *aarch64* ]]
2024-12-18T00:19:19.0567218Z + [[ distributed == *backward* ]]
2024-12-18T00:19:19.0567551Z + [[ distributed == *xla* ]]
2024-12-18T00:19:19.0567850Z + [[ distributed == *executorch* ]]
2024-12-18T00:19:19.0568183Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]]
2024-12-18T00:19:19.0568542Z + [[ linux-jammy-py3.9-gcc11 == *libtorch* ]]
2024-12-18T00:19:19.0568883Z + [[ distributed == distributed ]]
2024-12-18T00:19:19.0569191Z + test_distributed
2024-12-18T00:19:19.0569535Z + echo 'Testing distributed python tests'
2024-12-18T00:19:19.0570152Z Testing distributed python tests
2024-12-18T00:19:19.0571424Z + python test/run_test.py --distributed-tests --shard 2 2 --verbose
2024-12-18T00:19:19.1720926Z /var/lib/jenkins/workspace/test/run_test.py:22: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
2024-12-18T00:19:19.1721790Z   import pkg_resources
2024-12-18T00:19:23.9911046Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json?versionId=PhiMB7EP3187qvpKvnORewoK3InOIvX5 to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json
2024-12-18T00:19:24.0405578Z Ignoring disabled issues:  ['']
2024-12-18T00:19:24.0562591Z Found test times from artifacts
2024-12-18T00:19:24.1157261Z Found test times from artifacts
2024-12-18T00:19:24.1182091Z Running all tests
2024-12-18T00:19:24.1303602Z Running parallel tests on 3 processes
2024-12-18T00:19:24.1310983Z Name: tests to run (est. time: 64.1min)
2024-12-18T00:19:24.1311576Z   Serial tests (127):
2024-12-18T00:19:24.1312154Z     distributed/_tools/test_runtime_estimator 1/1
2024-12-18T00:19:24.1312586Z     distributed/test_inductor_collectives 1/1
2024-12-18T00:19:24.1313187Z     distributed/test_device_mesh 1/1
2024-12-18T00:19:24.1313545Z     distributed/_tensor/test_xla_integration 1/1
2024-12-18T00:19:24.1313944Z     distributed/_tensor/test_convolution_ops 1/1
2024-12-18T00:19:24.1314323Z     distributed/_tensor/test_random_ops 1/1
2024-12-18T00:19:24.1314673Z     distributed/launcher/test_run 1/1
2024-12-18T00:19:24.1315013Z     distributed/_tensor/test_pointwise_ops 1/1
2024-12-18T00:19:24.1315435Z     distributed/_composable/fsdp/test_fully_shard_init 1/1
2024-12-18T00:19:24.1315861Z     distributed/_tensor/test_embedding_ops 1/1
2024-12-18T00:19:24.1316347Z     distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1
2024-12-18T00:19:24.1316800Z     distributed/_tensor/test_view_ops 1/1
2024-12-18T00:19:24.1317231Z     distributed/_composable/fsdp/test_fully_shard_extensions 1/1
2024-12-18T00:19:24.1317657Z     distributed/fsdp/test_wrap 1/1
2024-12-18T00:19:24.1318047Z     distributed/_composable/fsdp/test_fully_shard_autograd 1/1
2024-12-18T00:19:24.1318516Z     distributed/fsdp/test_fsdp_clip_grad_norm 1/1
2024-12-18T00:19:24.1318878Z     distributed/fsdp/test_fsdp_misc 1/1
2024-12-18T00:19:24.1319213Z     distributed/test_c10d_common 1/1
2024-12-18T00:19:24.1319613Z     distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1
2024-12-18T00:19:24.1320088Z     distributed/_shard/sharded_tensor/ops/test_embedding 1/1
2024-12-18T00:19:24.1320573Z     distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1
2024-12-18T00:19:24.1321027Z     distributed/flight_recorder/test_fr_analysis 1/1
2024-12-18T00:19:24.1321432Z     distributed/_tensor/test_dtensor_compile 1/1
2024-12-18T00:19:24.1321825Z     distributed/_tensor/debug/test_op_coverage 1/1
2024-12-18T00:19:24.1322203Z     distributed/_tools/test_mod_tracker 1/1
2024-12-18T00:19:24.1322572Z     distributed/test_compute_comm_reordering 1/1
2024-12-18T00:19:24.1322983Z     distributed/pipelining/test_schedule_multiproc 1/1
2024-12-18T00:19:24.1323428Z     distributed/tensor/parallel/test_micro_pipeline_tp 1/1
2024-12-18T00:19:24.1323939Z     distributed/checkpoint/test_nested_dict 1/1
2024-12-18T00:19:24.1324327Z     distributed/pipelining/test_transformer 1/1
2024-12-18T00:19:24.1324715Z     distributed/pipelining/test_backward 1/1
2024-12-18T00:19:24.1325111Z     distributed/_shard/sharded_tensor/test_logger 1/1
2024-12-18T00:19:24.1325487Z     distributed/pipelining/test_pipe 1/1
2024-12-18T00:19:24.1325906Z     distributed/_composable/fsdp/test_fully_shard_compile 1/1
2024-12-18T00:19:24.1326343Z     distributed/_tools/test_sac_estimator 1/1
2024-12-18T00:19:24.1326700Z     distributed/_tools/test_sac_ilp 1/1
2024-12-18T00:19:24.1327054Z     distributed/test_c10d_functional_native 1/1
2024-12-18T00:19:24.1327406Z     distributed/_tensor/test_dtensor 1/1
2024-12-18T00:19:24.1327763Z     distributed/pipelining/test_unflatten 1/1
2024-12-18T00:19:24.1328146Z     distributed/checkpoint/fsdp/test_fsdp_dsd 1/1
2024-12-18T00:19:24.1328661Z     distributed/test_backends 1/1
2024-12-18T00:19:24.1329062Z     distributed/_composable/fsdp/test_fully_shard_logging 1/1
2024-12-18T00:19:24.1329466Z     distributed/test_symmetric_memory 1/1
2024-12-18T00:19:24.1329823Z     distributed/_tools/test_memory_tracker 1/1
2024-12-18T00:19:24.1330297Z     distributed/_composable/test_composability/test_pp_composability 1/1
2024-12-18T00:19:24.1330762Z     distributed/test_fake_pg 1/1
2024-12-18T00:19:24.1331121Z     distributed/checkpoint/test_fsdp_optim_state 1/1
2024-12-18T00:19:24.1331534Z     distributed/_tensor/experimental/test_local_map 1/1
2024-12-18T00:19:24.1331929Z     distributed/test_distributed_spawn 1/1
2024-12-18T00:19:24.1332297Z     distributed/checkpoint/test_format_utils 1/1
2024-12-18T00:19:24.1332710Z     distributed/_tensor/debug/test_comm_mode_features 1/1
2024-12-18T00:19:24.1333185Z     distributed/algorithms/quantization/test_quantization 1/1
2024-12-18T00:19:24.1333637Z     distributed/checkpoint/e2e/test_fine_tuning 1/1
2024-12-18T00:19:24.1334062Z     distributed/_tensor/experimental/test_tp_transform 1/1
2024-12-18T00:19:24.1334555Z     distributed/checkpoint/e2e/test_pipeline 1/1
2024-12-18T00:19:24.1334936Z     distributed/checkpoint/test_traverse 1/1
2024-12-18T00:19:24.1335338Z     distributed/tensor/parallel/test_tp_random_state 1/1
2024-12-18T00:19:24.1335774Z     distributed/checkpoint/test_dtensor_checkpoint 1/1
2024-12-18T00:19:24.1336214Z     distributed/_composable/test_replicate_with_compiler 1/1
2024-12-18T00:19:24.1336651Z     distributed/checkpoint/test_tp_checkpoint 1/1
2024-12-18T00:19:24.1337090Z     distributed/_composable/fsdp/test_fully_shard_overlap 1/1
2024-12-18T00:19:24.1337508Z     distributed/test_collective_utils 1/1
2024-12-18T00:19:24.1337864Z     distributed/checkpoint/test_planner 1/1
2024-12-18T00:19:24.1338480Z     distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1
2024-12-18T00:19:24.1339001Z     distributed/checkpoint/test_state_dict_utils 1/1
2024-12-18T00:19:24.1339389Z     distributed/fsdp/test_shard_utils 1/1
2024-12-18T00:19:24.1339775Z     distributed/checkpoint/test_compatibility 1/1
2024-12-18T00:19:24.1340183Z     distributed/checkpoint/test_hsdp_checkpoint 1/1
2024-12-18T00:19:24.1340551Z     distributed/test_functional_api 1/1
2024-12-18T00:19:24.1340954Z     distributed/_composable/fsdp/test_fully_shard_state 1/1
2024-12-18T00:19:24.1341371Z     distributed/test_control_collectives 1/1
2024-12-18T00:19:24.1341744Z     distributed/_tensor/debug/test_comm_mode 1/1
2024-12-18T00:19:24.1342127Z     distributed/_composable/test_replicate 1/1
2024-12-18T00:19:24.1342547Z     distributed/optim/test_apply_optimizer_in_backward 1/1
2024-12-18T00:19:24.1343027Z     distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1
2024-12-18T00:19:24.1343462Z     distributed/checkpoint/test_utils 1/1
2024-12-18T00:19:24.1343810Z     distributed/_tensor/test_utils 1/1
2024-12-18T00:19:24.1344160Z     distributed/pipelining/test_schedule 1/1
2024-12-18T00:19:24.1344522Z     distributed/_tensor/test_op_strategy 1/1
2024-12-18T00:19:24.1344903Z     distributed/checkpoint/test_fsdp_model_state 1/1
2024-12-18T00:19:24.1345344Z     distributed/_composable/fsdp/test_fully_shard_comm 1/1
2024-12-18T00:19:24.1345751Z     distributed/rpc/test_share_memory 1/1
2024-12-18T00:19:24.1346133Z     distributed/fsdp/test_fsdp_dtensor_state_dict 1/1
2024-12-18T00:19:24.1346532Z     distributed/checkpoint/test_checkpoint 1/1
2024-12-18T00:19:24.1346887Z     distributed/nn/jit/test_instantiator 1/1
2024-12-18T00:19:24.1347272Z     distributed/fsdp/test_fsdp_backward_prefetch 1/1
2024-12-18T00:19:24.1347661Z     distributed/fsdp/test_fsdp_pure_fp16 1/1
2024-12-18T00:19:24.1348028Z     distributed/test_c10d_object_collectives 1/1
2024-12-18T00:19:24.1348394Z     distributed/fsdp/test_fsdp_memory 1/1
2024-12-18T00:19:24.1348788Z     distributed/_composable/fsdp/test_fully_shard_frozen 1/1
2024-12-18T00:19:24.1349256Z     distributed/checkpoint/test_file_system_checkpoint 1/1
2024-12-18T00:19:24.1349653Z     distributed/test_c10d_pypg 1/1
2024-12-18T00:19:24.1350176Z     distributed/tensor/parallel/test_parallelize_api 1/1
2024-12-18T00:19:24.1350587Z     distributed/fsdp/test_fsdp_apply 1/1
2024-12-18T00:19:24.1350944Z     distributed/fsdp/test_fsdp_flatten_params 1/1
2024-12-18T00:19:24.1351320Z     distributed/fsdp/test_fsdp_traversal 1/1
2024-12-18T00:19:24.1351690Z     distributed/checkpoint/test_state_dict 1/1
2024-12-18T00:19:24.1352193Z     distributed/optim/test_zero_redundancy_optimizer 1/1
2024-12-18T00:19:24.1352578Z     distributed/test_c10d_ucc 1/1
2024-12-18T00:19:24.1352936Z     distributed/fsdp/test_fsdp_multiple_wrapping 1/1
2024-12-18T00:19:24.1353409Z     distributed/_composable/fsdp/test_fully_shard_mixed_precision 1/1
2024-12-18T00:19:24.1353973Z     distributed/_composable/test_composability/test_2d_composability 1/1
2024-12-18T00:19:24.1354518Z     distributed/_composable/fsdp/test_fully_shard_state_dict 1/1
2024-12-18T00:19:24.1354942Z     distributed/test_pg_wrapper 1/1
2024-12-18T00:19:24.1355291Z     distributed/fsdp/test_fsdp_comm_hooks 1/1
2024-12-18T00:19:24.1355738Z     distributed/test_data_parallel 1/1
2024-12-18T00:19:24.1356081Z     distributed/fsdp/test_fsdp_core 1/1
2024-12-18T00:19:24.1356436Z     distributed/rpc/test_tensorpipe_agent 1/4
2024-12-18T00:19:24.1356812Z     distributed/rpc/test_tensorpipe_agent 3/4
2024-12-18T00:19:24.1357232Z     distributed/_shard/sharding_plan/test_sharding_plan 1/1
2024-12-18T00:19:24.1357661Z     distributed/fsdp/test_fsdp_multiple_forward 1/1
2024-12-18T00:19:24.1358084Z     distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1
2024-12-18T00:19:24.1358467Z     distributed/fsdp/test_fsdp_meta 1/1
2024-12-18T00:19:24.1358827Z     distributed/fsdp/test_fsdp_unshard_params 1/1
2024-12-18T00:19:24.1359227Z     distributed/fsdp/test_fsdp_mixed_precision 1/1
2024-12-18T00:19:24.1359591Z     distributed/test_c10d_spawn_gloo 1/1
2024-12-18T00:19:24.1359929Z     distributed/test_c10d_spawn_ucc 1/1
2024-12-18T00:19:24.1360267Z     distributed/test_c10d_spawn_nccl 1/1
2024-12-18T00:19:24.1360602Z     distributed/test_store 1/1
2024-12-18T00:19:24.1360925Z     distributed/elastic/events/lib_test 1/1
2024-12-18T00:19:24.1361272Z     distributed/elastic/metrics/api_test 1/1
2024-12-18T00:19:24.1361669Z     distributed/elastic/multiprocessing/api_test 1/1
2024-12-18T00:19:24.1362094Z     distributed/elastic/timer/local_timer_example 1/1
2024-12-18T00:19:24.1362505Z     distributed/elastic/timer/local_timer_test 1/1
2024-12-18T00:19:24.1362906Z     distributed/elastic/utils/distributed_test 1/1
2024-12-18T00:19:24.1363294Z     distributed/elastic/utils/logging_test 1/1
2024-12-18T00:19:24.1363647Z     distributed/elastic/utils/util_test 1/1
2024-12-18T00:19:24.1364052Z   Parallel tests (0):
2024-12-18T00:19:24.1364335Z Name: excluded (est. time: 0.0min)
2024-12-18T00:19:24.1364642Z   Serial tests (0):
2024-12-18T00:19:24.1364881Z   Parallel tests (0):
2024-12-18T00:19:24.1569959Z Running distributed/_tools/test_runtime_estimator 1/1 ... [2024-12-18 00:19:24.156470]
2024-12-18T00:19:24.1571015Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:24.1578452Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_runtime_estimator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:24.157389]
2024-12-18T00:19:29.1401182Z 
2024-12-18T00:19:29.1402495Z distributed/_tools/test_runtime_estimator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_runtime_estimator_1.1_bf259fe0cfb0bf70_.log
2024-12-18T00:19:29.1404311Z Running 2 items in this shard: test/distributed/_tools/test_runtime_estimator.py::TestRuntimeEstimator::test_conv_model_runtime, test/distributed/_tools/test_runtime_estimator.py::TestRuntimeEstimator::test_transformer_runtime
2024-12-18T00:19:29.1405439Z 
2024-12-18T00:19:29.1410480Z Running distributed/test_inductor_collectives 1/1 ... [2024-12-18 00:19:29.140882]
2024-12-18T00:19:29.1411237Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:29.1416246Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_inductor_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:29.141403]
2024-12-18T00:19:33.8709071Z 
2024-12-18T00:19:33.8710407Z distributed/test_inductor_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_inductor_collectives_1.1_ce210139d607fda1_.log
2024-12-18T00:19:33.8735580Z Running 48 items in this shard: test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_all_to_all_single_inductor, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_all_to_all_single_inductor_split_sizes_none, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allgather_contiguous_input, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allgather_into_tensor_inductor, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allgather_output_buffer_reuse, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allreduce_inductor, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allreduce_inductor_cudagraph_trees, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_allreduce_input_buffer_reuse, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_broadcast_inductor, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_c10d_functional_tagged_pt2_compliant, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_eager_allreduce_inductor_wait, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_eager_async_allreduce_inductor_wait, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_inductor_allreduce_eager_wait, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_permute_tensor, test/distributed/test_inductor_collectives.py::TestCollectivesMultiProc::test_reduce_scatter_tensor_inductor, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_backwards, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_get_world_group_source_GroupMember_WORLD, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_get_world_group_source__get_default_group, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_get_world_group_source_group_WORLD, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_graphbreaks_unsupported_async_op, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_pg_var, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_all_gather, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_all_gather_args_match, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_all_gather_list, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_all_to_all_single, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_pg_mode_kwargs, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_pg_mode_kwargs_none, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_pg_mode_positional, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_pg_mode_positional_none, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_pg_mode_unspecified, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_reduce_op_reduce_op0, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_reduce_op_reduce_op1, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_reduce_op_reduce_op2, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_reduce_op_reduce_op3, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_allreduce_reduce_op_reduce_op4, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_rewrite_dist_reduce_scatter, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_support_collective_op_with_async_op_False, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_trace_all_gather_tensor, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_trace_all_gather_tensor_pg, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_trace_allgather_coalesced, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_trace_allreduce, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_dynamo_trace_reduce_scatter_tensor, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_inductor_all_gather_coalesced, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_inductor_doesnt_mutate_shared, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_inductor_reduce_scatter_coalesced, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_inductor_single_op, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_inductor_steal_buffer, test/distributed/test_inductor_collectives.py::TestCollectivesInductor::test_meta
2024-12-18T00:19:33.8758759Z 
2024-12-18T00:19:33.8759021Z Running distributed/test_device_mesh 1/1 ... [2024-12-18 00:19:33.871459]
2024-12-18T00:19:33.8759492Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:19:33.8760564Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_device_mesh.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:19:33.871950]
2024-12-18T00:23:54.6645734Z 
2024-12-18T00:23:54.6646910Z distributed/test_device_mesh 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_device_mesh_1.1_7cd54b210994b60a_.log
2024-12-18T00:23:54.6664721Z Running 47 items in this shard: test/distributed/test_device_mesh.py::DeviceMeshTestGlooBackend::test_device_mesh_reuse_default_group, test/distributed/test_device_mesh.py::DeviceMeshTest::test_2d_mesh_eager_init_subgroup, test/distributed/test_device_mesh.py::DeviceMeshTest::test_2d_mesh_non_eager_init_subgroup, test/distributed/test_device_mesh.py::DeviceMeshTest::test_assert_invalid_mesh_tensor, test/distributed/test_device_mesh.py::DeviceMeshTest::test_device_mesh_2d, test/distributed/test_device_mesh.py::DeviceMeshTest::test_device_mesh_init_backend, test/distributed/test_device_mesh.py::DeviceMeshTest::test_fake_pg_device_mesh, test/distributed/test_device_mesh.py::DeviceMeshTest::test_from_group_with_global_pg, test/distributed/test_device_mesh.py::DeviceMeshTest::test_from_group_with_invalid_mesh, test/distributed/test_device_mesh.py::DeviceMeshTest::test_get_group_and_get_all_groups, test/distributed/test_device_mesh.py::DeviceMeshTest::test_get_local_rank, test/distributed/test_device_mesh.py::DeviceMeshTest::test_get_local_rank_raises_exception, test/distributed/test_device_mesh.py::DeviceMeshTest::test_init_process_group, test/distributed/test_device_mesh.py::DeviceMeshTest::test_raises_invalid_device_type, test/distributed/test_device_mesh.py::DeviceMeshTest::test_set_mesh_dim_group_options, test/distributed/test_device_mesh.py::DeviceMeshTestNDim::test_device_mesh_hash, test/distributed/test_device_mesh.py::DeviceMeshTestNDim::test_device_mesh_nd, test/distributed/test_device_mesh.py::DeviceMeshTestNDim::test_device_mesh_parent_child_hash, test/distributed/test_device_mesh.py::DeviceMeshTestNDim::test_from_group_with_mesh_shape, test/distributed/test_device_mesh.py::DeviceMeshTestNDim::test_get_local_rank_3d, test/distributed/test_device_mesh.py::InitDeviceMeshTest::test_init_device_mesh, test/distributed/test_device_mesh.py::InitDeviceMeshTest::test_raises_duplicate_mesh_dim_names, test/distributed/test_device_mesh.py::InitDeviceMeshTest::test_raises_mesh_shape_mesh_dim_names_mismatch, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_cache_and_reuse_submesh_slice_result, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_flatten_mesh_3d, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_flatten_mesh_4d, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_get_item_1d, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_get_item_2d, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_get_item_3d, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_get_item_3d_noncontiguous_slicing, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_raises_invalid_mesh_dim_name, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_raises_no_mesh_dim_found, test/distributed/test_device_mesh.py::TestDeviceMeshGetItem::test_reconstruct_mesh_with_flatten_dim, test/distributed/test_device_mesh.py::TestMeshEnv::test_get_all_submeshes, test/distributed/test_device_mesh.py::TestMeshEnv::test_get_mesh_dim_by_name, test/distributed/test_device_mesh.py::TestMeshEnv::test_get_root_mesh, test/distributed/test_device_mesh.py::TestMeshEnv::test_get_root_mesh_dim_exist, test/distributed/test_device_mesh.py::TestMeshEnv::test_get_root_mesh_dim_not_exist, test/distributed/test_device_mesh.py::TestMeshEnv::test_mesh_slice_fake_tensor_mode, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_all_gather_uneven, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_broadcast_1d, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_broadcast_nd, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_reduce_scatter_contiguous, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_reduce_scatter_uneven, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_scatter_1d, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_scatter_nd, test/distributed/test_device_mesh.py::DeviceMeshCollectiveTest::test_scatter_uneven
2024-12-18T00:23:54.6681374Z 
2024-12-18T00:23:54.6681651Z Running distributed/_tensor/test_xla_integration 1/1 ... [2024-12-18 00:23:54.664548]
2024-12-18T00:23:54.6682162Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:54.6683302Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_xla_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:54.665015]
2024-12-18T00:23:58.9428906Z 
2024-12-18T00:23:58.9430029Z distributed/_tensor/test_xla_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_xla_integration_1.1_9c1815b3dcfb344e_.log
2024-12-18T00:23:58.9432366Z Running 3 items in this shard: test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_1d_replicate, test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_1d_shard, test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_2d
2024-12-18T00:23:58.9433962Z 
2024-12-18T00:23:58.9436328Z Running distributed/_tensor/test_convolution_ops 1/1 ... [2024-12-18 00:23:58.943384]
2024-12-18T00:23:58.9437144Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:23:58.9441126Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_convolution_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:23:58.943870]
2024-12-18T00:24:27.4229076Z 
2024-12-18T00:24:27.4230271Z distributed/_tensor/test_convolution_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_convolution_ops_1.1_3f07d144d106cfd3_.log
2024-12-18T00:24:27.4232200Z Running 2 items in this shard: test/distributed/_tensor/test_convolution_ops.py::DistConvolutionOpsTest::test_depthwise_convolution, test/distributed/_tensor/test_convolution_ops.py::DistConvolutionOpsTest::test_downsampling_convolution
2024-12-18T00:24:27.4233435Z 
2024-12-18T00:24:27.4233728Z Running distributed/_tensor/test_random_ops 1/1 ... [2024-12-18 00:24:27.423176]
2024-12-18T00:24:27.4234531Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:24:27.4239841Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_random_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:24:27.423663]
2024-12-18T00:25:17.6501991Z 
2024-12-18T00:25:17.6503215Z distributed/_tensor/test_random_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_random_ops_1.1_553c7e1e6ed25324_.log
2024-12-18T00:25:17.6509463Z Running 11 items in this shard: test/distributed/_tensor/test_random_ops.py::DistTensorRandomInitTest::test_init_ops, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_dropout_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_rand_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_uniform_2d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_fsdp_tp_model_meta_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_manual_seed, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_manual_seed_submesh, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_meta_tensor_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_pipeline_parallel_manual_seed, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_rng_tracker_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_tp_model_meta_init
2024-12-18T00:25:17.6515238Z 
2024-12-18T00:25:17.6515486Z Running distributed/launcher/test_run 1/1 ... [2024-12-18 00:25:17.650754]
2024-12-18T00:25:17.6515964Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:25:17.6517060Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/launcher/test_run.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:25:17.651221]
2024-12-18T00:26:02.1955996Z 
2024-12-18T00:26:02.1957569Z distributed/launcher/test_run 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.launcher.test_run_1.1_296a745534142545_.log
2024-12-18T00:26:02.1969495Z Running 24 items in this shard: test/distributed/launcher/test_run.py::ElasticLaunchTest::test_capture_logs_using_default_logs_specs, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_init_method_env_with_torchelastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_init_method_tcp_with_torchelastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_not_torchelastic_launched, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_torchelastic_launched, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_is_torchelastic_launched_with_logs_spec_defined, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_agent_raise_exception, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_multiple_agents, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_elastic_worker_raise_exception, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_run_path, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_shutdown, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_standalone, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_bash, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_default_nproc, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_python, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_user_script_python_caffe2_bc, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_launch_with_env_vars, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_logs_logs_spec_entrypoint_must_be_defined, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_min_max_nodes_parse, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_gpu_launch_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_auto_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_number_configurations, test/distributed/launcher/test_run.py::ElasticLaunchTest::test_nproc_launch_unknown_configurations
2024-12-18T00:26:02.1980048Z 
2024-12-18T00:26:02.1980339Z Running distributed/_tensor/test_pointwise_ops 1/1 ... [2024-12-18 00:26:02.196580]
2024-12-18T00:26:02.1980845Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:02.1981965Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_pointwise_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:02.197059]
2024-12-18T00:26:06.6253490Z 
2024-12-18T00:26:06.6254546Z distributed/_tensor/test_pointwise_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_pointwise_ops_1.1_2427dfcdaac19593_.log
2024-12-18T00:26:06.6258074Z Running 7 items in this shard: test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_activations, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_backward, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_errors, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_mul_out, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_add, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_mul
2024-12-18T00:26:06.6260981Z 
2024-12-18T00:26:06.6261316Z Running distributed/_composable/fsdp/test_fully_shard_init 1/1 ... [2024-12-18 00:26:06.625703]
2024-12-18T00:26:06.6261857Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:06.6264934Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:06.626188]
2024-12-18T00:26:10.9044711Z 
2024-12-18T00:26:10.9045916Z distributed/_composable/fsdp/test_fully_shard_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_init_1.1_193a193dd30034d4_.log
2024-12-18T00:26:10.9067991Z Running 38 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceTensor::test_move_states_to_device_tensor, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_invalid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_valid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMeshArg::test_2d_mesh_without_mesh_dim_names, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMeshArg::test_invalid_mesh_ndim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_duplicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested_fully_shard_and_replicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_single, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_nested_fully_shard, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_shared_params_and_buffers, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_duplicates, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_list_of_mlps, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_shared_params, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_raise_noncontiguous_parameter, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_raise_scalar_parameter, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_shard_tensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterDTensor::test_shard_dtensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_double_lazy_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_is_root, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_module_and_param_fqns, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_multi_module_root, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_reset_sharded_param_in_lazy_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_invalid_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_1d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_2d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_rank0_broadcast_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_1d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_2d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardHSDPBroadcast::test_hsdp_broadcast_across_replicas, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_transformer_shard_dim_neg1, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_transformer_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_1d_uneven_shard_largest_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_init_2d_transformer_shard_diff_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardPlacementFn::test_invalid_shard_dim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardOldImport::test_old_import_training
2024-12-18T00:26:10.9088500Z 
2024-12-18T00:26:10.9088777Z Running distributed/_tensor/test_embedding_ops 1/1 ... [2024-12-18 00:26:10.904999]
2024-12-18T00:26:10.9089279Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:10.9090397Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_embedding_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:10.905480]
2024-12-18T00:26:32.3709445Z 
2024-12-18T00:26:32.3710782Z distributed/_tensor/test_embedding_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_embedding_ops_1.1_3ba627a25eabb2d4_.log
2024-12-18T00:26:32.3713543Z Running 4 items in this shard: test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_multiple_embeddings_rowwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise_max_norm_errors, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_rowwise
2024-12-18T00:26:32.3715896Z 
2024-12-18T00:26:32.3716336Z Running distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1 ... [2024-12-18 00:26:32.371330]
2024-12-18T00:26:32.3717005Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:32.3720353Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:32.371804]
2024-12-18T00:26:36.6530244Z 
2024-12-18T00:26:36.6531478Z distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_clip_grad_norm__1.1_2a49b38c682eb0f4_.log
2024-12-18T00:26:36.6533609Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py::TestClipGradNormWorldSize2::test_clip_grad_norm_1d, test/distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py::TestClipGradNormWorldSize4::test_clip_grad_norm_2d
2024-12-18T00:26:36.6534781Z 
2024-12-18T00:26:36.6537097Z Running distributed/_tensor/test_view_ops 1/1 ... [2024-12-18 00:26:36.653501]
2024-12-18T00:26:36.6537612Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:26:36.6542129Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_view_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:26:36.653980]
2024-12-18T00:27:20.2753656Z 
2024-12-18T00:27:20.2754993Z distributed/_tensor/test_view_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_view_ops_1.1_d576bcad2a82deee_.log
2024-12-18T00:27:20.2757350Z Running 4 items in this shard: test/distributed/_tensor/test_view_ops.py::TestViewOps::test_complex_view_ops, test/distributed/_tensor/test_view_ops.py::TestViewOps::test_dtensor_view_op_uneven, test/distributed/_tensor/test_view_ops.py::TestViewOps::test_view_groups, test/distributed/_tensor/test_view_ops.py::TestViewOps::test_view_ops
2024-12-18T00:27:20.2759373Z 
2024-12-18T00:27:20.2759729Z Running distributed/_composable/fsdp/test_fully_shard_extensions 1/1 ... [2024-12-18 00:27:20.275711]
2024-12-18T00:27:20.2760311Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:20.2764758Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_extensions.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:20.276195]
2024-12-18T00:27:28.7628942Z 
2024-12-18T00:27:28.7630514Z distributed/_composable/fsdp/test_fully_shard_extensions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_extensions_1.1_edcf7ae9ed656e5e_.log
2024-12-18T00:27:28.7635471Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiProcess::test_all_gather_extensions_train_parity, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extension_hsdp_mesh, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extension_outer_size_stride, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extensions_end_to_end, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extensions_monkey_patch
2024-12-18T00:27:28.7640311Z 
2024-12-18T00:27:28.7640571Z Running distributed/fsdp/test_wrap 1/1 ... [2024-12-18 00:27:28.763326]
2024-12-18T00:27:28.7641037Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:27:28.7642528Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_wrap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:27:28.763861]
2024-12-18T00:29:08.7386246Z 
2024-12-18T00:29:08.7387456Z distributed/fsdp/test_wrap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_wrap_1.1_103948b9e847f982_.log
2024-12-18T00:29:08.7413471Z Running 51 items in this shard: test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_bn_always_wrapped_individually, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_False_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_False_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_True_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_True_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_False_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_False_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_True_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_True_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_False_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_False_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_True_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_True_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_False_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_False_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_True_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_True_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_False_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_False_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_True_device_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_True_device_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_wrap_batchnorm_individually_use_or_policy_False, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_wrap_batchnorm_individually_use_or_policy_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap_with_ignored_modules_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap_with_ignored_modules_wrap_method1, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_api, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_exclude_wrap, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_exclude_wrap_include_children, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_force_leaf, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_force_leaf_custom, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode0_cpu_offload0_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode0_cpu_offload0_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode0_cpu_offload1_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode0_cpu_offload1_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode1_cpu_offload0_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode1_cpu_offload0_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode1_cpu_offload1_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_device_init_mode1_cpu_offload1_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_with_ignored_modules_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_with_ignored_modules_wrap_method1, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_custom_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_frozen_params, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_module_wrap_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_module_wrap_policy_callable, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_transformer_auto_wrap_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_disabled_outside_context, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_override_defaults, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_wrap_method1, test/distributed/fsdp/test_wrap.py::TestWrapUtils::test_validate_frozen_params
2024-12-18T00:29:08.7436291Z 
2024-12-18T00:29:08.7436645Z Running distributed/_composable/fsdp/test_fully_shard_autograd 1/1 ... [2024-12-18 00:29:08.739205]
2024-12-18T00:29:08.7437217Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:29:08.7438617Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:29:08.739680]
2024-12-18T00:29:13.0173208Z 
2024-12-18T00:29:13.0174736Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_62ba4f7e52261791_.log
2024-12-18T00:29:13.0178472Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_nontensor_activations, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_module, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_output, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiThread::test_post_acc_grad_hook_runs, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardPostAccGradHookMultiProcess::test_post_acc_grad_hook_optim_parity
2024-12-18T00:29:13.0181846Z 
2024-12-18T00:29:13.0182147Z Running distributed/fsdp/test_fsdp_clip_grad_norm 1/1 ... [2024-12-18 00:29:13.017761]
2024-12-18T00:29:13.0182646Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:29:13.0184856Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_clip_grad_norm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:29:13.018266]
2024-12-18T00:29:17.1957812Z 
2024-12-18T00:29:17.1958982Z distributed/fsdp/test_fsdp_clip_grad_norm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_clip_grad_norm_1.1_6fe4684f4657983e_.log
2024-12-18T00:29:17.1959938Z Running 0 items in this shard:
2024-12-18T00:29:17.1960151Z 
2024-12-18T00:29:17.1964824Z Running distributed/fsdp/test_fsdp_misc 1/1 ... [2024-12-18 00:29:17.196240]
2024-12-18T00:29:17.1965360Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:29:17.1969594Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_misc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:29:17.196730]
2024-12-18T00:30:16.2143751Z 
2024-12-18T00:30:16.2145019Z distributed/fsdp/test_fsdp_misc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_misc_1.1_7972741ead1cc559_.log
2024-12-18T00:30:16.2159017Z Running 28 items in this shard: test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_cpu_init_with_sync_module_states, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_init_stays_on_cpu, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_training, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_False, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_True, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_not_all_outputs_used_in_loss, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optim_overlap_no_use_orig_params_error, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optimizer_overlap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_zero2_eval_with_prefetch, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_cpu_gpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_device_id_auto_wrap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_cpu_offload, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_no_move_ignored_params_and_bufs, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_ignored_module_meta, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_namedtuple, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_same_model_across_ranks, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_unsupported_module_cls, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_homogeneous_attributes, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_module_device_mismatches_device_id, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_multigpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_no_params, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_training_device_mismatch_errors, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_unsafe_setattr, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_world_size_1_sharding_strategy_warning
2024-12-18T00:30:16.2171699Z 
2024-12-18T00:30:16.2171936Z Running distributed/test_c10d_common 1/1 ... [2024-12-18 00:30:16.214923]
2024-12-18T00:30:16.2172400Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:30:16.2173537Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_common.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:30:16.215385]
2024-12-18T00:33:28.1925464Z 
2024-12-18T00:33:28.1927125Z distributed/test_c10d_common 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_common_1.1_d58dbb51f0ffd5b0_.log
2024-12-18T00:33:28.1941670Z Running 23 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype, test/distributed/test_c10d_common.py::CommTest::test_debug_level, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback
2024-12-18T00:33:28.1951196Z Running 1 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier
2024-12-18T00:33:28.1952246Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype
2024-12-18T00:33:28.1953246Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype
2024-12-18T00:33:28.1954257Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype
2024-12-18T00:33:28.1955276Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype
2024-12-18T00:33:28.1956154Z Running 1 items in this shard: test/distributed/test_c10d_common.py::CommTest::test_debug_level
2024-12-18T00:33:28.1957027Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr
2024-12-18T00:33:28.1958014Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config
2024-12-18T00:33:28.1958972Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives
2024-12-18T00:33:28.1961283Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name
2024-12-18T00:33:28.1962402Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends
2024-12-18T00:33:28.1963608Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available
2024-12-18T00:33:28.1964617Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv
2024-12-18T00:33:28.1965745Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends
2024-12-18T00:33:28.1967047Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend
2024-12-18T00:33:28.1968132Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop
2024-12-18T00:33:28.1968987Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable
2024-12-18T00:33:28.1969787Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal
2024-12-18T00:33:28.1970597Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle
2024-12-18T00:33:28.1971396Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank
2024-12-18T00:33:28.1972366Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback
2024-12-18T00:33:28.1973233Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv
2024-12-18T00:33:28.1974057Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback
2024-12-18T00:33:28.1974545Z 
2024-12-18T00:33:28.1974887Z Running distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 ... [2024-12-18 00:33:28.193633]
2024-12-18T00:33:28.1975435Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:33:28.1976609Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:28.194141]
2024-12-18T00:33:32.1215312Z 
2024-12-18T00:33:32.1216884Z distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_tensor_ops_1.1_971d486b925998dd_.log
2024-12-18T00:33:32.1220094Z Running 5 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_clone, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_deep_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_detach, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_inplace_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_set_requires_grad
2024-12-18T00:33:32.1222816Z 
2024-12-18T00:33:32.1223147Z Running distributed/_shard/sharded_tensor/ops/test_embedding 1/1 ... [2024-12-18 00:33:32.122019]
2024-12-18T00:33:32.1223710Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:33:32.1227360Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:32.122509]
2024-12-18T00:33:36.1002706Z 
2024-12-18T00:33:36.1004293Z distributed/_shard/sharded_tensor/ops/test_embedding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_1.1_938836322e3f7568_.log
2024-12-18T00:33:36.1006288Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding.py::TestShardedEmbedding::test_sharded_embedding_rowwise
2024-12-18T00:33:36.1007454Z 
2024-12-18T00:33:36.1010353Z Running distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 ... [2024-12-18 00:33:36.100793]
2024-12-18T00:33:36.1011058Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:33:36.1015568Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_embedding_bag.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:36.101310]
2024-12-18T00:33:40.0789823Z 
2024-12-18T00:33:40.0791331Z distributed/_shard/sharded_tensor/ops/test_embedding_bag 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_embedding_bag_1.1_2db2e22b1d232591_.log
2024-12-18T00:33:40.0793460Z Running 2 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_colwise, test/distributed/_shard/sharded_tensor/ops/test_embedding_bag.py::TestShardedEmbeddingBag::test_sharded_embedding_bag_rowwise
2024-12-18T00:33:40.0794701Z 
2024-12-18T00:33:40.0796833Z Running distributed/flight_recorder/test_fr_analysis 1/1 ... [2024-12-18 00:33:40.079438]
2024-12-18T00:33:40.0797396Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:33:40.0801976Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/flight_recorder/test_fr_analysis.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:40.079916]
2024-12-18T00:33:44.3579540Z 
2024-12-18T00:33:44.3580971Z distributed/flight_recorder/test_fr_analysis 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.flight_recorder.test_fr_analysis_1.1_1939680e4693ba2e_.log
2024-12-18T00:33:44.3582367Z Running 1 items in this shard: test/distributed/flight_recorder/test_fr_analysis.py::FlightRecorderEventTest::test_match_one_event
2024-12-18T00:33:44.3582949Z 
2024-12-18T00:33:44.3585993Z Running distributed/_tensor/test_dtensor_compile 1/1 ... [2024-12-18 00:33:44.358385]
2024-12-18T00:33:44.3586658Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:33:44.3591116Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:33:44.358842]
2024-12-18T00:34:35.4871401Z 
2024-12-18T00:34:35.4872880Z distributed/_tensor/test_dtensor_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_compile_1.1_2d02aa465a997336_.log
2024-12-18T00:34:35.4896400Z Running 30 items in this shard: test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_device_mesh_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_attribute_access_on_intermediate, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_constructor_w_dynamo_disable, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_constructor_w_graph_break, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_contiguous_dtensor_noncontiguous_local_as_tangent, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_different_gradient_placement, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dont_recompile_on_same_placement_devicemesh, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dynamic, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_dynamo_device_mesh_attrs, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_noncontiguous_output, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_partial_placement_graph_output, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_partial_placement_redistribute_unbalanced_correct_strides, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local_dynamic_shapes, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local_redistribute, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_from_local_redistribute_async, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_dtensor_recompile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_to_local_kwargs, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_dynamo_to_local_kwargs_forward_hook, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_fakify_dtensor, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_graph_input_is_async, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_placement_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_tp_compile_comm_reordering, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompile::test_unwrap_async_collective_tensor_tangent, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_2d_fsdp_tp_ac_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_2d_fsdp_tp_compile, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_compile_dtensor_redistribute_backward, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_tp_compile_fullgraph_is_seq_parallel_False, test/distributed/_tensor/test_dtensor_compile.py::TestDTensorCompileE2E::test_tp_compile_fullgraph_is_seq_parallel_True
2024-12-18T00:34:35.4918701Z 
2024-12-18T00:34:35.4926291Z Running distributed/_tensor/debug/test_op_coverage 1/1 ... [2024-12-18 00:34:35.487260]
2024-12-18T00:34:35.4927160Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:35.4929239Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/debug/test_op_coverage.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:35.487729]
2024-12-18T00:34:40.1684112Z 
2024-12-18T00:34:40.1685235Z distributed/_tensor/debug/test_op_coverage 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_op_coverage_1.1_a670bd9799e589a8_.log
2024-12-18T00:34:40.1686601Z Running 1 items in this shard: test/distributed/_tensor/debug/test_op_coverage.py::TestOpCoverage::test_trace_with_inductor_decomp
2024-12-18T00:34:40.1687180Z 
2024-12-18T00:34:40.1690591Z Running distributed/_tools/test_mod_tracker 1/1 ... [2024-12-18 00:34:40.168875]
2024-12-18T00:34:40.1691085Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:40.1695733Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_mod_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:40.169361]
2024-12-18T00:34:44.4977300Z 
2024-12-18T00:34:44.4978988Z distributed/_tools/test_mod_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mod_tracker_1.1_50865d3ad677d075_.log
2024-12-18T00:34:44.4983004Z Running 4 items in this shard: test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_ac, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_bw_detection, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_module_hierarchy, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_user_hooks
2024-12-18T00:34:44.4985541Z 
2024-12-18T00:34:44.4987858Z Running distributed/test_compute_comm_reordering 1/1 ... [2024-12-18 00:34:44.498533]
2024-12-18T00:34:44.4988713Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:44.4994576Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_compute_comm_reordering.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:44.499124]
2024-12-18T00:34:48.5769568Z 
2024-12-18T00:34:48.5771389Z distributed/test_compute_comm_reordering 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_compute_comm_reordering_1.1_085b0966c4ed9c78_.log
2024-12-18T00:34:48.5780059Z Running 7 items in this shard: test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_grouped_scheduler_node, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_nccl_heuristics, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_raise_comms, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap_custom_runtime_estimation, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits_raise_comms
2024-12-18T00:34:48.5786603Z 
2024-12-18T00:34:48.5787176Z Running distributed/pipelining/test_schedule_multiproc 1/1 ... [2024-12-18 00:34:48.577710]
2024-12-18T00:34:48.5787968Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:48.5789547Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_schedule_multiproc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:48.578333]
2024-12-18T00:34:52.6479370Z 
2024-12-18T00:34:52.6481017Z distributed/pipelining/test_schedule_multiproc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_schedule_multiproc_1.1_ec5e41b36dba9d0b_.log
2024-12-18T00:34:52.6481960Z 
2024-12-18T00:34:52.6486415Z Running distributed/tensor/parallel/test_micro_pipeline_tp 1/1 ... [2024-12-18 00:34:52.648432]
2024-12-18T00:34:52.6486989Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:52.6491515Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_micro_pipeline_tp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:52.648917]
2024-12-18T00:34:57.4779866Z 
2024-12-18T00:34:57.4781875Z distributed/tensor/parallel/test_micro_pipeline_tp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_micro_pipeline_tp_1.1_587035cdc7e08474_.log
2024-12-18T00:34:57.4810749Z Running 29 items in this shard: test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_dtensor_seq_par_shard_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_dtensor_seq_par_shard_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_find_all_gather_patterns, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_find_reduce_scatter_patterns, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_2_gather_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_2_gather_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_2_gather_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_3_gather_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_3_gather_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_matmul_A_dims_3_gather_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_2_gather_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_2_gather_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_2_gather_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_3_gather_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_3_gather_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_all_gather_scaled_matmul_A_dims_3_gather_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_2_scatter_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_2_scatter_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_2_scatter_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_3_scatter_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_3_scatter_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_matmul_reduce_scatter_A_dims_3_scatter_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_2_scatter_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_2_scatter_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_2_scatter_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_3_scatter_dim_0, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_3_scatter_dim_1, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_fuse_scaled_matmul_reduce_scatter_A_dims_3_scatter_dim_2, test/distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_get_unexposed_collectives
2024-12-18T00:34:57.4837043Z 
2024-12-18T00:34:57.4837570Z Running distributed/checkpoint/test_nested_dict 1/1 ... [2024-12-18 00:34:57.478845]
2024-12-18T00:34:57.4838529Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:34:57.4840239Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_nested_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:34:57.479464]
2024-12-18T00:35:01.7589465Z 
2024-12-18T00:35:01.7590781Z distributed/checkpoint/test_nested_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_nested_dict_1.1_157079bcb6973562_.log
2024-12-18T00:35:01.7592644Z Running 2 items in this shard: test/distributed/checkpoint/test_nested_dict.py::TestFlattening::test_flattening_round_trip, test/distributed/checkpoint/test_nested_dict.py::TestFlattening::test_mapping
2024-12-18T00:35:01.7593602Z 
2024-12-18T00:35:01.7596045Z Running distributed/pipelining/test_transformer 1/1 ... [2024-12-18 00:35:01.759406]
2024-12-18T00:35:01.7596595Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:01.7601182Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_transformer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:01.759874]
2024-12-18T00:35:06.4382925Z 
2024-12-18T00:35:06.4384764Z distributed/pipelining/test_transformer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_transformer_1.1_c23fc1a16e253abe_.log
2024-12-18T00:35:06.4387123Z Running 1 items in this shard: test/distributed/pipelining/test_transformer.py::TransformerTests::test_ir
2024-12-18T00:35:06.4388066Z 
2024-12-18T00:35:06.4392443Z Running distributed/pipelining/test_backward 1/1 ... [2024-12-18 00:35:06.439020]
2024-12-18T00:35:06.4393604Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:06.4399552Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_backward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:06.439619]
2024-12-18T00:35:10.8679845Z 
2024-12-18T00:35:10.8680984Z distributed/pipelining/test_backward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_backward_1.1_05074dbf6075746c_.log
2024-12-18T00:35:10.8683602Z Running 4 items in this shard: test/distributed/pipelining/test_backward.py::StageBackwardTests::test_stage_backward, test/distributed/pipelining/test_backward.py::StageBackwardTests::test_stage_backward_input, test/distributed/pipelining/test_backward.py::StageBackwardTests::test_stage_backward_weight, test/distributed/pipelining/test_backward.py::StageBackwardTests::test_stage_backward_weight_multiple_iters
2024-12-18T00:35:10.8685986Z 
2024-12-18T00:35:10.8686310Z Running distributed/_shard/sharded_tensor/test_logger 1/1 ... [2024-12-18 00:35:10.868446]
2024-12-18T00:35:10.8686845Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:10.8691234Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharded_tensor/test_logger.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:10.868893]
2024-12-18T00:35:14.9967181Z 
2024-12-18T00:35:14.9968336Z distributed/_shard/sharded_tensor/test_logger 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.test_logger_1.1_f21b10a4f11b7b38_.log
2024-12-18T00:35:14.9969739Z Running 1 items in this shard: test/distributed/_shard/sharded_tensor/test_logger.py::ShardingSpecLoggerTest::test_get_or_create_logger
2024-12-18T00:35:14.9970335Z 
2024-12-18T00:35:14.9973866Z Running distributed/pipelining/test_pipe 1/1 ... [2024-12-18 00:35:14.997192]
2024-12-18T00:35:14.9974412Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:14.9979390Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_pipe.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:14.997697]
2024-12-18T00:35:19.7765218Z 
2024-12-18T00:35:19.7766368Z distributed/pipelining/test_pipe 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_pipe_1.1_b8b8256b36ae2027_.log
2024-12-18T00:35:19.7768483Z Running 3 items in this shard: test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass0, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass1, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass2
2024-12-18T00:35:19.7769866Z 
2024-12-18T00:35:19.7772441Z Running distributed/_composable/fsdp/test_fully_shard_compile 1/1 ... [2024-12-18 00:35:19.777049]
2024-12-18T00:35:19.7773077Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:19.7777852Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:19.777547]
2024-12-18T00:35:23.9060446Z 
2024-12-18T00:35:23.9061656Z distributed/_composable/fsdp/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_compile_1.1_07aa984a9f175a1d_.log
2024-12-18T00:35:23.9072163Z Running 16 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompileCompute::test_disable_compiling_hooks, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_compiled_autograd_ctx, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_dynamo_recompiles_on_fsdp_layers, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_dynamo_trace_use_training_state, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_inductor_fullgraph_False, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_inductor_fullgraph_True, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_inductor, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_trace_fsdp_copy_, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_inductor_fullgraph_False, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_inductor_fullgraph_True
2024-12-18T00:35:23.9081227Z 
2024-12-18T00:35:23.9081502Z Running distributed/_tools/test_sac_estimator 1/1 ... [2024-12-18 00:35:23.906552]
2024-12-18T00:35:23.9081999Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:23.9083105Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_sac_estimator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:23.906999]
2024-12-18T00:35:28.2353138Z 
2024-12-18T00:35:28.2354181Z distributed/_tools/test_sac_estimator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_sac_estimator_1.1_58d280f7ce413e0d_.log
2024-12-18T00:35:28.2355865Z Running 2 items in this shard: test/distributed/_tools/test_sac_estimator.py::TestSACEstimator::test_simple_model_sac_estimation, test/distributed/_tools/test_sac_estimator.py::TestSACEstimator::test_transformer_sac_estimation
2024-12-18T00:35:28.2356843Z 
2024-12-18T00:35:28.2359739Z Running distributed/_tools/test_sac_ilp 1/1 ... [2024-12-18 00:35:28.235787]
2024-12-18T00:35:28.2360297Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:28.2364957Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_sac_ilp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:28.236253]
2024-12-18T00:35:32.5645117Z 
2024-12-18T00:35:32.5646301Z distributed/_tools/test_sac_ilp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_sac_ilp_1.1_29f181654d29c19e_.log
2024-12-18T00:35:32.5648757Z Running 4 items in this shard: test/distributed/_tools/test_sac_ilp.py::TestSACILP::test_sac_ilp_case1, test/distributed/_tools/test_sac_ilp.py::TestSACILP::test_sac_ilp_case2, test/distributed/_tools/test_sac_ilp.py::TestSACILP::test_sac_ilp_case3, test/distributed/_tools/test_sac_ilp.py::TestOptimalCheckpointingPolicy::test_get_optimial_checkpointing_policy_per_module
2024-12-18T00:35:32.5650486Z 
2024-12-18T00:35:32.5651421Z Running distributed/test_c10d_functional_native 1/1 ... [2024-12-18 00:35:32.564947]
2024-12-18T00:35:32.5651955Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:32.5656295Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_functional_native.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:32.565399]
2024-12-18T00:35:36.7431287Z 
2024-12-18T00:35:36.7433242Z distributed/test_c10d_functional_native 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_functional_native_1.1_d6c6933b44cab777_.log
2024-12-18T00:35:36.7470034Z Running 28 items in this shard: test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_to_all_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_broadcast, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_inductor_dtypeview_memory_leak, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_py_work, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_threading, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_unwaited, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_wait_tensor, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_non_contig_input, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_to_all_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_broadcast, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_inplace_op_on_view, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reuse_buffer_after_inplace_collective, test/distributed/test_c10d_functional_native.py::CompileTest::test_ranks_and_tag, test/distributed/test_c10d_functional_native.py::CompileTest::test_wait_tensor
2024-12-18T00:35:36.7488032Z 
2024-12-18T00:35:36.7488443Z Running distributed/_tensor/test_dtensor 1/1 ... [2024-12-18 00:35:36.743933]
2024-12-18T00:35:36.7489144Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:35:36.7490783Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_dtensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:35:36.744557]
2024-12-18T00:38:41.8344150Z 
2024-12-18T00:38:41.8346418Z distributed/_tensor/test_dtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_1.1_8f40b946cbd11c99_.log
2024-12-18T00:38:41.8369494Z Running 36 items in this shard: test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_async_output, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_constructor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_new_empty_strided, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_properties, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_save_load, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_save_load_import, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_hash, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_read_only_after_set, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_stride, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_negative_dim, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_then_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding_raise_error, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_sync, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_modules_w_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_shard_tensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_shard_tensor_2d, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_auto_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_default_value_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_device_mesh_nd, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_2d_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_api_device_mesh_context_manager, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_device_mesh_device_conversion, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_spec_local_shard_offset, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_from_local_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_implicit_replication_for_foreach_ops, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_metadata_consistency_check, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_redistribute_sub_mesh, test/distributed/_tensor/test_dtensor.py::TestDTensorPlacementTypes::test_split_tensor_1D, test/distributed/_tensor/test_dtensor.py::DTensorLogTest::test_dtensor_log
2024-12-18T00:38:41.8390325Z 
2024-12-18T00:38:41.8390799Z Running distributed/pipelining/test_unflatten 1/1 ... [2024-12-18 00:38:41.835378]
2024-12-18T00:38:41.8391611Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:38:41.8393216Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_unflatten.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:38:41.835979]
2024-12-18T00:38:46.4154559Z 
2024-12-18T00:38:46.4156332Z distributed/pipelining/test_unflatten 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_unflatten_1.1_10d81a9142bcf49f_.log
2024-12-18T00:38:46.4159025Z Running 1 items in this shard: test/distributed/pipelining/test_unflatten.py::UnflattenTests::test_unflatten
2024-12-18T00:38:46.4159967Z 
2024-12-18T00:38:46.4164765Z Running distributed/checkpoint/fsdp/test_fsdp_dsd 1/1 ... [2024-12-18 00:38:46.416186]
2024-12-18T00:38:46.4165686Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:38:46.4170641Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/fsdp/test_fsdp_dsd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:38:46.416731]
2024-12-18T00:38:50.6948247Z 
2024-12-18T00:38:50.6949415Z distributed/checkpoint/fsdp/test_fsdp_dsd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.fsdp.test_fsdp_dsd_1.1_11a3f704914850fd_.log
2024-12-18T00:38:50.6955651Z Running 6 items in this shard: test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_1d_fsdp_cpu_offload_full_model_state_dict, test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_1d_fsdp_get_model_state_dict, test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_save_with_fsdp1_and_load_with_fsdp2, test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_save_with_fsdp1_and_load_with_fsdp2_tp, test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_save_with_fsdp2_tp_and_load_with_tp, test/distributed/checkpoint/fsdp/test_fsdp_dsd.py::TestFullyShardWithDistributedStateDict::test_save_with_tp_and_load_with_fsdp2_tp
2024-12-18T00:38:50.6959609Z 
2024-12-18T00:38:50.6959979Z Running distributed/test_backends 1/1 ... [2024-12-18 00:38:50.695366]
2024-12-18T00:38:50.6960451Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:38:50.6961588Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_backends.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:38:50.695878]
2024-12-18T00:38:54.7766517Z 
2024-12-18T00:38:54.7767447Z distributed/test_backends 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_backends_1.1_40130e827d9d1507_.log
2024-12-18T00:38:54.7769011Z Running 2 items in this shard: test/distributed/test_backends.py::TestMiscCollectiveUtilsCPU::test_create_pg_cpu, test/distributed/test_backends.py::TestMiscCollectiveUtilsCPU::test_device_to_backend_mapping_cpu
2024-12-18T00:38:54.7769936Z 
2024-12-18T00:38:54.7772816Z Running distributed/_composable/fsdp/test_fully_shard_logging 1/1 ... [2024-12-18 00:38:54.777089]
2024-12-18T00:38:54.7773388Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:38:54.7777966Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_logging.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:38:54.777561]
2024-12-18T00:38:58.7261448Z 
2024-12-18T00:38:58.7262666Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_15151d7ede0e2d72_.log
2024-12-18T00:38:58.7263729Z Running 0 items in this shard:
2024-12-18T00:38:58.7263940Z 
2024-12-18T00:38:58.7267632Z Running distributed/test_symmetric_memory 1/1 ... [2024-12-18 00:38:58.726567]
2024-12-18T00:38:58.7268126Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:38:58.7272814Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_symmetric_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:38:58.727027]
2024-12-18T00:39:02.9553220Z 
2024-12-18T00:39:02.9554376Z distributed/test_symmetric_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_symmetric_memory_1.1_4ef31e4addad065e_.log
2024-12-18T00:39:02.9614586Z Running 113 items in this shard: test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_allow_overlapping_devices, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_barrier_timeout, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_cuda_nvlink_connectivity_detection, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_empty_strided_p2p, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_empty_strided_p2p_persistent, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_gather_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_gather_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_native_symm_mem_input_False_is_b_row_major_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_native_symm_mem_input_False_is_b_row_major_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_native_symm_mem_input_True_is_b_row_major_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_matmul_native_symm_mem_input_True_is_b_row_major_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_row-wise-replicated, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_row-wise-sharded, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_0_scale_mode_tensor-wise, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_row-wise-replicated, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_row-wise-sharded, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_all_gather_scaled_matmul_gather_dim_1_scale_mode_tensor-wise, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_matmul_reduce_scatter_scatter_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_matmul_reduce_scatter_scatter_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_0_rowwise_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_0_rowwise_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_1_rowwise_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_fused_scaled_matmul_reduce_scatter_scatter_dim_1_rowwise_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_get_signal_pad, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_has_multicast_support, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_large_alloc, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_all_gather_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_all_gather_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_avg_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_avg_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_sum_symm_mem_input_False, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_low_contention_reduce_scatter_reduce_op_sum_symm_mem_input_True, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_0, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_1, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_optimal_layout_dim_2, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_put_signal_timeout, test/distributed/test_symmetric_memory.py::SymmetricMemoryTest::test_wait_signal_timeout, test/distributed/test_symmetric_memory.py::SubgroupTest::test_subgroup, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_multimem_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_one_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_bfloat16_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_16_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_4_size_bytes_8196, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_4, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_8192, test/distributed/test_symmetric_memory.py::SymmMemAllReduceTest::test_two_shot_all_reduce_float32_align_bytes_8_size_bytes_8196, test/distributed/test_symmetric_memory.py::LoweringTest::test_lowering_one_shot_all_reduce, test/distributed/test_symmetric_memory.py::SymmMemSingleProcTest::test_memset32, test/distributed/test_symmetric_memory.py::SymmMemSingleProcTest::test_stream_write_value32
2024-12-18T00:39:02.9670990Z 
2024-12-18T00:39:02.9671299Z Running distributed/_tools/test_memory_tracker 1/1 ... [2024-12-18 00:39:02.955915]
2024-12-18T00:39:02.9671806Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:02.9672921Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tools/test_memory_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:02.956421]
2024-12-18T00:39:07.1841344Z 
2024-12-18T00:39:07.1842454Z distributed/_tools/test_memory_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_memory_tracker_1.1_004792d9fbb91663_.log
2024-12-18T00:39:07.1843771Z Running 1 items in this shard: test/distributed/_tools/test_memory_tracker.py::TestMemoryTracker::test_local_model
2024-12-18T00:39:07.1844320Z 
2024-12-18T00:39:07.1848710Z Running distributed/_composable/test_composability/test_pp_composability 1/1 ... [2024-12-18 00:39:07.184647]
2024-12-18T00:39:07.1849429Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:07.1853550Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_composability/test_pp_composability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:07.185134]
2024-12-18T00:39:11.5130555Z 
2024-12-18T00:39:11.5132321Z distributed/_composable/test_composability/test_pp_composability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_composability.test_pp_composability_1.1_ab28001a2a6b371f_.log
2024-12-18T00:39:11.5148731Z Running 21 items in this shard: test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass0_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass0_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass1_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass1_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass2_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass2_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass3_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass3_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass4_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_DDP_ScheduleClass4_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass0_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass0_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass1_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass1_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass2_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass2_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass3_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass3_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass4_use_new_runtime_False, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_manual_with_data_parallel_dp_type_FSDP_ScheduleClass4_use_new_runtime_True, test/distributed/_composable/test_composability/test_pp_composability.py::ComposabilityTest::test_pp_and_dcp
2024-12-18T00:39:11.5163736Z 
2024-12-18T00:39:11.5163978Z Running distributed/test_fake_pg 1/1 ... [2024-12-18 00:39:11.513660]
2024-12-18T00:39:11.5164433Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:11.5165491Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_fake_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:11.514170]
2024-12-18T00:39:15.8923842Z 
2024-12-18T00:39:15.8925177Z distributed/test_fake_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_fake_pg_1.1_f6c57eefbec68500_.log
2024-12-18T00:39:15.8929477Z Running 13 items in this shard: test/distributed/test_fake_pg.py::TestFakePG::test_all_reduce, test/distributed/test_fake_pg.py::TestFakePG::test_allgather, test/distributed/test_fake_pg.py::TestFakePG::test_alltoall, test/distributed/test_fake_pg.py::TestFakePG::test_alltoall_base, test/distributed/test_fake_pg.py::TestFakePG::test_broadcast, test/distributed/test_fake_pg.py::TestFakePG::test_construct_fsdp, test/distributed/test_fake_pg.py::TestFakePG::test_fake_pg_tracing, test/distributed/test_fake_pg.py::TestFakePG::test_fsdp_fake_e2e, test/distributed/test_fake_pg.py::TestFakePG::test_fsdp_tp_fake_e2e, test/distributed/test_fake_pg.py::TestFakePG::test_recv, test/distributed/test_fake_pg.py::TestFakePG::test_reduce_scatter, test/distributed/test_fake_pg.py::TestFakePG::test_scatter, test/distributed/test_fake_pg.py::TestFakePG::test_send
2024-12-18T00:39:15.8933077Z 
2024-12-18T00:39:15.8933601Z Running distributed/checkpoint/test_fsdp_optim_state 1/1 ... [2024-12-18 00:39:15.892770]
2024-12-18T00:39:15.8934277Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:15.8935425Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:15.893249]
2024-12-18T00:39:28.7404988Z 
2024-12-18T00:39:28.7406193Z distributed/checkpoint/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_55bacf7f19035d5c_.log
2024-12-18T00:39:28.7408515Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_False, test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_True
2024-12-18T00:39:28.7410063Z 
2024-12-18T00:39:28.7411635Z Running distributed/_tensor/experimental/test_local_map 1/1 ... [2024-12-18 00:39:28.740971]
2024-12-18T00:39:28.7412265Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:28.7416955Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_local_map.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:28.741467]
2024-12-18T00:39:49.1432504Z 
2024-12-18T00:39:49.1434332Z distributed/_tensor/experimental/test_local_map 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_local_map_1.1_59511e3f48f6b599_.log
2024-12-18T00:39:49.1439354Z Running 4 items in this shard: test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_correctness, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_in_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_out_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_redistribute
2024-12-18T00:39:49.1442491Z 
2024-12-18T00:39:49.1442871Z Running distributed/test_distributed_spawn 1/1 ... [2024-12-18 00:39:49.143888]
2024-12-18T00:39:49.1520361Z MPI not available -- MPI backend tests will be skipped
2024-12-18T00:39:49.1522375Z Running distributed tests for the test backend with env init_method
2024-12-18T00:39:49.1525959Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:49.1531761Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:49.152919]
2024-12-18T00:39:53.2697289Z 
2024-12-18T00:39:53.2698531Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_851d0a92286580c7_.log
2024-12-18T00:39:53.2699555Z Running 0 items in this shard:
2024-12-18T00:39:53.2699753Z 
2024-12-18T00:39:53.2708131Z Running distributed tests for the test backend with file init_method
2024-12-18T00:39:53.2709807Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:53.2714363Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:53.271211]
2024-12-18T00:39:57.3869562Z 
2024-12-18T00:39:57.3870753Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_2d3118a1f3df0b20_.log
2024-12-18T00:39:57.3871988Z Running 0 items in this shard:
2024-12-18T00:39:57.3872192Z 
2024-12-18T00:39:57.3878749Z Running distributed tests for the gloo backend with env init_method
2024-12-18T00:39:57.3880795Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T00:39:57.3885469Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 00:39:57.388293]
2024-12-18T01:00:34.5407821Z 
2024-12-18T01:00:34.5408876Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_f872e212351084a9_.log
2024-12-18T01:00:34.5566165Z Running 278 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-12-18T01:00:34.5689373Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager
2024-12-18T01:00:34.5690698Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager
2024-12-18T01:00:34.5691770Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class
2024-12-18T01:00:34.5692804Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel
2024-12-18T01:00:34.5693883Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU
2024-12-18T01:00:34.5695022Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view
2024-12-18T01:00:34.5696195Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm
2024-12-18T01:00:34.5697405Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input
2024-12-18T01:00:34.5698675Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last
2024-12-18T01:00:34.5700210Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value
2024-12-18T01:00:34.5701647Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient
2024-12-18T01:00:34.5702983Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine
2024-12-18T01:00:34.5704308Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process
2024-12-18T01:00:34.5705621Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half
2024-12-18T01:00:34.5706845Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream
2024-12-18T01:00:34.5708124Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad
2024-12-18T01:00:34.5709345Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view
2024-12-18T01:00:34.5710524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding
2024-12-18T01:00:34.5711602Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group
2024-12-18T01:00:34.5712684Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync
2024-12-18T01:00:34.5713835Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook
2024-12-18T01:00:34.5715085Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook
2024-12-18T01:00:34.5716325Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view
2024-12-18T01:00:34.5717375Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather
2024-12-18T01:00:34.5718377Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex
2024-12-18T01:00:34.5719473Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group
2024-12-18T01:00:34.5720562Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group
2024-12-18T01:00:34.5721632Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple
2024-12-18T01:00:34.5722721Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty
2024-12-18T01:00:34.5723838Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex
2024-12-18T01:00:34.5724823Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda
2024-12-18T01:00:34.5725813Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex
2024-12-18T01:00:34.5726919Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group
2024-12-18T01:00:34.5727924Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group
2024-12-18T01:00:34.5728975Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda
2024-12-18T01:00:34.5730102Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda
2024-12-18T01:00:34.5731211Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg
2024-12-18T01:00:34.5732283Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup
2024-12-18T01:00:34.5733294Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda
2024-12-18T01:00:34.5734361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max
2024-12-18T01:00:34.5735574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min
2024-12-18T01:00:34.5736731Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product
2024-12-18T01:00:34.5737892Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum
2024-12-18T01:00:34.5739221Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max
2024-12-18T01:00:34.5740330Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min
2024-12-18T01:00:34.5741461Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product
2024-12-18T01:00:34.5742577Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum
2024-12-18T01:00:34.5743656Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max
2024-12-18T01:00:34.5744794Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported
2024-12-18T01:00:34.5745927Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min
2024-12-18T01:00:34.5746990Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product
2024-12-18T01:00:34.5748057Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum
2024-12-18T01:00:34.5749150Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops
2024-12-18T01:00:34.5750251Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max
2024-12-18T01:00:34.5751288Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min
2024-12-18T01:00:34.5752361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product
2024-12-18T01:00:34.5753429Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum
2024-12-18T01:00:34.5754607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max
2024-12-18T01:00:34.5755629Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min
2024-12-18T01:00:34.5756651Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product
2024-12-18T01:00:34.5757677Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum
2024-12-18T01:00:34.5758646Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max
2024-12-18T01:00:34.5759608Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min
2024-12-18T01:00:34.5760586Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product
2024-12-18T01:00:34.5761567Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum
2024-12-18T01:00:34.5762624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async
2024-12-18T01:00:34.5763718Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex
2024-12-18T01:00:34.5764729Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda
2024-12-18T01:00:34.5765752Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async
2024-12-18T01:00:34.5766802Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex
2024-12-18T01:00:34.5767802Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all
2024-12-18T01:00:34.5768764Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex
2024-12-18T01:00:34.5769739Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda
2024-12-18T01:00:34.5770736Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex
2024-12-18T01:00:34.5771754Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group
2024-12-18T01:00:34.5772791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda
2024-12-18T01:00:34.5773795Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group
2024-12-18T01:00:34.5774791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda
2024-12-18T01:00:34.5775846Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split
2024-12-18T01:00:34.5776967Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex
2024-12-18T01:00:34.5778117Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda
2024-12-18T01:00:34.5779283Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex
2024-12-18T01:00:34.5780479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group
2024-12-18T01:00:34.5781749Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda
2024-12-18T01:00:34.5782929Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group
2024-12-18T01:00:34.5784093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda
2024-12-18T01:00:34.5785239Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split
2024-12-18T01:00:34.5786381Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex
2024-12-18T01:00:34.5787553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda
2024-12-18T01:00:34.5788739Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex
2024-12-18T01:00:34.5790000Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group
2024-12-18T01:00:34.5791213Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda
2024-12-18T01:00:34.5792397Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group
2024-12-18T01:00:34.5793574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda
2024-12-18T01:00:34.5794672Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters
2024-12-18T01:00:34.5795624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier
2024-12-18T01:00:34.5796547Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda
2024-12-18T01:00:34.5797510Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group
2024-12-18T01:00:34.5798519Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda
2024-12-18T01:00:34.5799510Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group
2024-12-18T01:00:34.5800467Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda
2024-12-18T01:00:34.5801490Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group
2024-12-18T01:00:34.5802543Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global
2024-12-18T01:00:34.5803663Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group
2024-12-18T01:00:34.5804687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo
2024-12-18T01:00:34.5805734Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags
2024-12-18T01:00:34.5806842Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err
2024-12-18T01:00:34.5807915Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl
2024-12-18T01:00:34.5809060Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl
2024-12-18T01:00:34.5810160Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err
2024-12-18T01:00:34.5811228Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err
2024-12-18T01:00:34.5812348Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl
2024-12-18T01:00:34.5813455Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl
2024-12-18T01:00:34.5814450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast
2024-12-18T01:00:34.5815394Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda
2024-12-18T01:00:34.5816421Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group
2024-12-18T01:00:34.5817407Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group
2024-12-18T01:00:34.5818393Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list
2024-12-18T01:00:34.5819396Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager
2024-12-18T01:00:34.5820410Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async
2024-12-18T01:00:34.5821592Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger
2024-12-18T01:00:34.5822934Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger
2024-12-18T01:00:34.5824156Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward
2024-12-18T01:00:34.5825323Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false
2024-12-18T01:00:34.5826564Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params
2024-12-18T01:00:34.5827671Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer
2024-12-18T01:00:34.5828725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook
2024-12-18T01:00:34.5829807Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce
2024-12-18T01:00:34.5830922Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future
2024-12-18T01:00:34.5832087Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping
2024-12-18T01:00:34.5833304Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad
2024-12-18T01:00:34.5834433Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging
2024-12-18T01:00:34.5835522Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph
2024-12-18T01:00:34.5836643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks
2024-12-18T01:00:34.5837800Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks
2024-12-18T01:00:34.5839082Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph
2024-12-18T01:00:34.5840039Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device
2024-12-18T01:00:34.5841064Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization
2024-12-18T01:00:34.5842136Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook
2024-12-18T01:00:34.5843277Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs
2024-12-18T01:00:34.5844463Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized
2024-12-18T01:00:34.5845498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce
2024-12-18T01:00:34.5846621Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group
2024-12-18T01:00:34.5847767Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD
2024-12-18T01:00:34.5848839Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD
2024-12-18T01:00:34.5849895Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD
2024-12-18T01:00:34.5850930Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg
2024-12-18T01:00:34.5851915Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference
2024-12-18T01:00:34.5852925Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence
2024-12-18T01:00:34.5853960Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu
2024-12-18T01:00:34.5854963Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu
2024-12-18T01:00:34.5856046Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks
2024-12-18T01:00:34.5857203Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks
2024-12-18T01:00:34.5858404Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params
2024-12-18T01:00:34.5859615Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error
2024-12-18T01:00:34.5860686Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple
2024-12-18T01:00:34.5861840Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none
2024-12-18T01:00:34.5863279Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none
2024-12-18T01:00:34.5864559Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params
2024-12-18T01:00:34.5865849Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none
2024-12-18T01:00:34.5867229Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none
2024-12-18T01:00:34.5868432Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd
2024-12-18T01:00:34.5869498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph
2024-12-18T01:00:34.5870632Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler
2024-12-18T01:00:34.5871798Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace
2024-12-18T01:00:34.5872895Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler
2024-12-18T01:00:34.5873974Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged
2024-12-18T01:00:34.5875027Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks
2024-12-18T01:00:34.5876112Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad
2024-12-18T01:00:34.5877237Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params
2024-12-18T01:00:34.5878297Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone
2024-12-18T01:00:34.5879333Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types
2024-12-18T01:00:34.5880425Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval
2024-12-18T01:00:34.5881467Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states
2024-12-18T01:00:34.5882516Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception
2024-12-18T01:00:34.5883671Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable
2024-12-18T01:00:34.5884729Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs
2024-12-18T01:00:34.5885823Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn
2024-12-18T01:00:34.5887029Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception
2024-12-18T01:00:34.5888162Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features
2024-12-18T01:00:34.5889188Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group
2024-12-18T01:00:34.5890151Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group
2024-12-18T01:00:34.5891245Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static
2024-12-18T01:00:34.5892342Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks
2024-12-18T01:00:34.5893420Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars
2024-12-18T01:00:34.5894407Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather
2024-12-18T01:00:34.5895342Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks
2024-12-18T01:00:34.5896287Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda
2024-12-18T01:00:34.5897233Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group
2024-12-18T01:00:34.5898255Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group
2024-12-18T01:00:34.5899199Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object
2024-12-18T01:00:34.5900183Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup
2024-12-18T01:00:34.5901158Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend
2024-12-18T01:00:34.5902147Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params
2024-12-18T01:00:34.5903132Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future
2024-12-18T01:00:34.5904041Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank
2024-12-18T01:00:34.5905020Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group
2024-12-18T01:00:34.5906039Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group
2024-12-18T01:00:34.5907116Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync
2024-12-18T01:00:34.5908201Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph
2024-12-18T01:00:34.5909155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv
2024-12-18T01:00:34.5910046Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend
2024-12-18T01:00:34.5911003Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler
2024-12-18T01:00:34.5912024Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler
2024-12-18T01:00:34.5913086Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang
2024-12-18T01:00:34.5914264Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks
2024-12-18T01:00:34.5915440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order
2024-12-18T01:00:34.5916507Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo
2024-12-18T01:00:34.5917663Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout
2024-12-18T01:00:34.5918806Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup
2024-12-18T01:00:34.5919908Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks
2024-12-18T01:00:34.5921007Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather
2024-12-18T01:00:34.5922085Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce
2024-12-18T01:00:34.5923160Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast
2024-12-18T01:00:34.5924301Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce
2024-12-18T01:00:34.5925438Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream
2024-12-18T01:00:34.5926449Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups
2024-12-18T01:00:34.5927470Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration
2024-12-18T01:00:34.5928663Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size
2024-12-18T01:00:34.5929951Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank
2024-12-18T01:00:34.5931189Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size
2024-12-18T01:00:34.5932367Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed
2024-12-18T01:00:34.5933569Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size
2024-12-18T01:00:34.5934768Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module
2024-12-18T01:00:34.5935898Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module
2024-12-18T01:00:34.5936985Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager
2024-12-18T01:00:34.5938070Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group
2024-12-18T01:00:34.5939426Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity
2024-12-18T01:00:34.5940595Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view
2024-12-18T01:00:34.5941845Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd
2024-12-18T01:00:34.5943184Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view
2024-12-18T01:00:34.5944462Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload
2024-12-18T01:00:34.5945696Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max
2024-12-18T01:00:34.5946721Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min
2024-12-18T01:00:34.5947746Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product
2024-12-18T01:00:34.5948784Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum
2024-12-18T01:00:34.5949783Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max
2024-12-18T01:00:34.5950756Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min
2024-12-18T01:00:34.5951747Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product
2024-12-18T01:00:34.5952841Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum
2024-12-18T01:00:34.5953788Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max
2024-12-18T01:00:34.5954709Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min
2024-12-18T01:00:34.5955641Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product
2024-12-18T01:00:34.5956655Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda
2024-12-18T01:00:34.5957703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda
2024-12-18T01:00:34.5958680Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum
2024-12-18T01:00:34.5959631Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda
2024-12-18T01:00:34.5960617Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice
2024-12-18T01:00:34.5961607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice
2024-12-18T01:00:34.5962531Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter
2024-12-18T01:00:34.5963528Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks
2024-12-18T01:00:34.5964488Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex
2024-12-18T01:00:34.5965448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda
2024-12-18T01:00:34.5966421Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex
2024-12-18T01:00:34.5967423Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group
2024-12-18T01:00:34.5968397Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group
2024-12-18T01:00:34.5969367Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list
2024-12-18T01:00:34.5970330Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv
2024-12-18T01:00:34.5971295Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source
2024-12-18T01:00:34.5972451Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler
2024-12-18T01:00:34.5973609Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler
2024-12-18T01:00:34.5974720Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler
2024-12-18T01:00:34.5975741Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl
2024-12-18T01:00:34.5976781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler
2024-12-18T01:00:34.5977874Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler
2024-12-18T01:00:34.5978955Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler
2024-12-18T01:00:34.5980037Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag
2024-12-18T01:00:34.5981115Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler
2024-12-18T01:00:34.5982261Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler
2024-12-18T01:00:34.5983342Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum
2024-12-18T01:00:34.5984385Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda
2024-12-18T01:00:34.5985419Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp
2024-12-18T01:00:34.5986444Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu
2024-12-18T01:00:34.6002121Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward
2024-12-18T01:00:34.6003171Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged
2024-12-18T01:00:34.6004336Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters
2024-12-18T01:00:34.6005506Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-12-18T01:00:34.6006678Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-12-18T01:00:34.6007349Z 
2024-12-18T01:00:34.6007598Z Running distributed tests for the gloo backend with file init_method
2024-12-18T01:00:34.6008059Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:00:34.6009210Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:00:34.549441]
2024-12-18T01:21:14.4829468Z 
2024-12-18T01:21:14.4830480Z distributed/test_distributed_spawn 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.1_a471e8f5300fd154_.log
2024-12-18T01:21:14.4993316Z Running 278 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-12-18T01:21:14.5116116Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager
2024-12-18T01:21:14.5117428Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager
2024-12-18T01:21:14.5118511Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class
2024-12-18T01:21:14.5119535Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel
2024-12-18T01:21:14.5120610Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU
2024-12-18T01:21:14.5121954Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view
2024-12-18T01:21:14.5123128Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm
2024-12-18T01:21:14.5124511Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input
2024-12-18T01:21:14.5125781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last
2024-12-18T01:21:14.5127147Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value
2024-12-18T01:21:14.5128575Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient
2024-12-18T01:21:14.5129905Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine
2024-12-18T01:21:14.5131228Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process
2024-12-18T01:21:14.5132534Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half
2024-12-18T01:21:14.5133755Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream
2024-12-18T01:21:14.5135110Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad
2024-12-18T01:21:14.5136339Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view
2024-12-18T01:21:14.5137509Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding
2024-12-18T01:21:14.5138743Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group
2024-12-18T01:21:14.5139831Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync
2024-12-18T01:21:14.5140980Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook
2024-12-18T01:21:14.5142370Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook
2024-12-18T01:21:14.5143624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view
2024-12-18T01:21:14.5144674Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather
2024-12-18T01:21:14.5145791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex
2024-12-18T01:21:14.5146888Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group
2024-12-18T01:21:14.5147977Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group
2024-12-18T01:21:14.5149044Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple
2024-12-18T01:21:14.5150214Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty
2024-12-18T01:21:14.5151266Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex
2024-12-18T01:21:14.5152243Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda
2024-12-18T01:21:14.5153225Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex
2024-12-18T01:21:14.5154250Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group
2024-12-18T01:21:14.5155249Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group
2024-12-18T01:21:14.5156295Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda
2024-12-18T01:21:14.5157415Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda
2024-12-18T01:21:14.5158514Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg
2024-12-18T01:21:14.5159583Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup
2024-12-18T01:21:14.5160589Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda
2024-12-18T01:21:14.5161647Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max
2024-12-18T01:21:14.5162793Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min
2024-12-18T01:21:14.5164034Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product
2024-12-18T01:21:14.5165196Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum
2024-12-18T01:21:14.5166317Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max
2024-12-18T01:21:14.5167417Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min
2024-12-18T01:21:14.5168534Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product
2024-12-18T01:21:14.5169706Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum
2024-12-18T01:21:14.5170786Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max
2024-12-18T01:21:14.5171921Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported
2024-12-18T01:21:14.5173058Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min
2024-12-18T01:21:14.5174124Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product
2024-12-18T01:21:14.5175187Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum
2024-12-18T01:21:14.5176282Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops
2024-12-18T01:21:14.5177440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max
2024-12-18T01:21:14.5178485Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min
2024-12-18T01:21:14.5179555Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product
2024-12-18T01:21:14.5180628Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum
2024-12-18T01:21:14.5181659Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max
2024-12-18T01:21:14.5182662Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min
2024-12-18T01:21:14.5183687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product
2024-12-18T01:21:14.5184711Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum
2024-12-18T01:21:14.5185673Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max
2024-12-18T01:21:14.5186631Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min
2024-12-18T01:21:14.5187604Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product
2024-12-18T01:21:14.5188574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum
2024-12-18T01:21:14.5189553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async
2024-12-18T01:21:14.5190566Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex
2024-12-18T01:21:14.5191574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda
2024-12-18T01:21:14.5192597Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async
2024-12-18T01:21:14.5193639Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex
2024-12-18T01:21:14.5194633Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all
2024-12-18T01:21:14.5195645Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex
2024-12-18T01:21:14.5196622Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda
2024-12-18T01:21:14.5197617Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex
2024-12-18T01:21:14.5198641Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group
2024-12-18T01:21:14.5199676Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda
2024-12-18T01:21:14.5200677Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group
2024-12-18T01:21:14.5201668Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda
2024-12-18T01:21:14.5202723Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split
2024-12-18T01:21:14.5203987Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex
2024-12-18T01:21:14.5205129Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda
2024-12-18T01:21:14.5206295Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex
2024-12-18T01:21:14.5207490Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group
2024-12-18T01:21:14.5208691Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda
2024-12-18T01:21:14.5209858Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group
2024-12-18T01:21:14.5211020Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda
2024-12-18T01:21:14.5212164Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split
2024-12-18T01:21:14.5213300Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex
2024-12-18T01:21:14.5214455Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda
2024-12-18T01:21:14.5215631Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex
2024-12-18T01:21:14.5216845Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group
2024-12-18T01:21:14.5218063Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda
2024-12-18T01:21:14.5219243Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group
2024-12-18T01:21:14.5220424Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda
2024-12-18T01:21:14.5221522Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters
2024-12-18T01:21:14.5222470Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier
2024-12-18T01:21:14.5223473Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda
2024-12-18T01:21:14.5224441Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group
2024-12-18T01:21:14.5225450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda
2024-12-18T01:21:14.5226441Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group
2024-12-18T01:21:14.5227399Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda
2024-12-18T01:21:14.5228425Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group
2024-12-18T01:21:14.5229481Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global
2024-12-18T01:21:14.5230562Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group
2024-12-18T01:21:14.5231578Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo
2024-12-18T01:21:14.5232623Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags
2024-12-18T01:21:14.5233727Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err
2024-12-18T01:21:14.5234797Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl
2024-12-18T01:21:14.5235882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl
2024-12-18T01:21:14.5236979Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err
2024-12-18T01:21:14.5238051Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err
2024-12-18T01:21:14.5239368Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl
2024-12-18T01:21:14.5240483Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl
2024-12-18T01:21:14.5241484Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast
2024-12-18T01:21:14.5242426Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda
2024-12-18T01:21:14.5243486Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group
2024-12-18T01:21:14.5244479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group
2024-12-18T01:21:14.5245471Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list
2024-12-18T01:21:14.5246475Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager
2024-12-18T01:21:14.5247493Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async
2024-12-18T01:21:14.5248677Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger
2024-12-18T01:21:14.5250151Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger
2024-12-18T01:21:14.5251376Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward
2024-12-18T01:21:14.5252539Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false
2024-12-18T01:21:14.5253789Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params
2024-12-18T01:21:14.5254903Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer
2024-12-18T01:21:14.5255958Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook
2024-12-18T01:21:14.5257138Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce
2024-12-18T01:21:14.5258332Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future
2024-12-18T01:21:14.5259500Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping
2024-12-18T01:21:14.5260719Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad
2024-12-18T01:21:14.5261851Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging
2024-12-18T01:21:14.5262878Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph
2024-12-18T01:21:14.5264017Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks
2024-12-18T01:21:14.5265173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks
2024-12-18T01:21:14.5266230Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph
2024-12-18T01:21:14.5267341Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device
2024-12-18T01:21:14.5268349Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization
2024-12-18T01:21:14.5269431Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook
2024-12-18T01:21:14.5270494Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs
2024-12-18T01:21:14.5271525Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized
2024-12-18T01:21:14.5272549Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce
2024-12-18T01:21:14.5273668Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group
2024-12-18T01:21:14.5274808Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD
2024-12-18T01:21:14.5275879Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD
2024-12-18T01:21:14.5276923Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD
2024-12-18T01:21:14.5278038Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg
2024-12-18T01:21:14.5279026Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference
2024-12-18T01:21:14.5280030Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence
2024-12-18T01:21:14.5281062Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu
2024-12-18T01:21:14.5282068Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu
2024-12-18T01:21:14.5283153Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks
2024-12-18T01:21:14.5284357Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks
2024-12-18T01:21:14.5285648Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params
2024-12-18T01:21:14.5286882Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error
2024-12-18T01:21:14.5287948Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple
2024-12-18T01:21:14.5289102Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none
2024-12-18T01:21:14.5290455Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none
2024-12-18T01:21:14.5291729Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params
2024-12-18T01:21:14.5293018Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none
2024-12-18T01:21:14.5294393Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none
2024-12-18T01:21:14.5295576Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd
2024-12-18T01:21:14.5296651Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph
2024-12-18T01:21:14.5297772Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler
2024-12-18T01:21:14.5298879Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace
2024-12-18T01:21:14.5299975Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler
2024-12-18T01:21:14.5301031Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged
2024-12-18T01:21:14.5302073Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks
2024-12-18T01:21:14.5303155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad
2024-12-18T01:21:14.5304260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params
2024-12-18T01:21:14.5305362Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone
2024-12-18T01:21:14.5306398Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types
2024-12-18T01:21:14.5307480Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval
2024-12-18T01:21:14.5308529Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states
2024-12-18T01:21:14.5309574Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception
2024-12-18T01:21:14.5310650Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable
2024-12-18T01:21:14.5311674Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs
2024-12-18T01:21:14.5312832Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn
2024-12-18T01:21:14.5314028Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception
2024-12-18T01:21:14.5315156Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features
2024-12-18T01:21:14.5316171Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group
2024-12-18T01:21:14.5317143Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group
2024-12-18T01:21:14.5318171Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static
2024-12-18T01:21:14.5319257Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks
2024-12-18T01:21:14.5320320Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars
2024-12-18T01:21:14.5321296Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather
2024-12-18T01:21:14.5322218Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks
2024-12-18T01:21:14.5323152Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda
2024-12-18T01:21:14.5324222Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group
2024-12-18T01:21:14.5325187Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group
2024-12-18T01:21:14.5326136Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object
2024-12-18T01:21:14.5327108Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup
2024-12-18T01:21:14.5328085Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend
2024-12-18T01:21:14.5329070Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params
2024-12-18T01:21:14.5330053Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future
2024-12-18T01:21:14.5330968Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank
2024-12-18T01:21:14.5332013Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group
2024-12-18T01:21:14.5333034Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group
2024-12-18T01:21:14.5334105Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync
2024-12-18T01:21:14.5335171Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph
2024-12-18T01:21:14.5336114Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv
2024-12-18T01:21:14.5337009Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend
2024-12-18T01:21:14.5337970Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler
2024-12-18T01:21:14.5339186Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler
2024-12-18T01:21:14.5340383Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang
2024-12-18T01:21:14.5341561Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks
2024-12-18T01:21:14.5342728Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order
2024-12-18T01:21:14.5343795Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo
2024-12-18T01:21:14.5344887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout
2024-12-18T01:21:14.5346026Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup
2024-12-18T01:21:14.5347149Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks
2024-12-18T01:21:14.5348244Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather
2024-12-18T01:21:14.5349315Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce
2024-12-18T01:21:14.5350384Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast
2024-12-18T01:21:14.5351423Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce
2024-12-18T01:21:14.5352477Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream
2024-12-18T01:21:14.5353485Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups
2024-12-18T01:21:14.5354497Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration
2024-12-18T01:21:14.5355697Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size
2024-12-18T01:21:14.5356983Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank
2024-12-18T01:21:14.5358215Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size
2024-12-18T01:21:14.5359464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed
2024-12-18T01:21:14.5360665Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size
2024-12-18T01:21:14.5361874Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module
2024-12-18T01:21:14.5363007Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module
2024-12-18T01:21:14.5364169Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager
2024-12-18T01:21:14.5365264Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group
2024-12-18T01:21:14.5366394Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity
2024-12-18T01:21:14.5367624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view
2024-12-18T01:21:14.5368985Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd
2024-12-18T01:21:14.5370311Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view
2024-12-18T01:21:14.5371585Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload
2024-12-18T01:21:14.5372673Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max
2024-12-18T01:21:14.5373701Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min
2024-12-18T01:21:14.5374745Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product
2024-12-18T01:21:14.5375782Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum
2024-12-18T01:21:14.5376781Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max
2024-12-18T01:21:14.5377753Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min
2024-12-18T01:21:14.5378891Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product
2024-12-18T01:21:14.5379887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum
2024-12-18T01:21:14.5380843Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max
2024-12-18T01:21:14.5381764Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min
2024-12-18T01:21:14.5382700Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product
2024-12-18T01:21:14.5383714Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda
2024-12-18T01:21:14.5384750Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda
2024-12-18T01:21:14.5385708Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum
2024-12-18T01:21:14.5386723Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda
2024-12-18T01:21:14.5387715Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice
2024-12-18T01:21:14.5388703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice
2024-12-18T01:21:14.5389641Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter
2024-12-18T01:21:14.5390571Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks
2024-12-18T01:21:14.5391531Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex
2024-12-18T01:21:14.5392471Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda
2024-12-18T01:21:14.5393442Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex
2024-12-18T01:21:14.5394502Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group
2024-12-18T01:21:14.5395474Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group
2024-12-18T01:21:14.5396450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list
2024-12-18T01:21:14.5397407Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv
2024-12-18T01:21:14.5398369Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source
2024-12-18T01:21:14.5399448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler
2024-12-18T01:21:14.5400593Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler
2024-12-18T01:21:14.5401705Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler
2024-12-18T01:21:14.5402717Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl
2024-12-18T01:21:14.5403836Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler
2024-12-18T01:21:14.5404945Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler
2024-12-18T01:21:14.5406017Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler
2024-12-18T01:21:14.5407041Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag
2024-12-18T01:21:14.5408107Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler
2024-12-18T01:21:14.5409250Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler
2024-12-18T01:21:14.5410324Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum
2024-12-18T01:21:14.5411366Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda
2024-12-18T01:21:14.5412410Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp
2024-12-18T01:21:14.5413480Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu
2024-12-18T01:21:14.5414517Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward
2024-12-18T01:21:14.5415522Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged
2024-12-18T01:21:14.5416577Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters
2024-12-18T01:21:14.5417739Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
2024-12-18T01:21:14.5418900Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger
2024-12-18T01:21:14.5419553Z 
2024-12-18T01:21:14.5419838Z Running distributed/checkpoint/test_format_utils 1/1 ... [2024-12-18 01:21:14.491720]
2024-12-18T01:21:14.5420359Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:21:14.5421573Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_format_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:21:14.492179]
2024-12-18T01:21:31.2968248Z 
2024-12-18T01:21:31.2969423Z distributed/checkpoint/test_format_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_format_utils_1.1_46e5a7c8ab223385_.log
2024-12-18T01:21:31.2971519Z Running 3 items in this shard: test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_dcp_to_torch_save, test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_online_torch_save_to_dcp, test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_torch_save_to_dcp
2024-12-18T01:21:31.2972940Z 
2024-12-18T01:21:31.2975340Z Running distributed/_tensor/debug/test_comm_mode_features 1/1 ... [2024-12-18 01:21:31.297359]
2024-12-18T01:21:31.2975899Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:21:31.2980604Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode_features.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:21:31.297844]
2024-12-18T01:21:52.2121712Z 
2024-12-18T01:21:52.2123704Z distributed/_tensor/debug/test_comm_mode_features 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_fd3da6d695954def_.log
2024-12-18T01:21:52.2128676Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLPStacked_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_module_tracing, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_transformer_module_tracing
2024-12-18T01:21:52.2132204Z 
2024-12-18T01:21:52.2132587Z Running distributed/algorithms/quantization/test_quantization 1/1 ... [2024-12-18 01:21:52.212656]
2024-12-18T01:21:52.2210490Z MPI not available -- MPI backend tests will be skipped
2024-12-18T01:21:52.2211827Z Running distributed tests for the test backend with env init_method
2024-12-18T01:21:52.2214429Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:21:52.2220582Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:21:52.221811]
2024-12-18T01:21:56.0648982Z 
2024-12-18T01:21:56.0650259Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_c0ecaa615beb2841_.log
2024-12-18T01:21:56.0651376Z Running 0 items in this shard:
2024-12-18T01:21:56.0651571Z 
2024-12-18T01:21:56.0657482Z Running distributed tests for the test backend with file init_method
2024-12-18T01:21:56.0661134Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:21:56.0664151Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:21:56.066181]
2024-12-18T01:21:59.9219290Z 
2024-12-18T01:21:59.9220694Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_7dec386a2bd8f8f1_.log
2024-12-18T01:21:59.9222232Z Running 0 items in this shard:
2024-12-18T01:21:59.9222426Z 
2024-12-18T01:21:59.9228403Z Running distributed tests for the gloo backend with env init_method
2024-12-18T01:21:59.9230296Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:21:59.9234600Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:21:59.923229]
2024-12-18T01:22:27.7488026Z 
2024-12-18T01:22:27.7489710Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_882ebb87d3573109_.log
2024-12-18T01:22:27.7494299Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16
2024-12-18T01:22:27.7497958Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16
2024-12-18T01:22:27.7499217Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16
2024-12-18T01:22:27.7500539Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16
2024-12-18T01:22:27.7501751Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16
2024-12-18T01:22:27.7502959Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16
2024-12-18T01:22:27.7504268Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16
2024-12-18T01:22:27.7504986Z 
2024-12-18T01:22:27.7505223Z Running distributed tests for the gloo backend with file init_method
2024-12-18T01:22:27.7505665Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:22:27.7507186Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:22:27.750276]
2024-12-18T01:22:55.5603563Z 
2024-12-18T01:22:55.5605356Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_bf35ad6835ee27f4_.log
2024-12-18T01:22:55.5609761Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16
2024-12-18T01:22:55.5614035Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16
2024-12-18T01:22:55.5615323Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16
2024-12-18T01:22:55.5616594Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16
2024-12-18T01:22:55.5618028Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16
2024-12-18T01:22:55.5619280Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16
2024-12-18T01:22:55.5620623Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16
2024-12-18T01:22:55.5621340Z 
2024-12-18T01:22:55.5621657Z Running distributed/checkpoint/e2e/test_fine_tuning 1/1 ... [2024-12-18 01:22:55.561595]
2024-12-18T01:22:55.5622279Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:22:55.5623539Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fine_tuning.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:22:55.562089]
2024-12-18T01:22:59.8431797Z 
2024-12-18T01:22:59.8433206Z distributed/checkpoint/e2e/test_fine_tuning 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fine_tuning_1.1_2b2ae656959de62d_.log
2024-12-18T01:22:59.8434569Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fine_tuning.py::TestFineTuning::test_fine_tuning
2024-12-18T01:22:59.8435109Z 
2024-12-18T01:22:59.8438709Z Running distributed/_tensor/experimental/test_tp_transform 1/1 ... [2024-12-18 01:22:59.843658]
2024-12-18T01:22:59.8439258Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:22:59.8444463Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/experimental/test_tp_transform.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:22:59.844185]
2024-12-18T01:23:18.8566375Z 
2024-12-18T01:23:18.8567676Z distributed/_tensor/experimental/test_tp_transform 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_tp_transform_1.1_2cf192f05e921fa4_.log
2024-12-18T01:23:18.8570384Z Running 3 items in this shard: test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_e2e, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_no_bias, test/distributed/_tensor/experimental/test_tp_transform.py::TensorParallelTest::test_tp_transform_with_uncovered_op
2024-12-18T01:23:18.8572207Z 
2024-12-18T01:23:18.8572744Z Running distributed/checkpoint/e2e/test_pipeline 1/1 ... [2024-12-18 01:23:18.857088]
2024-12-18T01:23:18.8573337Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:18.8577880Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/e2e/test_pipeline.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:18.857561]
2024-12-18T01:23:23.1388795Z 
2024-12-18T01:23:23.1390104Z distributed/checkpoint/e2e/test_pipeline 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_pipeline_1.1_e7fe79eb7e7d6fdf_.log
2024-12-18T01:23:23.1391683Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_pipeline.py::TestPipeline::test_pipeline
2024-12-18T01:23:23.1392184Z 
2024-12-18T01:23:23.1396423Z Running distributed/checkpoint/test_traverse 1/1 ... [2024-12-18 01:23:23.139431]
2024-12-18T01:23:23.1396940Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:23.1401656Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_traverse.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:23.139919]
2024-12-18T01:23:27.4178965Z 
2024-12-18T01:23:27.4180209Z distributed/checkpoint/test_traverse 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_traverse_1.1_9b80483cae108ae5_.log
2024-12-18T01:23:27.4183803Z Running 7 items in this shard: test/distributed/checkpoint/test_traverse.py::TestTraverse::test_get_element, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_set_element, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_traverse_doesnt_ignore_intermediate_collections, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_traverse_nested_dict, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_traverse_nested_list, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_traverse_shallow, test/distributed/checkpoint/test_traverse.py::TestTraverse::test_traverse_with_ordered_dict
2024-12-18T01:23:27.4186793Z 
2024-12-18T01:23:27.4187124Z Running distributed/tensor/parallel/test_tp_random_state 1/1 ... [2024-12-18 01:23:27.418265]
2024-12-18T01:23:27.4187683Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:27.4190149Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_random_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:27.418741]
2024-12-18T01:23:35.9554802Z 
2024-12-18T01:23:35.9556036Z distributed/tensor/parallel/test_tp_random_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_799493e6077067c3_.log
2024-12-18T01:23:35.9557497Z Running 1 items in this shard: test/distributed/tensor/parallel/test_tp_random_state.py::TensorParallelRandomStateTests::test_model_init
2024-12-18T01:23:35.9558118Z 
2024-12-18T01:23:35.9561113Z Running distributed/checkpoint/test_dtensor_checkpoint 1/1 ... [2024-12-18 01:23:35.955925]
2024-12-18T01:23:35.9561661Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:35.9566974Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:35.956418]
2024-12-18T01:23:44.8438011Z 
2024-12-18T01:23:44.8439523Z distributed/checkpoint/test_dtensor_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_checkpoint_1.1_8d303b9e1f9096c9_.log
2024-12-18T01:23:44.8441064Z Running 1 items in this shard: test/distributed/checkpoint/test_dtensor_checkpoint.py::DTensorPlanner::test_distributed_tensor_planner
2024-12-18T01:23:44.8441727Z 
2024-12-18T01:23:44.8445277Z Running distributed/_composable/test_replicate_with_compiler 1/1 ... [2024-12-18 01:23:44.844315]
2024-12-18T01:23:44.8445840Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:44.8450491Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_replicate_with_compiler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:44.844808]
2024-12-18T01:23:49.2733776Z 
2024-12-18T01:23:49.2735029Z distributed/_composable/test_replicate_with_compiler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_replicate_with_compiler_1.1_11bc81c5d996444d_.log
2024-12-18T01:23:49.2754507Z Running 10 items in this shard: test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_bucketing_coalesced_op, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_bucketing_concat_op, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_backward_only, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_bf16, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_cpu, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_cpu_no_sync, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_fp16, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_gpu, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_gpu_ac, test/distributed/_composable/test_replicate_with_compiler.py::DDP_TP_Test::test_ddp_tp
2024-12-18T01:23:49.2761772Z 
2024-12-18T01:23:49.2762354Z Running distributed/checkpoint/test_tp_checkpoint 1/1 ... [2024-12-18 01:23:49.273881]
2024-12-18T01:23:49.2763229Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:23:49.2765291Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_tp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:23:49.274359]
2024-12-18T01:24:02.3709322Z 
2024-12-18T01:24:02.3710647Z distributed/checkpoint/test_tp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_tp_checkpoint_1.1_b8b8d9e70625870b_.log
2024-12-18T01:24:02.3712458Z Running 2 items in this shard: test/distributed/checkpoint/test_tp_checkpoint.py::TestTpCheckpoint::test_tp_checkpoint, test/distributed/checkpoint/test_tp_checkpoint.py::TestTpCheckpoint::test_tp_checkpoint_load_on_meta_device
2024-12-18T01:24:02.3713496Z 
2024-12-18T01:24:02.3715926Z Running distributed/_composable/fsdp/test_fully_shard_overlap 1/1 ... [2024-12-18 01:24:02.371400]
2024-12-18T01:24:02.3716498Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:02.3720858Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:02.371867]
2024-12-18T01:24:06.7525199Z 
2024-12-18T01:24:06.7526711Z distributed/_composable/fsdp/test_fully_shard_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_overlap_1.1_98543208f92d59b1_.log
2024-12-18T01:24:06.7528785Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_post_optim_event_overlap, test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_training_overlap
2024-12-18T01:24:06.7529978Z 
2024-12-18T01:24:06.7531849Z Running distributed/test_collective_utils 1/1 ... [2024-12-18 01:24:06.752990]
2024-12-18T01:24:06.7532341Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:06.7537294Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_collective_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:06.753506]
2024-12-18T01:24:10.6105334Z 
2024-12-18T01:24:10.6106387Z distributed/test_collective_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_collective_utils_1.1_51364855190b7737_.log
2024-12-18T01:24:10.6107160Z 
2024-12-18T01:24:10.6111816Z Running distributed/checkpoint/test_planner 1/1 ... [2024-12-18 01:24:10.610993]
2024-12-18T01:24:10.6112304Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:10.6117280Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_planner.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:10.611514]
2024-12-18T01:24:15.0399359Z 
2024-12-18T01:24:15.0401157Z distributed/checkpoint/test_planner 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_planner_1.1_59a19f6dad73f0f0_.log
2024-12-18T01:24:15.0408245Z Running 8 items in this shard: test/distributed/checkpoint/test_planner.py::TestSavePlan::test_global_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_resharding, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_world_size_diff_by_one, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_load_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_plan, test/distributed/checkpoint/test_planner.py::TestPlannerHelpers::test_create_read_item_from_chunks, test/distributed/checkpoint/test_planner.py::TestLoadPlanner::test_load_different_sizes_throws, test/distributed/checkpoint/test_planner.py::TestLoadPlanner::test_strict
2024-12-18T01:24:15.0413680Z 
2024-12-18T01:24:15.0414334Z Running distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 ... [2024-12-18 01:24:15.040732]
2024-12-18T01:24:15.0415260Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:15.0417448Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:15.041377]
2024-12-18T01:24:23.7804834Z 
2024-12-18T01:24:23.7806404Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_64c33e7bf176c68b_.log
2024-12-18T01:24:23.7808003Z Running 1 items in this shard: test/distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py::TestFsdpTpCheckpointConversion::test_fsdp_to_tp
2024-12-18T01:24:23.7808679Z 
2024-12-18T01:24:23.7811417Z Running distributed/checkpoint/test_state_dict_utils 1/1 ... [2024-12-18 01:24:23.780930]
2024-12-18T01:24:23.7812027Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:23.7816665Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_state_dict_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:23.781385]
2024-12-18T01:24:28.1599884Z 
2024-12-18T01:24:28.1601289Z distributed/checkpoint/test_state_dict_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_utils_1.1_3346a4a47a307d46_.log
2024-12-18T01:24:28.1605020Z Running 6 items in this shard: test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_complicated_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_cpu_and_ranks_only, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_create_cpu_state_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_state_dict_dtensor, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_with_cpu_and_ranks_only, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_state_dict_util_distribute_tensors
2024-12-18T01:24:28.1608652Z 
2024-12-18T01:24:28.1608910Z Running distributed/fsdp/test_shard_utils 1/1 ... [2024-12-18 01:24:28.160415]
2024-12-18T01:24:28.1609465Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:28.1611038Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_shard_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:28.160875]
2024-12-18T01:24:40.6046867Z 
2024-12-18T01:24:40.6047967Z distributed/fsdp/test_shard_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_shard_utils_1.1_ccc7509dd1d77232_.log
2024-12-18T01:24:40.6049935Z Running 2 items in this shard: test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributed::test_create_chunk_sharded_tensor, test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributedDTensor::test_create_chunk_dtensor
2024-12-18T01:24:40.6051091Z 
2024-12-18T01:24:40.6052310Z Running distributed/checkpoint/test_compatibility 1/1 ... [2024-12-18 01:24:40.605042]
2024-12-18T01:24:40.6052853Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:40.6057435Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_compatibility.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:40.605522]
2024-12-18T01:24:44.9842132Z 
2024-12-18T01:24:44.9843360Z distributed/checkpoint/test_compatibility 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_compatibility_1.1_6ff8050bf90327be_.log
2024-12-18T01:24:44.9845957Z Running 4 items in this shard: test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_metadata, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_sharded_tensor_dependency, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_storage_meta, test/distributed/checkpoint/test_compatibility.py::TestDCPCompatbility::test_with_v_2_3
2024-12-18T01:24:44.9847886Z 
2024-12-18T01:24:44.9848210Z Running distributed/checkpoint/test_hsdp_checkpoint 1/1 ... [2024-12-18 01:24:44.984586]
2024-12-18T01:24:44.9848747Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:24:44.9853063Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_hsdp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:24:44.985062]
2024-12-18T01:25:06.0501797Z 
2024-12-18T01:25:06.0503983Z distributed/checkpoint/test_hsdp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_hsdp_checkpoint_1.1_7039de7d13665679_.log
2024-12-18T01:25:06.0509571Z Running 4 items in this shard: test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_checkpoint_is_even_sharded_model_False, test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_checkpoint_is_even_sharded_model_True, test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_fsdp_checkpoint_conversion_is_even_sharded_model_False, test/distributed/checkpoint/test_hsdp_checkpoint.py::TestHSDPCheckpoint::test_hsdp_fsdp_checkpoint_conversion_is_even_sharded_model_True
2024-12-18T01:25:06.0512141Z 
2024-12-18T01:25:06.0512487Z Running distributed/test_functional_api 1/1 ... [2024-12-18 01:25:06.050670]
2024-12-18T01:25:06.0513111Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:25:06.0514514Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_functional_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:25:06.051222]
2024-12-18T01:25:10.5299749Z 
2024-12-18T01:25:10.5301327Z distributed/test_functional_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_functional_api_1.1_e105a7814f93e6cb_.log
2024-12-18T01:25:10.5304020Z Running 2 items in this shard: test/distributed/test_functional_api.py::TestMetaCollectives::test_all_reduce, test/distributed/test_functional_api.py::TestMakeFx::test_all_reduce_tracing
2024-12-18T01:25:10.5305536Z 
2024-12-18T01:25:10.5306438Z Running distributed/_composable/fsdp/test_fully_shard_state 1/1 ... [2024-12-18 01:25:10.530434]
2024-12-18T01:25:10.5307416Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:25:10.5313277Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:25:10.530966]
2024-12-18T01:25:14.9098978Z 
2024-12-18T01:25:14.9100209Z distributed/_composable/fsdp/test_fully_shard_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_66b7ff74ebd540fd_.log
2024-12-18T01:25:14.9103475Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_cls, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_deepcopy, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_reapply, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_state, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_unsupported_module_cls
2024-12-18T01:25:14.9106035Z 
2024-12-18T01:25:14.9106310Z Running distributed/test_control_collectives 1/1 ... [2024-12-18 01:25:14.910372]
2024-12-18T01:25:14.9106816Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:25:14.9111022Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_control_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:25:14.910863]
2024-12-18T01:25:19.3397170Z 
2024-12-18T01:25:19.3398301Z distributed/test_control_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_control_collectives_1.1_26c0a86ab03b8904_.log
2024-12-18T01:25:19.3404149Z Running 13 items in this shard: test/distributed/test_control_collectives.py::TestCollectives::test_all_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_barrier, test/distributed/test_control_collectives.py::TestCollectives::test_barrier_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_gather, test/distributed/test_control_collectives.py::TestCollectives::test_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_scatter, test/distributed/test_control_collectives.py::TestCollectives::test_scatter_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_simple_user_func, test/distributed/test_control_collectives.py::TestCollectives::test_unique
2024-12-18T01:25:19.3409178Z 
2024-12-18T01:25:19.3409471Z Running distributed/_tensor/debug/test_comm_mode 1/1 ... [2024-12-18 01:25:19.340184]
2024-12-18T01:25:19.3410109Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:25:19.3411241Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:25:19.340696]
2024-12-18T01:25:23.7688774Z 
2024-12-18T01:25:23.7689871Z distributed/_tensor/debug/test_comm_mode 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_1.1_38108357c18f0a56_.log
2024-12-18T01:25:23.7692191Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_coalesced, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_c10d, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_dtensor
2024-12-18T01:25:23.7694128Z 
2024-12-18T01:25:23.7694411Z Running distributed/_composable/test_replicate 1/1 ... [2024-12-18 01:25:23.769191]
2024-12-18T01:25:23.7694919Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:25:23.7699287Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_replicate.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:25:23.769690]
2024-12-18T01:26:37.2658018Z 
2024-12-18T01:26:37.2659182Z distributed/_composable/test_replicate 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_replicate_1.1_f66208d9928fbbde_.log
2024-12-18T01:26:37.2667991Z Running 17 items in this shard: test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_non_root_multiple_save_load, test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_single_module_save_load, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_device_id, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_ignore_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_move_args_kwargs_to_device, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_multi_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_single_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_with_kwargs, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_wrong_device_id_type, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_device_id, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_fully_shard_init, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_ignore_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_move_args_kwargs_to_device, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_multi_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_single_module, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_with_kwargs, test/distributed/_composable/test_replicate.py::ReplicateFullyShardInit::test_replicate_wrong_device_id_type
2024-12-18T01:26:37.2675716Z 
2024-12-18T01:26:37.2676050Z Running distributed/optim/test_apply_optimizer_in_backward 1/1 ... [2024-12-18 01:26:37.266323]
2024-12-18T01:26:37.2676609Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:26:37.2677790Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/optim/test_apply_optimizer_in_backward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:37.266808]
2024-12-18T01:26:40.2394564Z 
2024-12-18T01:26:40.2396159Z distributed/optim/test_apply_optimizer_in_backward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_apply_optimizer_in_backward_1.1_d046b652893032b8_.log
2024-12-18T01:26:40.2397097Z 
2024-12-18T01:26:40.2401056Z Running distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1 ... [2024-12-18 01:26:40.239881]
2024-12-18T01:26:40.2401749Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:26:40.2406446Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_grad_scaler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:40.240374]
2024-12-18T01:26:48.6751204Z 
2024-12-18T01:26:48.6752537Z distributed/_composable/fsdp/test_fully_shard_grad_scaler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_grad_scaler_1.1_0e5328a2d38d584a_.log
2024-12-18T01:26:48.6754209Z Running 1 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_grad_scaler.py::TestFullyShardGradientScaler::test_gradient_scaler
2024-12-18T01:26:48.6754854Z 
2024-12-18T01:26:48.6757138Z Running distributed/checkpoint/test_utils 1/1 ... [2024-12-18 01:26:48.675513]
2024-12-18T01:26:48.6757634Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:26:48.6762513Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:48.676045]
2024-12-18T01:26:53.0546480Z 
2024-12-18T01:26:53.0548208Z distributed/checkpoint/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_utils_1.1_eea41e2f6b9edc9f_.log
2024-12-18T01:26:53.0553887Z Running 6 items in this shard: test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_dcp_logger, test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_flat_data, test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_index_hint_ignored_on_equals, test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_index_hint_ignored_on_hash, test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_init_convert_offset, test/distributed/checkpoint/test_utils.py::TestMedatadaIndex::test_sharded_tensor_lookup
2024-12-18T01:26:53.0558232Z 
2024-12-18T01:26:53.0558686Z Running distributed/_tensor/test_utils 1/1 ... [2024-12-18 01:26:53.055332]
2024-12-18T01:26:53.0559371Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:26:53.0563242Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:26:53.055970]
2024-12-18T01:27:52.1620764Z 
2024-12-18T01:27:52.1622357Z distributed/_tensor/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_utils_1.1_6826c30d4d2a1680_.log
2024-12-18T01:27:52.1630663Z Running 10 items in this shard: test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_1D, test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_2D, test/distributed/_tensor/test_utils.py::UtilTest::test_fsdp_tp_meta_compute, test/distributed/_tensor/test_utils.py::UtilTest::test_hsdp_tp_meta_compute, test/distributed/_tensor/test_utils.py::UtilTest::test_strided_sharding_assumption_in_meta_compute, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_1d_mesh_strided_sharding, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_2d_mesh_2d_tensor_strided_sharding, test/distributed/_tensor/test_utils.py::TestStridedSharding::test_2d_mesh_strided_sharding, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp1_tp_2d_dtensor_local_shards_and_offsets, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp2_tp_2d_dtensor_local_shards_and_offsets
2024-12-18T01:27:52.1635776Z 
2024-12-18T01:27:52.1636098Z Running distributed/pipelining/test_schedule 1/1 ... [2024-12-18 01:27:52.162876]
2024-12-18T01:27:52.1636597Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:27:52.1637723Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/pipelining/test_schedule.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:27:52.163441]
2024-12-18T01:28:36.8010483Z 
2024-12-18T01:28:36.8011992Z distributed/pipelining/test_schedule 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_schedule_1.1_2ed10832d329c74f_.log
2024-12-18T01:28:36.8028487Z Running 28 items in this shard: test/distributed/pipelining/test_schedule.py::ScheduleTest::test_get_schedule_class, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass0, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass1, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass2, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass3, test/distributed/pipelining/test_schedule.py::ScheduleTest::test_schedule_with_single_stage_ScheduleClass4, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass1, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_flex_and_zero_bubble_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_flex_and_zero_bubble_ScheduleClass1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref2, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref3, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref4, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref5, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref6, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref7, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_csv_csv_name_zb1p_2rank_2stagep, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_grad_with_split_b_w, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_grad_with_v_schedule, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_merge_bw_test_info0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_send_recv_test_info0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_send_recv_test_info1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_unshard_reshard_test_info0, test/distributed/pipelining/test_schedule.py::TestValidateSchedule::test_invalid_schedule_missing_action, test/distributed/pipelining/test_schedule.py::TestValidateSchedule::test_invalid_schedule_missing_rank, test/distributed/pipelining/test_schedule.py::TestValidateSchedule::test_valid_schedule
2024-12-18T01:28:36.8041465Z 
2024-12-18T01:28:36.8041742Z Running distributed/_tensor/test_op_strategy 1/1 ... [2024-12-18 01:28:36.801607]
2024-12-18T01:28:36.8042240Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:28:36.8043424Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_tensor/test_op_strategy.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:28:36.802125]
2024-12-18T01:28:41.3307976Z 
2024-12-18T01:28:41.3309080Z distributed/_tensor/test_op_strategy 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_op_strategy_1.1_8e9c3368d3eded9a_.log
2024-12-18T01:28:41.3315321Z Running 15 items in this shard: test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_batch_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_bmm_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_free_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumDims::test_mm_dims, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_bmm_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_bmm_2d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_linearity_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_mm_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_mm_2d_mesh, test/distributed/_tensor/test_op_strategy.py::TestEinsumStrategies::test_pointwise_1d_mesh, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_bmm_strategies, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_mm_strategies, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_latency, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_mesh_1d, test/distributed/_tensor/test_op_strategy.py::TestCostModel::test_redistribute_cost_mesh_2d
2024-12-18T01:28:41.3321032Z 
2024-12-18T01:28:41.3321353Z Running distributed/checkpoint/test_fsdp_model_state 1/1 ... [2024-12-18 01:28:41.331245]
2024-12-18T01:28:41.3321876Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:28:41.3323015Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_model_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:28:41.331731]
2024-12-18T01:28:54.0280322Z 
2024-12-18T01:28:54.0281693Z distributed/checkpoint/test_fsdp_model_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_model_state_1.1_2a3301ab4ad4abe3_.log
2024-12-18T01:28:54.0284039Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_no_resharding, test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_with_resharding
2024-12-18T01:28:54.0285447Z 
2024-12-18T01:28:54.0286909Z Running distributed/_composable/fsdp/test_fully_shard_comm 1/1 ... [2024-12-18 01:28:54.028433]
2024-12-18T01:28:54.0287450Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:28:54.0291586Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_comm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:28:54.028921]
2024-12-18T01:28:58.4574364Z 
2024-12-18T01:28:58.4575563Z distributed/_composable/fsdp/test_fully_shard_comm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_comm_1.1_7c890dc2716084fc_.log
2024-12-18T01:28:58.4584638Z Running 15 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_all_gather_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp16, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_fully_shard_communication_count, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_manual_reshard_with_reshard_after_forward_false, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_set_reduce_scatter_divide_factor, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_backward_misprefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_unused_module, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_forward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiProcess::test_unshard_async, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_no_param_group, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_without_lazy_init
2024-12-18T01:28:58.4593607Z 
2024-12-18T01:28:58.4593943Z Running distributed/rpc/test_share_memory 1/1 ... [2024-12-18 01:28:58.457921]
2024-12-18T01:28:58.4594456Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:28:58.4595684Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_share_memory.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:28:58.458402]
2024-12-18T01:29:11.3037960Z 
2024-12-18T01:29:11.3039826Z distributed/rpc/test_share_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_share_memory_1.1_cf1dbc97115754ca_.log
2024-12-18T01:29:11.3041972Z Running 1 items in this shard: test/distributed/rpc/test_share_memory.py::TestRPCPickler::test_case
2024-12-18T01:29:11.3043518Z Running 1 items in this shard: test/distributed/rpc/test_share_memory.py::TestRPCPickler::test_case
2024-12-18T01:29:11.3044388Z 
2024-12-18T01:29:11.3048070Z Running distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 ... [2024-12-18 01:29:11.304571]
2024-12-18T01:29:11.3049344Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:11.3054667Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:11.305143]
2024-12-18T01:29:15.7844958Z 
2024-12-18T01:29:15.7846346Z distributed/fsdp/test_fsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_dtensor_state_dict_1.1_787da1ab9344b468_.log
2024-12-18T01:29:15.7847337Z Running 0 items in this shard:
2024-12-18T01:29:15.7847546Z 
2024-12-18T01:29:15.7851202Z Running distributed/checkpoint/test_checkpoint 1/1 ... [2024-12-18 01:29:15.784913]
2024-12-18T01:29:15.7851731Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:15.7856543Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:15.785406]
2024-12-18T01:29:28.7848759Z 
2024-12-18T01:29:28.7850217Z distributed/checkpoint/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_checkpoint_1.1_72a28e5bd67f18c9_.log
2024-12-18T01:29:28.7854791Z Running 8 items in this shard: test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_default_metadata, test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_tensor_metadata_with_missing_rank_spec, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_reader_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_writer_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling_no_dist, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling_no_dist
2024-12-18T01:29:28.7859086Z 
2024-12-18T01:29:28.7859360Z Running distributed/nn/jit/test_instantiator 1/1 ... [2024-12-18 01:29:28.785376]
2024-12-18T01:29:28.7859969Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:28.7861498Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/nn/jit/test_instantiator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:28.785879]
2024-12-18T01:29:33.0142647Z 
2024-12-18T01:29:33.0144074Z distributed/nn/jit/test_instantiator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.nn.jit.test_instantiator_1.1_2bb2a6c4edf6a91b_.log
2024-12-18T01:29:33.0146386Z Running 3 items in this shard: test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_get_arg_return_types_from_interface, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_non_scripted_remote_module_template, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_scripted_remote_module_template
2024-12-18T01:29:33.0147955Z 
2024-12-18T01:29:33.0149830Z Running distributed/fsdp/test_fsdp_backward_prefetch 1/1 ... [2024-12-18 01:29:33.014737]
2024-12-18T01:29:33.0150456Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:33.0154855Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_backward_prefetch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:33.015228]
2024-12-18T01:29:41.4001629Z 
2024-12-18T01:29:41.4002799Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_d4582a83dbf216ec_.log
2024-12-18T01:29:41.4004251Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_backward_prefetch.py::TestBackwardPrefetch::test_backward_prefetch
2024-12-18T01:29:41.4004828Z 
2024-12-18T01:29:41.4007112Z Running distributed/fsdp/test_fsdp_pure_fp16 1/1 ... [2024-12-18 01:29:41.400518]
2024-12-18T01:29:41.4007763Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:41.4012105Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_pure_fp16.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:41.400968]
2024-12-18T01:29:45.6786983Z 
2024-12-18T01:29:45.6788083Z distributed/fsdp/test_fsdp_pure_fp16 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_pure_fp16_1.1_3d5041c088148df7_.log
2024-12-18T01:29:45.6789343Z Running 0 items in this shard:
2024-12-18T01:29:45.6789551Z 
2024-12-18T01:29:45.6793541Z Running distributed/test_c10d_object_collectives 1/1 ... [2024-12-18 01:29:45.679150]
2024-12-18T01:29:45.6794056Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:29:45.6798532Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_object_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:29:45.679619]
2024-12-18T01:30:27.6930583Z 
2024-12-18T01:30:27.6932110Z distributed/test_c10d_object_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_object_collectives_1.1_57afe03e107f6ed8_.log
2024-12-18T01:30:27.6937001Z Running 9 items in this shard: test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_broadcast_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_scatter_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_send_recv_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_broadcast_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_scatter_object
2024-12-18T01:30:27.6941694Z 
2024-12-18T01:30:27.6942038Z Running distributed/fsdp/test_fsdp_memory 1/1 ... [2024-12-18 01:30:27.693567]
2024-12-18T01:30:27.6942823Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:30:27.6944181Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:30:27.694108]
2024-12-18T01:30:39.8350572Z 
2024-12-18T01:30:39.8351838Z distributed/fsdp/test_fsdp_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_memory_1.1_35e2ac25f2e58c27_.log
2024-12-18T01:30:39.8353430Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_memory.py::TestFSDPMemory::test_fsdp_memory_ckpt_ckpt, test/distributed/fsdp/test_fsdp_memory.py::TestFSDPMemory::test_fsdp_memory_ckpt_no_ckpt
2024-12-18T01:30:39.8354302Z 
2024-12-18T01:30:39.8357680Z Running distributed/_composable/fsdp/test_fully_shard_frozen 1/1 ... [2024-12-18 01:30:39.835538]
2024-12-18T01:30:39.8358277Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:30:39.8362824Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_frozen.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:30:39.836022]
2024-12-18T01:30:44.1139494Z 
2024-12-18T01:30:44.1140681Z distributed/_composable/fsdp/test_fully_shard_frozen 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_frozen_1.1_88ed50fb3b87503b_.log
2024-12-18T01:30:44.1143394Z Running 3 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_multi_forward_mixed_requires_grad, test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_train_mixed_requires_grad_across_groups, test/distributed/_composable/fsdp/test_fully_shard_frozen.py::TestFullyShardFrozen::test_train_mixed_requires_grad_per_group
2024-12-18T01:30:44.1145687Z 
2024-12-18T01:30:44.1146029Z Running distributed/checkpoint/test_file_system_checkpoint 1/1 ... [2024-12-18 01:30:44.114354]
2024-12-18T01:30:44.1146589Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:30:44.1152838Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_file_system_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:30:44.114914]
2024-12-18T01:30:48.3930115Z 
2024-12-18T01:30:48.3932116Z distributed/checkpoint/test_file_system_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_file_system_checkpoint_1.1_da3a76da08f79538_.log
2024-12-18T01:30:48.3940417Z Running 6 items in this shard: test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_save_load_bytes, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor
2024-12-18T01:30:48.3946421Z 
2024-12-18T01:30:48.3946891Z Running distributed/test_c10d_pypg 1/1 ... [2024-12-18 01:30:48.393742]
2024-12-18T01:30:48.3947681Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:30:48.3949178Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_pypg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:30:48.394409]
2024-12-18T01:30:52.8728023Z 
2024-12-18T01:30:52.8729095Z distributed/test_c10d_pypg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_pypg_1.1_36de502d5281ddf3_.log
2024-12-18T01:30:52.8748810Z Running 43 items in this shard: test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_dataclass_output, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_dataclass_output_unused_param, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_invoke_work_object, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_with_pypg, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_with_pypg_with_grad_views, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_invalid_powerSGD_state, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_sync_batch_norm_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_dataclass_output, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_dataclass_output_unused_param, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_invoke_work_object, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_with_pypg, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_with_pypg_with_grad_views, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_invalid_powerSGD_state, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_sync_batch_norm_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_pypg.py::TestPyProcessGroup::test_attr_overrides
2024-12-18T01:30:52.8767713Z 
2024-12-18T01:30:52.8768054Z Running distributed/tensor/parallel/test_parallelize_api 1/1 ... [2024-12-18 01:30:52.873320]
2024-12-18T01:30:52.8768686Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:30:52.8769867Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/tensor/parallel/test_parallelize_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:30:52.873826]
2024-12-18T01:31:47.7138177Z 
2024-12-18T01:31:47.7139838Z distributed/tensor/parallel/test_parallelize_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_parallelize_api_1.1_69d397719a7fa458_.log
2024-12-18T01:31:47.7147470Z Running 12 items in this shard: test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_empty_plan, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_col_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_row_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api_nested, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_multi_wildcard, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_digit, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_question, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_star, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_input, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_output, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_under_devicemesh_context
2024-12-18T01:31:47.7154701Z 
2024-12-18T01:31:47.7154977Z Running distributed/fsdp/test_fsdp_apply 1/1 ... [2024-12-18 01:31:47.714376]
2024-12-18T01:31:47.7155450Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:31:47.7156545Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_apply.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:31:47.714850]
2024-12-18T01:31:51.9425908Z 
2024-12-18T01:31:51.9427738Z distributed/fsdp/test_fsdp_apply 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_apply_1.1_fe6746585d5e0a49_.log
2024-12-18T01:31:51.9429389Z Running 0 items in this shard:
2024-12-18T01:31:51.9429745Z 
2024-12-18T01:31:51.9434422Z Running distributed/fsdp/test_fsdp_flatten_params 1/1 ... [2024-12-18 01:31:51.943225]
2024-12-18T01:31:51.9435301Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:31:51.9441498Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_flatten_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:31:51.943780]
2024-12-18T01:32:47.0490170Z 
2024-12-18T01:32:47.0491880Z distributed/fsdp/test_fsdp_flatten_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_flatten_params_1.1_dfdf143c55c1e923_.log
2024-12-18T01:32:47.0502521Z Running 13 items in this shard: test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_empty_module, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_full_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_mixed_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_unaligned, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_with_memory_format_memory_format0, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_with_memory_format_memory_format1, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flatten_nothing, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_partial_flattening, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_pnorm_after_step_with_shared_params
2024-12-18T01:32:47.0508955Z 
2024-12-18T01:32:47.0509260Z Running distributed/fsdp/test_fsdp_traversal 1/1 ... [2024-12-18 01:32:47.049372]
2024-12-18T01:32:47.0509744Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:32:47.0510858Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_traversal.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:32:47.049903]
2024-12-18T01:32:51.3277909Z 
2024-12-18T01:32:51.3279101Z distributed/fsdp/test_fsdp_traversal 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_traversal_1.1_5abdd4a8baaa06d2_.log
2024-12-18T01:32:51.3280038Z Running 0 items in this shard:
2024-12-18T01:32:51.3280250Z 
2024-12-18T01:32:51.3284713Z Running distributed/checkpoint/test_state_dict 1/1 ... [2024-12-18 01:32:51.328271]
2024-12-18T01:32:51.3285247Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:32:51.3290103Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/checkpoint/test_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:32:51.328768]
2024-12-18T01:33:00.4166027Z 
2024-12-18T01:33:00.4167120Z distributed/checkpoint/test_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_1.1_3b00d1b70e35c449_.log
2024-12-18T01:33:00.4176635Z Running 23 items in this shard: test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_fsdp1, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0_hsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_compiled_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_cpu_offload_full_state_dict, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_fsdp_api, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_partial, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_extra_state, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_flattened_osd, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp2, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_root_not_initialized, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_non_persistent_buffers, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_optim_state_dict_param_matching, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model_broadcasting, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_shared_weight, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_single_gpu, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_strict, test/distributed/checkpoint/test_state_dict.py::TestNoComm::test_no_dist
2024-12-18T01:33:00.4185351Z 
2024-12-18T01:33:00.4185688Z Running distributed/optim/test_zero_redundancy_optimizer 1/1 ... [2024-12-18 01:33:00.417124]
2024-12-18T01:33:00.4186236Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:33:00.4187389Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/optim/test_zero_redundancy_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:33:00.417636]
2024-12-18T01:34:49.4605931Z 
2024-12-18T01:34:49.4608273Z distributed/optim/test_zero_redundancy_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_zero_redundancy_optimizer_1.1_e5524ce0e0b19918_.log
2024-12-18T01:34:49.4660832Z Running 42 items in this shard: test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_constructor, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_lr_scheduler, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_same_dense_param_type, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_state_dict, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_with_extra_inner_key, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_with_kwargs, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_without_closure, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_zero_grad, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_add_param_group, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_collect_shards, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_AdamW_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_AdamW_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_Adam_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_Adam_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_SGD_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_SGD_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_lr_scheduler, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_multiple_param_groups, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_nondefault_process_group, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_sharding, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_step, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_step_with_closure, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_join_cpu, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_join_gpu, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_model_parallel_parameters_as_bucket_view_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_model_parallel_parameters_as_bucket_view_True
2024-12-18T01:34:49.4696607Z 
2024-12-18T01:34:49.4696880Z Running distributed/test_c10d_ucc 1/1 ... [2024-12-18 01:34:49.461421]
2024-12-18T01:34:49.4697335Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:34:49.4698451Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:34:49.462037]
2024-12-18T01:34:51.0153238Z 
2024-12-18T01:34:51.0154505Z distributed/test_c10d_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ucc_1.1_7f76ab54a70fd7cb_.log
2024-12-18T01:34:51.0155519Z 
2024-12-18T01:34:51.0159444Z Running distributed/fsdp/test_fsdp_multiple_wrapping 1/1 ... [2024-12-18 01:34:51.015747]
2024-12-18T01:34:51.0160044Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:34:51.0164400Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_multiple_wrapping.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:34:51.016193]
2024-12-18T01:34:55.3443239Z 
2024-12-18T01:34:55.3444351Z distributed/fsdp/test_fsdp_multiple_wrapping 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_multiple_wrapping_1.1_c7555204588099a1_.log
2024-12-18T01:34:55.3445365Z Running 0 items in this shard:
2024-12-18T01:34:55.3445588Z 
2024-12-18T01:34:55.3450315Z Running distributed/_composable/fsdp/test_fully_shard_mixed_precision 1/1 ... [2024-12-18 01:34:55.344822]
2024-12-18T01:34:55.3450921Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:34:55.3455642Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_mixed_precision.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:34:55.345341]
2024-12-18T01:34:59.6735439Z 
2024-12-18T01:34:59.6736702Z distributed/_composable/fsdp/test_fully_shard_mixed_precision 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_mixed_precision_1.1_01bd95193ae41c90_.log
2024-12-18T01:34:59.6742260Z Running 7 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionTraining::test_compute_dtype, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionTraining::test_grad_acc_with_reduce_dtype, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionTraining::test_reduce_dtype, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionCasts::test_float16_on_one_submodule, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionCasts::test_norm_modules_bf16, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionCasts::test_norm_modules_fp16, test/distributed/_composable/fsdp/test_fully_shard_mixed_precision.py::TestFullyShardMixedPrecisionCasts::test_submodules_with_external_inputs
2024-12-18T01:34:59.6746570Z 
2024-12-18T01:34:59.6747045Z Running distributed/_composable/test_composability/test_2d_composability 1/1 ... [2024-12-18 01:34:59.674017]
2024-12-18T01:34:59.6747926Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:34:59.6749167Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/test_composability/test_2d_composability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:34:59.674524]
2024-12-18T01:36:06.0398603Z 
2024-12-18T01:36:06.0400343Z distributed/_composable/test_composability/test_2d_composability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_composability.test_2d_composability_1.1_7855f9ab224a09f4_.log
2024-12-18T01:36:06.0414927Z Running 20 items in this shard: test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_2d_uneven_shard_raise_error, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_tp_with_fsdp_offloading, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_mlp, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_transformer, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DTraining::test_train_parity_2d_transformer_checkpoint_resume, test/distributed/_composable/test_composability/test_2d_composability.py::TestFullyShard2DStateDict::test_fully_shard_tp_2d_set_full_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::Test2dFSDP1ParallelIntegration::test_2d_ddp_integration_functionality, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_default, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_not_use_orig_params, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_e2e_training_use_orig_params, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_2d_fsdp_state_enable_extension, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelTraining::test_raise_invalid_tp_composition, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_load_state_dict_is_even_sharded_model_False, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_load_state_dict_is_even_sharded_model_True, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_optim_state_dict_is_even_sharded_model_False, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_optim_state_dict_is_even_sharded_model_True, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_state_dict_is_even_sharded_model_False, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_2d_state_dict_is_even_sharded_model_True, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_fsdp1_tp_2d_set_full_state_dict, test/distributed/_composable/test_composability/test_2d_composability.py::TestNew2dParallelStateDict::test_fsdp_2d_extension
2024-12-18T01:36:06.0427825Z 
2024-12-18T01:36:06.0428201Z Running distributed/_composable/fsdp/test_fully_shard_state_dict 1/1 ... [2024-12-18 01:36:06.040448]
2024-12-18T01:36:06.0428779Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:36:06.0430111Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:36:06.040954]
2024-12-18T01:36:10.4191883Z 
2024-12-18T01:36:10.4193149Z distributed/_composable/fsdp/test_fully_shard_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_state_dict_1.1_f7475a8cbfe46f5d_.log
2024-12-18T01:36:10.4197690Z Running 6 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_2d_state_dict_correctness, test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_dp_state_dict_cpu_offload, test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_dp_state_dict_save_load, test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_dp_tp_state_dict_save_load, test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_hsdp_tp_state_dict_save_load, test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiThread::test_rank0_offload_full_state_dict
2024-12-18T01:36:10.4202149Z 
2024-12-18T01:36:10.4202406Z Running distributed/test_pg_wrapper 1/1 ... [2024-12-18 01:36:10.419649]
2024-12-18T01:36:10.4203073Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:36:10.4204523Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_pg_wrapper.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:36:10.420136]
2024-12-18T01:38:04.6543562Z 
2024-12-18T01:38:04.6544933Z distributed/test_pg_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_pg_wrapper_1.1_a13780dc456866c0_.log
2024-12-18T01:38:04.6554696Z Running 17 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_coalescing_manager_debug_mode_detail, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_hang, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_detail, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_off, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_debug_level_detail_no_gloo, test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_new_group_no_gloo, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_hang, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode_off, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda_debug_mode, test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_debug_mode
2024-12-18T01:38:04.6563570Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_coalescing_manager_debug_mode_detail
2024-12-18T01:38:04.6564968Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_hang
2024-12-18T01:38:04.6566041Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_detail
2024-12-18T01:38:04.6567206Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collective_shape_mismatch_debug_mode_off
2024-12-18T01:38:04.6568290Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch
2024-12-18T01:38:04.6569356Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_collectives_op_mismatch_debug_mode
2024-12-18T01:38:04.6570415Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_debug_level_detail_no_gloo
2024-12-18T01:38:04.6571401Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupNCCLWrapperTest::test_new_group_no_gloo
2024-12-18T01:38:04.6572345Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_hang
2024-12-18T01:38:04.6573481Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda
2024-12-18T01:38:04.6574604Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_cuda_debug_mode
2024-12-18T01:38:04.6575770Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode
2024-12-18T01:38:04.6576913Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collective_shape_mismatch_debug_mode_off
2024-12-18T01:38:04.6577990Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch
2024-12-18T01:38:04.6579020Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda
2024-12-18T01:38:04.6580125Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_cuda_debug_mode
2024-12-18T01:38:04.6581250Z Running 1 items in this shard: test/distributed/test_pg_wrapper.py::ProcessGroupGlooWrapperTest::test_collectives_op_mismatch_debug_mode
2024-12-18T01:38:04.6581869Z 
2024-12-18T01:38:04.6582129Z Running distributed/fsdp/test_fsdp_comm_hooks 1/1 ... [2024-12-18 01:38:04.655186]
2024-12-18T01:38:04.6582625Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:38:04.6583731Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_comm_hooks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:38:04.655648]
2024-12-18T01:39:11.4865364Z 
2024-12-18T01:39:11.4867122Z distributed/fsdp/test_fsdp_comm_hooks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_comm_hooks_1.1_bf62c9ba4499361e_.log
2024-12-18T01:39:11.4894861Z Running 28 items in this shard: test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_bf16_hook_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_behavior_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_default_communication_hook_initialization_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_False_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_fp16_hook_has_wrapping_True_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_hybrid_strategy, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_non_root_sharding_strategy2, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy0, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy1, test/distributed/fsdp/test_fsdp_comm_hooks.py::TestCommunicationHooks::test_registering_hook_submodules_sharding_strategy2
2024-12-18T01:39:11.4920258Z 
2024-12-18T01:39:11.4920617Z Running distributed/test_data_parallel 1/1 ... [2024-12-18 01:39:11.487346]
2024-12-18T01:39:11.4921330Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:39:11.4922989Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_data_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:39:11.487989]
2024-12-18T01:39:15.8675405Z 
2024-12-18T01:39:15.8676623Z distributed/test_data_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_data_parallel_1.1_b6e19c54b0a4b3c5_.log
2024-12-18T01:39:15.8697085Z Running 46 items in this shard: test/distributed/test_data_parallel.py::TestDataParallel::test_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_buffers_requiring_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_complex, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_device_args, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_function_deletion, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_lazy_linear, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_device, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_no_refcycles, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_module_zero_inputs, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_multiple_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_output, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_no_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_rnn, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_small_back, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_sparse, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_different_len_dicts, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_passes_exception, test/distributed/test_data_parallel.py::TestDataParallel::test_parameter_list_dict_replica, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate_buffers, test/distributed/test_data_parallel.py::TestDataParallel::test_save_replica_module, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_strided_grad_layout, test/distributed/test_data_parallel.py::TestDataParallel::test_zero_grad, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float64
2024-12-18T01:39:15.8716014Z 
2024-12-18T01:39:15.8716280Z Running distributed/fsdp/test_fsdp_core 1/1 ... [2024-12-18 01:39:15.868109]
2024-12-18T01:39:15.8716763Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:39:15.8717856Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_core.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:39:15.868603]
2024-12-18T01:39:20.1465760Z 
2024-12-18T01:39:20.1466912Z distributed/fsdp/test_fsdp_core 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_core_1.1_59d11361a8d0d487_.log
2024-12-18T01:39:20.1467835Z Running 0 items in this shard:
2024-12-18T01:39:20.1468042Z 
2024-12-18T01:39:20.1472295Z Running distributed/rpc/test_tensorpipe_agent 1/4 ... [2024-12-18 01:39:20.147029]
2024-12-18T01:39:20.1472881Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:39:20.1477756Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:39:20.147528]
2024-12-18T01:53:27.9542799Z 
2024-12-18T01:53:27.9543924Z distributed/rpc/test_tensorpipe_agent 1/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_1.4_26ee6b2b55c10d4e_.log
2024-12-18T01:53:27.9597337Z Running 85 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_int_callee, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_forward_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_tensor_dims, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_send_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_with_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_rpc_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_module, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_unexepected_kwarg_is_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_send_remote_module_with_a_new_attribute_not_pickled_over_the_wire, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_create_remote_module_from_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_itself_sparse
2024-12-18T01:53:27.9636383Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback
2024-12-18T01:53:27.9637367Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy
2024-12-18T01:53:27.9638669Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async
2024-12-18T01:53:27.9639709Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained
2024-12-18T01:53:27.9640739Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained_remote
2024-12-18T01:53:27.9641834Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type
2024-12-18T01:53:27.9642871Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref
2024-12-18T01:53:27.9643878Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain
2024-12-18T01:53:27.9644821Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_multi
2024-12-18T01:53:27.9645774Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret
2024-12-18T01:53:27.9646977Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction
2024-12-18T01:53:27.9648024Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info
2024-12-18T01:53:27.9648985Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback
2024-12-18T01:53:27.9649936Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_int_callee
2024-12-18T01:53:27.9650870Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork
2024-12-18T01:53:27.9651880Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc
2024-12-18T01:53:27.9652892Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote
2024-12-18T01:53:27.9653884Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names
2024-12-18T01:53:27.9654990Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin
2024-12-18T01:53:27.9656134Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin_single_threaded
2024-12-18T01:53:27.9657265Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf
2024-12-18T01:53:27.9658302Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf
2024-12-18T01:53:27.9659397Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded
2024-12-18T01:53:27.9660599Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded
2024-12-18T01:53:27.9661756Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_builtin
2024-12-18T01:53:27.9662793Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method
2024-12-18T01:53:27.9663904Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend
2024-12-18T01:53:27.9665008Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker
2024-12-18T01:53:27.9666012Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset
2024-12-18T01:53:27.9667005Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref
2024-12-18T01:53:27.9667969Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_forward_chain
2024-12-18T01:53:27.9668925Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class
2024-12-18T01:53:27.9669891Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist
2024-12-18T01:53:27.9670919Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking
2024-12-18T01:53:27.9671957Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote
2024-12-18T01:53:27.9672959Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_rpc_arg
2024-12-18T01:53:27.9674097Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript
2024-12-18T01:53:27.9675156Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin
2024-12-18T01:53:27.9676239Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function
2024-12-18T01:53:27.9677273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types
2024-12-18T01:53:27.9678301Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads
2024-12-18T01:53:27.9679445Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error
2024-12-18T01:53:27.9680632Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_tensor_dims
2024-12-18T01:53:27.9681821Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_nested
2024-12-18T01:53:27.9682934Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf
2024-12-18T01:53:27.9684178Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_send_function
2024-12-18T01:53:27.9685326Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context
2024-12-18T01:53:27.9686470Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward
2024-12-18T01:53:27.9687651Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_with_grad
2024-12-18T01:53:27.9688894Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context
2024-12-18T01:53:27.9690031Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref
2024-12-18T01:53:27.9691228Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value_remote
2024-12-18T01:53:27.9692383Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call
2024-12-18T01:53:27.9693531Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call
2024-12-18T01:53:27.9694626Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy
2024-12-18T01:53:27.9695753Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad
2024-12-18T01:53:27.9696897Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_rpc_complex_args
2024-12-18T01:53:27.9697954Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id
2024-12-18T01:53:27.9699085Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults
2024-12-18T01:53:27.9700227Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type
2024-12-18T01:53:27.9701307Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception
2024-12-18T01:53:27.9702487Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py
2024-12-18T01:53:27.9703657Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py
2024-12-18T01:53:27.9704735Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed
2024-12-18T01:53:27.9705732Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_module
2024-12-18T01:53:27.9706892Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script
2024-12-18T01:53:27.9708060Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation
2024-12-18T01:53:27.9709092Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function
2024-12-18T01:53:27.9710222Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_unexepected_kwarg_is_specified
2024-12-18T01:53:27.9711319Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote
2024-12-18T01:53:27.9712367Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async
2024-12-18T01:53:27.9713604Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_send_remote_module_with_a_new_attribute_not_pickled_over_the_wire
2024-12-18T01:53:27.9715013Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeThreeWorkersRemoteModuleTest::test_create_remote_module_from_module_rref
2024-12-18T01:53:27.9716227Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison
2024-12-18T01:53:27.9717475Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank
2024-12-18T01:53:27.9718803Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options
2024-12-18T01:53:27.9720016Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options
2024-12-18T01:53:27.9721249Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse
2024-12-18T01:53:27.9722434Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse
2024-12-18T01:53:27.9723711Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse
2024-12-18T01:53:27.9725032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse
2024-12-18T01:53:27.9726254Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse
2024-12-18T01:53:27.9727418Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse
2024-12-18T01:53:27.9728699Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse
2024-12-18T01:53:27.9730158Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_itself_sparse
2024-12-18T01:53:27.9730941Z 
2024-12-18T01:53:27.9731213Z Running distributed/rpc/test_tensorpipe_agent 3/4 ... [2024-12-18 01:53:27.957937]
2024-12-18T01:53:27.9731723Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T01:53:27.9732911Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=3', '--num-shards=4', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 01:53:27.958415]
2024-12-18T02:12:29.2099062Z 
2024-12-18T02:12:29.2100340Z distributed/rpc/test_tensorpipe_agent 3/4 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_3.4_047c50862f6d9f67_.log
2024-12-18T02:12:29.2177081Z Running 117 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_build_rpc_profiling_key, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_none, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_dist_init_decorator, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name_2, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_in_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_wait_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_garbage_collected_user_rref_due_to_local_circular_dependency, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_instance_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rpc_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_get_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_slow_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_partial_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_twice_dense, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_world_size_one, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_autograd_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_round_trips, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_script_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_add_done_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_and_kwargs_contain_different_types, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_fork_in_jit_with_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_local_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_restore_context_after_swtich_to_jit_thread, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_train_eval, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_ret_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_py_udf_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_py_udf_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_remote_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_multi_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_no_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_multiple_backward_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse
2024-12-18T02:12:29.2229372Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add
2024-12-18T02:12:29.2230258Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id
2024-12-18T02:12:29.2231241Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained
2024-12-18T02:12:29.2232410Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout
2024-12-18T02:12:29.2233470Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async
2024-12-18T02:12:29.2234510Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple
2024-12-18T02:12:29.2235539Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor
2024-12-18T02:12:29.2236605Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call
2024-12-18T02:12:29.2237661Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_build_rpc_profiling_key
2024-12-18T02:12:29.2238876Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret
2024-12-18T02:12:29.2239825Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc
2024-12-18T02:12:29.2240754Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_none
2024-12-18T02:12:29.2241699Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error
2024-12-18T02:12:29.2242622Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock
2024-12-18T02:12:29.2243608Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling
2024-12-18T02:12:29.2244582Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_dist_init_decorator
2024-12-18T02:12:29.2245537Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name_2
2024-12-18T02:12:29.2246464Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_in_rpc
2024-12-18T02:12:29.2247402Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_wait_twice
2024-12-18T02:12:29.2248340Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak
2024-12-18T02:12:29.2249273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg
2024-12-18T02:12:29.2250237Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc
2024-12-18T02:12:29.2251368Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server
2024-12-18T02:12:29.2252315Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_remote
2024-12-18T02:12:29.2253443Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_garbage_collected_user_rref_due_to_local_circular_dependency
2024-12-18T02:12:29.2254549Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero
2024-12-18T02:12:29.2255588Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded
2024-12-18T02:12:29.2256725Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context
2024-12-18T02:12:29.2257848Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded
2024-12-18T02:12:29.2259108Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded
2024-12-18T02:12:29.2260239Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc
2024-12-18T02:12:29.2261301Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc
2024-12-18T02:12:29.2262315Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor
2024-12-18T02:12:29.2263306Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_instance_method
2024-12-18T02:12:29.2264295Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_multi_async_call
2024-12-18T02:12:29.2265246Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rpc_rref_args
2024-12-18T02:12:29.2266212Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share
2024-12-18T02:12:29.2267140Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors
2024-12-18T02:12:29.2268041Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote
2024-12-18T02:12:29.2269052Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function
2024-12-18T02:12:29.2270070Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_get_future
2024-12-18T02:12:29.2271029Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking
2024-12-18T02:12:29.2272002Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_slow_init
2024-12-18T02:12:29.2273002Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking
2024-12-18T02:12:29.2273996Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed
2024-12-18T02:12:29.2274993Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote
2024-12-18T02:12:29.2275950Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all
2024-12-18T02:12:29.2276880Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body
2024-12-18T02:12:29.2277948Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception
2024-12-18T02:12:29.2278976Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_partial_exception
2024-12-18T02:12:29.2280024Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_twice_dense
2024-12-18T02:12:29.2280996Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_world_size_one
2024-12-18T02:12:29.2281968Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_autograd_context
2024-12-18T02:12:29.2283038Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes
2024-12-18T02:12:29.2284221Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args
2024-12-18T02:12:29.2285368Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots
2024-12-18T02:12:29.2286486Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_round_trips
2024-12-18T02:12:29.2287624Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor
2024-12-18T02:12:29.2288719Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure
2024-12-18T02:12:29.2289827Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf
2024-12-18T02:12:29.2290973Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error
2024-12-18T02:12:29.2292097Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_script_call
2024-12-18T02:12:29.2293194Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks
2024-12-18T02:12:29.2294289Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf
2024-12-18T02:12:29.2295406Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc
2024-12-18T02:12:29.2296543Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad
2024-12-18T02:12:29.2297694Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call
2024-12-18T02:12:29.2298867Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself
2024-12-18T02:12:29.2300011Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call
2024-12-18T02:12:29.2301068Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad
2024-12-18T02:12:29.2302178Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads
2024-12-18T02:12:29.2303287Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse
2024-12-18T02:12:29.2304293Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks
2024-12-18T02:12:29.2305331Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps
2024-12-18T02:12:29.2306373Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception
2024-12-18T02:12:29.2307518Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor
2024-12-18T02:12:29.2308618Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_add_done_callback
2024-12-18T02:12:29.2309693Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_and_kwargs_contain_different_types
2024-12-18T02:12:29.2310828Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed
2024-12-18T02:12:29.2311915Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_remote_multi
2024-12-18T02:12:29.2313003Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple
2024-12-18T02:12:29.2314060Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_fork_in_jit_with_profiling
2024-12-18T02:12:29.2315122Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling
2024-12-18T02:12:29.2316115Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple
2024-12-18T02:12:29.2317109Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation
2024-12-18T02:12:29.2318133Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_local_rref_local_value
2024-12-18T02:12:29.2319216Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified
2024-12-18T02:12:29.2320304Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs
2024-12-18T02:12:29.2321333Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_throw
2024-12-18T02:12:29.2322471Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script
2024-12-18T02:12:29.2323768Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults
2024-12-18T02:12:29.2324991Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitDistAutogradTest::test_restore_context_after_swtich_to_jit_thread
2024-12-18T02:12:29.2326124Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module
2024-12-18T02:12:29.2327142Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script
2024-12-18T02:12:29.2328164Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_train_eval
2024-12-18T02:12:29.2329161Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods
2024-12-18T02:12:29.2330219Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc
2024-12-18T02:12:29.2331334Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_ret_sparse
2024-12-18T02:12:29.2332591Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse
2024-12-18T02:12:29.2333781Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_py_udf_remote_sparse
2024-12-18T02:12:29.2334922Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse
2024-12-18T02:12:29.2336084Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_blocking
2024-12-18T02:12:29.2337322Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking
2024-12-18T02:12:29.2338740Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_py_udf_remote_sparse
2024-12-18T02:12:29.2339996Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_remote_arg_sparse
2024-12-18T02:12:29.2341487Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout
2024-12-18T02:12:29.2342770Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse
2024-12-18T02:12:29.2343951Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse
2024-12-18T02:12:29.2345161Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_multi_sparse
2024-12-18T02:12:29.2346439Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_sparse
2024-12-18T02:12:29.2347752Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse
2024-12-18T02:12:29.2349110Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse
2024-12-18T02:12:29.2350466Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_no_grad_sparse
2024-12-18T02:12:29.2351837Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors
2024-12-18T02:12:29.2353146Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_multiple_backward_sparse
2024-12-18T02:12:29.2354534Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse
2024-12-18T02:12:29.2355927Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse
2024-12-18T02:12:29.2356629Z 
2024-12-18T02:12:29.2356963Z Running distributed/_shard/sharding_plan/test_sharding_plan 1/1 ... [2024-12-18 02:12:29.215671]
2024-12-18T02:12:29.2357516Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:12:29.2358685Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/_shard/sharding_plan/test_sharding_plan.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:12:29.216184]
2024-12-18T02:12:33.1941759Z 
2024-12-18T02:12:33.1943401Z distributed/_shard/sharding_plan/test_sharding_plan 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_plan.test_sharding_plan_1.1_d378522a886b753a_.log
2024-12-18T02:12:33.1945960Z Running 3 items in this shard: test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_custom_sharding_planner, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_shard_module_sub_process_group, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_sharding_plan_errors
2024-12-18T02:12:33.1947987Z 
2024-12-18T02:12:33.1948306Z Running distributed/fsdp/test_fsdp_multiple_forward 1/1 ... [2024-12-18 02:12:33.194630]
2024-12-18T02:12:33.1948901Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:12:33.1952999Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_multiple_forward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:12:33.195081]
2024-12-18T02:12:41.6794245Z 
2024-12-18T02:12:41.6795420Z distributed/fsdp/test_fsdp_multiple_forward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_multiple_forward_1.1_3e936380c9dd91ba_.log
2024-12-18T02:12:41.6796774Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_multiple_forward.py::TestMultiForwardCPU::test_multi_forward_cpu
2024-12-18T02:12:41.6797334Z 
2024-12-18T02:12:41.6800769Z Running distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 ... [2024-12-18 02:12:41.679876]
2024-12-18T02:12:41.6801311Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:12:41.6806299Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_sharded_grad_scaler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:12:41.680381]
2024-12-18T02:13:51.1588968Z 
2024-12-18T02:13:51.1590277Z distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_sharded_grad_scaler_1.1_f21be4c42361bf28_.log
2024-12-18T02:13:51.1605369Z Running 20 items in this shard: test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_grad_scaling, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_inf_gradients_skip_optim_step, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_scaling_unscaling_sparse, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_sharded_grad_scaler_found_inf
2024-12-18T02:13:51.1619065Z 
2024-12-18T02:13:51.1619320Z Running distributed/fsdp/test_fsdp_meta 1/1 ... [2024-12-18 02:13:51.159128]
2024-12-18T02:13:51.1619801Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:13:51.1620891Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_meta.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:13:51.159649]
2024-12-18T02:14:26.8423589Z 
2024-12-18T02:14:26.8424982Z distributed/fsdp/test_fsdp_meta 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_meta_1.1_a668326ce1b1ef3c_.log
2024-12-18T02:14:26.8434421Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_meta, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_torchdistx, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_meta_device_with_mixed_precision, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_reset_params, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_init_fn
2024-12-18T02:14:26.8442115Z 
2024-12-18T02:14:26.8442677Z Running distributed/fsdp/test_fsdp_unshard_params 1/1 ... [2024-12-18 02:14:26.842763]
2024-12-18T02:14:26.8443262Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:14:26.8444396Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_unshard_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:14:26.843246]
2024-12-18T02:15:29.9140385Z 
2024-12-18T02:15:29.9141509Z distributed/fsdp/test_fsdp_unshard_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_unshard_params_1.1_ceb340e9994c5d2a_.log
2024-12-18T02:15:29.9149422Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_named_parameters_and_buffers, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_param_data, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_recurse, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_respects_reshard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_singleton_param_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_submodule, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_core, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_none_grads, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_param_data_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_writeback_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_offload_to_cpu_no_shard_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_rank0_only_with_writeback_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_backward_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_forward_raises
2024-12-18T02:15:29.9157093Z 
2024-12-18T02:15:29.9157387Z Running distributed/fsdp/test_fsdp_mixed_precision 1/1 ... [2024-12-18 02:15:29.914468]
2024-12-18T02:15:29.9157904Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:15:29.9159034Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/fsdp/test_fsdp_mixed_precision.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:15:29.914963]
2024-12-18T02:19:14.1354001Z 
2024-12-18T02:19:14.1355159Z distributed/fsdp/test_fsdp_mixed_precision 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_mixed_precision_1.1_8ff2aa11df1c2cae_.log
2024-12-18T02:19:14.1391676Z Running 57 items in this shard: test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_eval_root_cast_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval_buffers, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval_comm, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_grads_reduced_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_input_grads_with_param_mixed_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_no_reshard_after_forward, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_resnet, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_batchnorm_convert_sync_bn_False, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_batchnorm_convert_sync_bn_True, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_default, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_only_params_and_bufs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_params_and_reduce_diff, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_reduce, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_grads_reduced_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_mixed_precision_e2e_full_shard, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_mixed_precision_no_reshard_after_forward, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionIgnoredModules::test_mixed_precision_with_ignored_module, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule_skip_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule_skip_inputs_error, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_different_precisions, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_different_precisions_error, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_external_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPTrainEval::test_train_ema_eval_flow
2024-12-18T02:19:14.1426585Z 
2024-12-18T02:19:14.1426849Z Running distributed/test_c10d_spawn_gloo 1/1 ... [2024-12-18 02:19:14.135833]
2024-12-18T02:19:14.1427330Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:19:14.1428470Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_spawn_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:19:14.136342]
2024-12-18T02:20:38.2453085Z 
2024-12-18T02:20:38.2455090Z distributed/test_c10d_spawn_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_gloo_1.1_6dfdcdf4a65f4834_.log
2024-12-18T02:20:38.2464878Z Running 11 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cpu, test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cuda, test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_rnn, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_gather, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all_single, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_allreduce, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_broadcast, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_gather, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_reduce, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_scatter
2024-12-18T02:20:38.2473969Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cpu
2024-12-18T02:20:38.2475399Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cuda
2024-12-18T02:20:38.2476861Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_rnn
2024-12-18T02:20:38.2478351Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_gather
2024-12-18T02:20:38.2479854Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all
2024-12-18T02:20:38.2481432Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all_single
2024-12-18T02:20:38.2482832Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_allreduce
2024-12-18T02:20:38.2484232Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_broadcast
2024-12-18T02:20:38.2485658Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_gather
2024-12-18T02:20:38.2487079Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_reduce
2024-12-18T02:20:38.2488413Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_scatter
2024-12-18T02:20:38.2489188Z 
2024-12-18T02:20:38.2489562Z Running distributed/test_c10d_spawn_ucc 1/1 ... [2024-12-18 02:20:38.246303]
2024-12-18T02:20:38.2490298Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:20:38.2492279Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_spawn_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:20:38.246902]
2024-12-18T02:21:07.4409509Z 
2024-12-18T02:21:07.4411151Z distributed/test_c10d_spawn_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_ucc_1.1_470ace3aff3f3f23_.log
2024-12-18T02:21:07.4417385Z Running 6 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_gather, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all_single, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_allreduce, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_broadcast, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_reduce
2024-12-18T02:21:07.4422464Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_gather
2024-12-18T02:21:07.4424020Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all
2024-12-18T02:21:07.4425621Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all_single
2024-12-18T02:21:07.4427341Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_allreduce
2024-12-18T02:21:07.4428852Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_broadcast
2024-12-18T02:21:07.4430073Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_reduce
2024-12-18T02:21:07.4430811Z 
2024-12-18T02:21:07.4431423Z Running distributed/test_c10d_spawn_nccl 1/1 ... [2024-12-18 02:21:07.441813]
2024-12-18T02:21:07.4432072Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:21:07.4433755Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_c10d_spawn_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:21:07.442452]
2024-12-18T02:21:50.0355880Z 
2024-12-18T02:21:50.0357404Z distributed/test_c10d_spawn_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_nccl_1.1_444ec547be6b9dc4_.log
2024-12-18T02:21:50.0361852Z Running 9 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather_base, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all_single, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_allreduce, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_broadcast, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter_non_contiguous
2024-12-18T02:21:50.0366475Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather
2024-12-18T02:21:50.0367514Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather_base
2024-12-18T02:21:50.0368660Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all
2024-12-18T02:21:50.0369771Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all_single
2024-12-18T02:21:50.0370810Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_allreduce
2024-12-18T02:21:50.0371862Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_broadcast
2024-12-18T02:21:50.0372867Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce
2024-12-18T02:21:50.0373863Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter
2024-12-18T02:21:50.0375036Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter_non_contiguous
2024-12-18T02:21:50.0375724Z 
2024-12-18T02:21:50.0376661Z Running distributed/test_store 1/1 ... [2024-12-18 02:21:50.036315]
2024-12-18T02:21:50.0377184Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:21:50.0378352Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/test_store.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:21:50.036779]
2024-12-18T02:28:29.3752802Z 
2024-12-18T02:28:29.3753761Z distributed/test_store 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_store_1.1_2669bb0d45a66081_.log
2024-12-18T02:28:29.3791630Z Running 88 items in this shard: test/distributed/test_store.py::FileStoreTest::test_append, test/distributed/test_store.py::FileStoreTest::test_compare_set, test/distributed/test_store.py::FileStoreTest::test_init_pg_and_rpc_with_same_file, test/distributed/test_store.py::FileStoreTest::test_multi_get, test/distributed/test_store.py::FileStoreTest::test_multi_set, test/distributed/test_store.py::FileStoreTest::test_refcount, test/distributed/test_store.py::FileStoreTest::test_set_get_check, test/distributed/test_store.py::FileStoreTest::test_simple_wait, test/distributed/test_store.py::HashStoreTest::test_append, test/distributed/test_store.py::HashStoreTest::test_compare_set, test/distributed/test_store.py::HashStoreTest::test_multi_get, test/distributed/test_store.py::HashStoreTest::test_multi_set, test/distributed/test_store.py::HashStoreTest::test_set_get_check, test/distributed/test_store.py::HashStoreTest::test_simple_wait, test/distributed/test_store.py::PrefixStoreTest::test_get_underlying_store, test/distributed/test_store.py::PrefixFileStoreTest::test_append, test/distributed/test_store.py::PrefixFileStoreTest::test_compare_set, test/distributed/test_store.py::PrefixFileStoreTest::test_multi_get, test/distributed/test_store.py::PrefixFileStoreTest::test_multi_set, test/distributed/test_store.py::PrefixFileStoreTest::test_set_get_check, test/distributed/test_store.py::PrefixFileStoreTest::test_simple_wait, test/distributed/test_store.py::TCPStoreTest::test_address_already_in_use, test/distributed/test_store.py::TCPStoreTest::test_append, test/distributed/test_store.py::TCPStoreTest::test_compare_set, test/distributed/test_store.py::TCPStoreTest::test_init_pg_and_rpc_with_same_socket, test/distributed/test_store.py::TCPStoreTest::test_multi_get, test/distributed/test_store.py::TCPStoreTest::test_multi_set, test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_fixed_world_size, test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_nonfixed_world_size, test/distributed/test_store.py::TCPStoreTest::test_multitenancy, test/distributed/test_store.py::TCPStoreTest::test_numkeys_delkeys, test/distributed/test_store.py::TCPStoreTest::test_repr, test/distributed/test_store.py::TCPStoreTest::test_set_get_check, test/distributed/test_store.py::TCPStoreTest::test_simple_wait, test/distributed/test_store.py::TCPStoreTest::test_store_timeout_on_missing_clients, test/distributed/test_store.py::TCPStoreTest::test_take_over_listen_socket, test/distributed/test_store.py::TCPStoreTest::test_world_size_0_raises, test/distributed/test_store.py::LibUvTCPStoreTest::test_address_already_in_use, test/distributed/test_store.py::LibUvTCPStoreTest::test_append, test/distributed/test_store.py::LibUvTCPStoreTest::test_compare_set, test/distributed/test_store.py::LibUvTCPStoreTest::test_init_pg_and_rpc_with_same_socket, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_get, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_set, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_fixed_world_size, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_nonfixed_world_size, test/distributed/test_store.py::LibUvTCPStoreTest::test_multitenancy, test/distributed/test_store.py::LibUvTCPStoreTest::test_numkeys_delkeys, test/distributed/test_store.py::LibUvTCPStoreTest::test_repr, test/distributed/test_store.py::LibUvTCPStoreTest::test_set_get_check, test/distributed/test_store.py::LibUvTCPStoreTest::test_simple_wait, test/distributed/test_store.py::LibUvTCPStoreTest::test_store_timeout_on_missing_clients, test/distributed/test_store.py::LibUvTCPStoreTest::test_take_over_listen_socket, test/distributed/test_store.py::LibUvTCPStoreTest::test_world_size_0_raises, test/distributed/test_store.py::PrefixTCPStoreTest::test_append, test/distributed/test_store.py::PrefixTCPStoreTest::test_compare_set, test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_get, test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_set, test/distributed/test_store.py::PrefixTCPStoreTest::test_set_get_check, test/distributed/test_store.py::PrefixTCPStoreTest::test_simple_wait, test/distributed/test_store.py::PrefixTCPStoreTest::test_underlying_non_prefix_store, test/distributed/test_store.py::PythonStoreTest::test_set_get, test/distributed/test_store.py::RendezvousTest::test_unknown_handler, test/distributed/test_store.py::RendezvousTest::test_url_with_node_params, test/distributed/test_store.py::RendezvousEnvTest::test_nominal, test/distributed/test_store.py::RendezvousFileTest::test_common_errors, test/distributed/test_store.py::RendezvousFileTest::test_nominal, test/distributed/test_store.py::RendezvousTCPTest::test_common_errors, test/distributed/test_store.py::RendezvousTCPTest::test_dns_timeout, test/distributed/test_store.py::RendezvousTCPTest::test_nominal, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_doest_break_client, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_set, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_url_with_libuv, test/distributed/test_store.py::TestPythonStore::test_append_roundtrip, test/distributed/test_store.py::TestPythonStore::test_extended_methods_fallbacks, test/distributed/test_store.py::TestPythonStore::test_has_extended_api_passthrough, test/distributed/test_store.py::TestPythonStore::test_has_extended_api_roundtrip, test/distributed/test_store.py::TestPythonStore::test_multi_get_roundtrip, test/distributed/test_store.py::TestPythonStore::test_multi_set_roundtrip, test/distributed/test_store.py::TestPythonStore::test_optional_methods_fail, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_file_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_hash_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_prefix_file_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store_uv, test/distributed/test_store.py::TimeoutTest::test_interrupt_doesnt_break_wait, test/distributed/test_store.py::InitPgWithNonUvStore::test_with_env_var, test/distributed/test_store.py::InitPgWithNonUvStore::test_with_url_param, test/distributed/test_store.py::TestClientProtocol::test_client_connect
2024-12-18T02:28:29.3819078Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_append
2024-12-18T02:28:29.3819815Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_compare_set
2024-12-18T02:28:29.3820686Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_init_pg_and_rpc_with_same_file
2024-12-18T02:28:29.3821477Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_multi_get
2024-12-18T02:28:29.3822199Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_multi_set
2024-12-18T02:28:29.3822913Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_refcount
2024-12-18T02:28:29.3823647Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_set_get_check
2024-12-18T02:28:29.3824392Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_simple_wait
2024-12-18T02:28:29.3825186Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_append
2024-12-18T02:28:29.3825902Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_compare_set
2024-12-18T02:28:29.3826628Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_multi_get
2024-12-18T02:28:29.3827359Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_multi_set
2024-12-18T02:28:29.3828096Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_set_get_check
2024-12-18T02:28:29.3828843Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_simple_wait
2024-12-18T02:28:29.3829623Z Running 1 items in this shard: test/distributed/test_store.py::PrefixStoreTest::test_get_underlying_store
2024-12-18T02:28:29.3830412Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_append
2024-12-18T02:28:29.3831179Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_compare_set
2024-12-18T02:28:29.3832025Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_multi_get
2024-12-18T02:28:29.3832810Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_multi_set
2024-12-18T02:28:29.3833605Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_set_get_check
2024-12-18T02:28:29.3834407Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_simple_wait
2024-12-18T02:28:29.3835212Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_address_already_in_use
2024-12-18T02:28:29.3835960Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_append
2024-12-18T02:28:29.3836659Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_compare_set
2024-12-18T02:28:29.3837476Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_init_pg_and_rpc_with_same_socket
2024-12-18T02:28:29.3838469Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_get
2024-12-18T02:28:29.3839190Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_set
2024-12-18T02:28:29.3839995Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_fixed_world_size
2024-12-18T02:28:29.3840906Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_nonfixed_world_size
2024-12-18T02:28:29.3841723Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multitenancy
2024-12-18T02:28:29.3842470Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_numkeys_delkeys
2024-12-18T02:28:29.3843232Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_repr
2024-12-18T02:28:29.3843943Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_set_get_check
2024-12-18T02:28:29.3844685Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_simple_wait
2024-12-18T02:28:29.3845488Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_store_timeout_on_missing_clients
2024-12-18T02:28:29.3846407Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_take_over_listen_socket
2024-12-18T02:28:29.3847202Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_world_size_0_raises
2024-12-18T02:28:29.3848025Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_address_already_in_use
2024-12-18T02:28:29.3848820Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_append
2024-12-18T02:28:29.3849576Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_compare_set
2024-12-18T02:28:29.3850571Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_init_pg_and_rpc_with_same_socket
2024-12-18T02:28:29.3851424Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_get
2024-12-18T02:28:29.3852167Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_set
2024-12-18T02:28:29.3853028Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_fixed_world_size
2024-12-18T02:28:29.3853991Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_nonfixed_world_size
2024-12-18T02:28:29.3854871Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multitenancy
2024-12-18T02:28:29.3855667Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_numkeys_delkeys
2024-12-18T02:28:29.3856428Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_repr
2024-12-18T02:28:29.3857271Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_set_get_check
2024-12-18T02:28:29.3858043Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_simple_wait
2024-12-18T02:28:29.3858907Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_store_timeout_on_missing_clients
2024-12-18T02:28:29.3859812Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_take_over_listen_socket
2024-12-18T02:28:29.3860655Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_world_size_0_raises
2024-12-18T02:28:29.3861437Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_append
2024-12-18T02:28:29.3862202Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_compare_set
2024-12-18T02:28:29.3862982Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_get
2024-12-18T02:28:29.3863737Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_set
2024-12-18T02:28:29.3864516Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_set_get_check
2024-12-18T02:28:29.3865310Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_simple_wait
2024-12-18T02:28:29.3866154Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_underlying_non_prefix_store
2024-12-18T02:28:29.3866967Z Running 1 items in this shard: test/distributed/test_store.py::PythonStoreTest::test_set_get
2024-12-18T02:28:29.3867718Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTest::test_unknown_handler
2024-12-18T02:28:29.3868498Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTest::test_url_with_node_params
2024-12-18T02:28:29.3869278Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousEnvTest::test_nominal
2024-12-18T02:28:29.3870052Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousFileTest::test_common_errors
2024-12-18T02:28:29.3870824Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousFileTest::test_nominal
2024-12-18T02:28:29.3871593Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_common_errors
2024-12-18T02:28:29.3872373Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_dns_timeout
2024-12-18T02:28:29.3873131Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_nominal
2024-12-18T02:28:29.3873971Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_doest_break_client
2024-12-18T02:28:29.3874879Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_set
2024-12-18T02:28:29.3875864Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_url_with_libuv
2024-12-18T02:28:29.3876709Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_append_roundtrip
2024-12-18T02:28:29.3877541Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_extended_methods_fallbacks
2024-12-18T02:28:29.3878416Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_has_extended_api_passthrough
2024-12-18T02:28:29.3879275Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_has_extended_api_roundtrip
2024-12-18T02:28:29.3880109Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_multi_get_roundtrip
2024-12-18T02:28:29.3880914Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_multi_set_roundtrip
2024-12-18T02:28:29.3881732Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_optional_methods_fail
2024-12-18T02:28:29.3882621Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_file_store
2024-12-18T02:28:29.3883521Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_hash_store
2024-12-18T02:28:29.3884383Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_prefix_file_store
2024-12-18T02:28:29.3885228Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store
2024-12-18T02:28:29.3886069Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store_uv
2024-12-18T02:28:29.3886914Z Running 1 items in this shard: test/distributed/test_store.py::TimeoutTest::test_interrupt_doesnt_break_wait
2024-12-18T02:28:29.3887740Z Running 1 items in this shard: test/distributed/test_store.py::InitPgWithNonUvStore::test_with_env_var
2024-12-18T02:28:29.3888556Z Running 1 items in this shard: test/distributed/test_store.py::InitPgWithNonUvStore::test_with_url_param
2024-12-18T02:28:29.3889366Z Running 1 items in this shard: test/distributed/test_store.py::TestClientProtocol::test_client_connect
2024-12-18T02:28:29.3889821Z 
2024-12-18T02:28:29.3890098Z Running distributed/elastic/events/lib_test 1/1 ... [2024-12-18 02:28:29.378195]
2024-12-18T02:28:29.3890579Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:28:29.3891692Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/events/lib_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:28:29.378686]
2024-12-18T02:28:33.7063678Z 
2024-12-18T02:28:33.7064864Z distributed/elastic/events/lib_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.events.lib_test_1.1_5e3761782db54253_.log
2024-12-18T02:28:33.7069342Z Running 8 items in this shard: test/distributed/elastic/events/lib_test.py::EventLibTest::test_event_created, test/distributed/elastic/events/lib_test.py::EventLibTest::test_event_deser, test/distributed/elastic/events/lib_test.py::EventLibTest::test_get_or_create_logger, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_construct_and_record_rdzv_event, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_construct_and_record_rdzv_event_does_not_run_if_invalid_dest, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_created, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_deserialize, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_str
2024-12-18T02:28:33.7072939Z 
2024-12-18T02:28:33.7073293Z Running distributed/elastic/metrics/api_test 1/1 ... [2024-12-18 02:28:33.706805]
2024-12-18T02:28:33.7073893Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:28:33.7075738Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/metrics/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:28:33.707281]
2024-12-18T02:28:37.8347930Z 
2024-12-18T02:28:37.8349376Z distributed/elastic/metrics/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.metrics.api_test_1.1_50ffaf8e0844228a_.log
2024-12-18T02:28:37.8351302Z Running 3 items in this shard: test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_get_metric_name, test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_inheritance, test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_profile
2024-12-18T02:28:37.8352506Z 
2024-12-18T02:28:37.8354789Z Running distributed/elastic/multiprocessing/api_test 1/1 ... [2024-12-18 02:28:37.835269]
2024-12-18T02:28:37.8355378Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:28:37.8359866Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/multiprocessing/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:28:37.835747]
2024-12-18T02:29:14.1643023Z 
2024-12-18T02:29:14.1644439Z distributed/elastic/multiprocessing/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.multiprocessing.api_test_1.1_a3b7a28ec4e37fcb_.log
2024-12-18T02:29:14.1658844Z Running 25 items in this shard: test/distributed/elastic/multiprocessing/api_test.py::RunProcResultsTest::test_get_failures, test/distributed/elastic/multiprocessing/api_test.py::RunProcResultsTest::test_is_failed, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_str_bad_input, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_value, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_value_map, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_args_env_len_mismatch, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_function_large_ret_val, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_function_raise, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_function_with_tensor, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_invalid_log_dir, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_multiprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_multiprocessing_context_poll_raises_exception, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_pcontext_wait, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_pcontext_wait_on_a_child_thread, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_to_map, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_void_function, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsFuncTest::test_wait_for_all_child_procs_to_exit, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsBinaryTest::test_binary_exit, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsBinaryTest::test_binary_incorrect_entrypoint, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsBinaryTest::test_binary_raises, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsBinaryTest::test_subprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesAsBinaryTest::test_validate_full_rank, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListAsFuncTest::test_function, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListAsBinaryTest::test_binary, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListAsBinaryTest::test_binary_redirect_and_tee
2024-12-18T02:29:14.1671780Z 
2024-12-18T02:29:14.1672175Z Running distributed/elastic/timer/local_timer_example 1/1 ... [2024-12-18 02:29:14.164832]
2024-12-18T02:29:14.1672741Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:29:14.1673985Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/timer/local_timer_example.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:29:14.165336]
2024-12-18T02:29:37.5920336Z 
2024-12-18T02:29:37.5921543Z distributed/elastic/timer/local_timer_example 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.local_timer_example_1.1_a6ff18f7664fa7ff_.log
2024-12-18T02:29:37.5923509Z Running 2 items in this shard: test/distributed/elastic/timer/local_timer_example.py::LocalTimerExample::test_example_start_method_spawn, test/distributed/elastic/timer/local_timer_example.py::LocalTimerExample::test_torch_mp_example
2024-12-18T02:29:37.5924915Z 
2024-12-18T02:29:37.5926937Z Running distributed/elastic/timer/local_timer_test 1/1 ... [2024-12-18 02:29:37.592491]
2024-12-18T02:29:37.5927548Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:29:37.5931938Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/timer/local_timer_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:29:37.592953]
2024-12-18T02:29:47.2289442Z 
2024-12-18T02:29:47.2290768Z distributed/elastic/timer/local_timer_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.local_timer_test_1.1_a0c79ed3e0f7b03d_.log
2024-12-18T02:29:47.2297873Z Running 14 items in this shard: test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_client_interaction, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_exception_propagation, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_get_timer_recursive, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_happy_path, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_no_client, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_timer, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get_less_than_size, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get_size, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_acquire_release, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_expired_timers, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_valid_timers, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_watchdog_call_count, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_watchdog_empty_queue
2024-12-18T02:29:47.2304212Z 
2024-12-18T02:29:47.2304537Z Running distributed/elastic/utils/distributed_test 1/1 ... [2024-12-18 02:29:47.229427]
2024-12-18T02:29:47.2305067Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:29:47.2306235Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/utils/distributed_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:29:47.229899]
2024-12-18T02:29:55.9652948Z 
2024-12-18T02:29:55.9654513Z distributed/elastic/utils/distributed_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.distributed_test_1.1_3fdb4c81002e86d3_.log
2024-12-18T02:29:55.9659300Z Running 8 items in this shard: test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_multi, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_no_port_multi, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_single_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_timeout_on_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_timeout_on_worker, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_with_libuv_support, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_port_already_in_use_on_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_port_already_in_use_on_worker
2024-12-18T02:29:55.9663608Z 
2024-12-18T02:29:55.9663919Z Running distributed/elastic/utils/logging_test 1/1 ... [2024-12-18 02:29:55.966029]
2024-12-18T02:29:55.9664436Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:29:55.9667798Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/utils/logging_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:29:55.966522]
2024-12-18T02:30:00.1445631Z 
2024-12-18T02:30:00.1446779Z distributed/elastic/utils/logging_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.logging_test_1.1_5c37cda950c9761d_.log
2024-12-18T02:30:00.1448396Z Running 2 items in this shard: test/distributed/elastic/utils/logging_test.py::LoggingTest::test_derive_module_name, test/distributed/elastic/utils/logging_test.py::LoggingTest::test_logger_name
2024-12-18T02:30:00.1449285Z 
2024-12-18T02:30:00.1452172Z Running distributed/elastic/utils/util_test 1/1 ... [2024-12-18 02:30:00.145041]
2024-12-18T02:30:00.1452724Z SCRIBE_GRAPHQL_ACCESS_TOKEN is set
2024-12-18T02:30:00.1457341Z Executing ['/opt/conda/envs/py_3.9/bin/python', '-bb', 'distributed/elastic/utils/util_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-12-18 02:30:00.145511]
2024-12-18T02:30:04.6240555Z 
2024-12-18T02:30:04.6242203Z distributed/elastic/utils/util_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.util_test_1.1_0e16dd22f10a6f85_.log
2024-12-18T02:30:04.6249275Z Running 12 items in this shard: test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier_hash_store, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier_timeout_operations, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier_timeout_rank_tracing, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_get_all_rank_0, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_get_all_rank_n, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_synchronize, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_synchronize_hash_store, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_custom_name, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_different, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_none
2024-12-18T02:30:04.6256760Z 
2024-12-18T02:30:05.4355553Z Running test batch 'tests to run' cost 7841.3 seconds
2024-12-18T02:30:06.2083319Z 
2024-12-18T02:30:06.2083794Z real	130m47.152s
2024-12-18T02:30:06.2084093Z user	238m50.283s
2024-12-18T02:30:06.2084694Z sys	35m48.245s
2024-12-18T02:30:06.2084945Z + assert_git_not_dirty
2024-12-18T02:30:06.2085293Z + [[ linux-jammy-py3.9-gcc11 != *rocm* ]]
2024-12-18T02:30:06.2085653Z + [[ linux-jammy-py3.9-gcc11 != *xla* ]]
2024-12-18T02:30:06.2090439Z ++ git status --porcelain
2024-12-18T02:30:06.2090878Z ++ grep -v '?? third_party'
2024-12-18T02:30:33.9766336Z ++ true
2024-12-18T02:30:33.9767124Z + git_status=
2024-12-18T02:30:33.9767471Z + [[ -n '' ]]
2024-12-18T02:30:33.9767833Z + [[ linux-jammy-py3.9-gcc11 == *cuda* ]]
2024-12-18T02:30:33.9768279Z + [[ linux-jammy-py3.9-gcc11 == *rocm* ]]
2024-12-18T02:30:33.9768775Z + [[ 2 == 1 ]]
2024-12-18T02:30:33.9769136Z + cleanup_workspace
2024-12-18T02:30:33.9771550Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.'
2024-12-18T02:30:33.9772746Z sudo may print the following warning message that can be ignored. The chown command will still run.
2024-12-18T02:30:33.9773574Z + echo '    sudo: setrlimit(RLIMIT_STACK): Operation not permitted'
2024-12-18T02:30:33.9774314Z     sudo: setrlimit(RLIMIT_STACK): Operation not permitted
2024-12-18T02:30:33.9774871Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42'
2024-12-18T02:30:33.9775476Z For more details refer to https://github.com/sudo-project/sudo/issues/42
2024-12-18T02:30:33.9775961Z + sudo chown -R 1000 /var/lib/jenkins/workspace
2024-12-18T02:30:36.8251499Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@release/2.6
2024-12-18T02:30:36.8252027Z with:
2024-12-18T02:30:36.8252287Z   benchmark-results-dir: test/test-reports
2024-12-18T02:30:36.8252623Z   dry-run: false
2024-12-18T02:30:36.8252857Z   schema-version: v3
2024-12-18T02:30:36.8253356Z   github-token: ***
2024-12-18T02:30:36.8253606Z env:
2024-12-18T02:30:36.8253830Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:36.8254307Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:36.8254886Z ##[endgroup]
2024-12-18T02:30:36.8278279Z ##[group]Run set -eux
2024-12-18T02:30:36.8278571Z set -eux
2024-12-18T02:30:36.8278846Z python3 -mpip install boto3==1.35.33
2024-12-18T02:30:36.8314379Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:36.8314784Z env:
2024-12-18T02:30:36.8315018Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:36.8315544Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:36.8316044Z ##[endgroup]
2024-12-18T02:30:36.8346340Z + python3 -mpip install boto3==1.35.33
2024-12-18T02:30:37.1098693Z Defaulting to user installation because normal site-packages is not writeable
2024-12-18T02:30:38.1898164Z Collecting boto3==1.35.33
2024-12-18T02:30:38.2273532Z   Downloading boto3-1.35.33-py3-none-any.whl (139 kB)
2024-12-18T02:30:39.3635034Z Collecting botocore<1.36.0,>=1.35.33
2024-12-18T02:30:39.3676726Z   Downloading botocore-1.35.83-py3-none-any.whl (13.3 MB)
2024-12-18T02:30:39.5307231Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0)
2024-12-18T02:30:39.6045800Z Collecting s3transfer<0.11.0,>=0.10.0
2024-12-18T02:30:39.6090173Z   Downloading s3transfer-0.10.4-py3-none-any.whl (83 kB)
2024-12-18T02:30:39.6196738Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.1)
2024-12-18T02:30:39.6209596Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10)
2024-12-18T02:30:39.7463101Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0)
2024-12-18T02:30:39.8356590Z Installing collected packages: botocore, s3transfer, boto3
2024-12-18T02:30:40.3977161Z Successfully installed boto3-1.35.33 botocore-1.35.83 s3transfer-0.10.4
2024-12-18T02:30:40.5147697Z ##[group]Run set -eux
2024-12-18T02:30:40.5148021Z set -eux
2024-12-18T02:30:40.5148255Z 
2024-12-18T02:30:40.5148515Z if [[ -z "${GITHUB_TOKEN}" ]]; then
2024-12-18T02:30:40.5148890Z   echo "Missing github-token input"
2024-12-18T02:30:40.5149225Z   exit 1
2024-12-18T02:30:40.5149468Z fi
2024-12-18T02:30:40.5159962Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:40.5160367Z env:
2024-12-18T02:30:40.5160600Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:40.5161076Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:40.5161977Z   GITHUB_TOKEN: ***
2024-12-18T02:30:40.5162233Z ##[endgroup]
2024-12-18T02:30:40.5186428Z + [[ -z *** ]]
2024-12-18T02:30:40.5263918Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main
2024-12-18T02:30:40.5264700Z with:
2024-12-18T02:30:40.5265298Z   github-token: ***
2024-12-18T02:30:40.5265692Z env:
2024-12-18T02:30:40.5266316Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:40.5267148Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:40.5268065Z ##[endgroup]
2024-12-18T02:30:40.5292320Z ##[group]Run set -eux
2024-12-18T02:30:40.5292608Z set -eux
2024-12-18T02:30:40.5292856Z 
2024-12-18T02:30:40.5293508Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2024-12-18T02:30:40.5299413Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:40.5299808Z env:
2024-12-18T02:30:40.5300041Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:40.5300521Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:40.5301287Z   GITHUB_TOKEN: ***
2024-12-18T02:30:40.5301643Z ##[endgroup]
2024-12-18T02:30:40.5325240Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 12383255652 i-0e3f9f9d03e28a547
2024-12-18T02:30:43.8226800Z setting job-id=34566861385
2024-12-18T02:30:43.8227366Z setting job-name=linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T02:30:43.8343894Z ##[group]Run set -eux
2024-12-18T02:30:43.8344199Z set -eux
2024-12-18T02:30:43.8344440Z 
2024-12-18T02:30:43.8344858Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \
2024-12-18T02:30:43.8345395Z   --schema-version "${SCHEMA_VERSION}" \
2024-12-18T02:30:43.8345758Z   --repo "${REPO}" \
2024-12-18T02:30:43.8346079Z   --head-branch "${HEAD_BRANCH}" \
2024-12-18T02:30:43.8346418Z   --head-sha "${HEAD_SHA}" \
2024-12-18T02:30:43.8346770Z   --workflow-id "${WORKFLOW_RUN_ID}" \
2024-12-18T02:30:43.8347141Z   --run-attempt "${RUN_ATTEMPT}" \
2024-12-18T02:30:43.8347488Z   --job-id "${JOB_ID}" \
2024-12-18T02:30:43.8347806Z   --job-name "${JOB_NAME}"
2024-12-18T02:30:43.8353525Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:43.8353927Z env:
2024-12-18T02:30:43.8354166Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:43.8354644Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:43.8355158Z   SCHEMA_VERSION: v3
2024-12-18T02:30:43.8355440Z   REPO: pytorch/pytorch
2024-12-18T02:30:43.8355715Z   HEAD_BRANCH: refs/heads/release/2.6
2024-12-18T02:30:43.8356081Z   HEAD_SHA: 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7
2024-12-18T02:30:43.8356442Z   WORKFLOW_RUN_ID: 12383255652
2024-12-18T02:30:43.8356727Z   RUN_ATTEMPT: 1
2024-12-18T02:30:43.8356968Z   JOB_ID: 34566861385
2024-12-18T02:30:43.8357351Z   JOB_NAME: linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)
2024-12-18T02:30:43.8357805Z ##[endgroup]
2024-12-18T02:30:43.8383985Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/release/2.6 --head-sha 0cdf8b1d09254cfda66191d1bd01e3041c3c76f7 --workflow-id 12383255652 --run-attempt 1 --job-id 34566861385 --job-name 'linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)'
2024-12-18T02:30:43.8723707Z ##[group]Run set -eux
2024-12-18T02:30:43.8724029Z set -eux
2024-12-18T02:30:43.8724264Z 
2024-12-18T02:30:43.8724534Z # TODO (huydhn): Implement this part
2024-12-18T02:30:43.8724926Z echo "runners=[]" >> "${GITHUB_OUTPUT}"
2024-12-18T02:30:43.8730714Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:43.8731143Z env:
2024-12-18T02:30:43.8731368Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:43.8731854Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:43.8732370Z ##[endgroup]
2024-12-18T02:30:43.8756285Z + echo 'runners=[]'
2024-12-18T02:30:43.8781668Z ##[group]Run set -eux
2024-12-18T02:30:43.8781952Z set -eux
2024-12-18T02:30:43.8782202Z 
2024-12-18T02:30:43.8782467Z # TODO (huydhn): Implement this part
2024-12-18T02:30:43.8782867Z echo "dependencies={}" >> "${GITHUB_OUTPUT}"
2024-12-18T02:30:43.8788211Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:43.8788785Z env:
2024-12-18T02:30:43.8789020Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:43.8789487Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:43.8790000Z ##[endgroup]
2024-12-18T02:30:43.8811954Z + echo 'dependencies={}'
2024-12-18T02:30:43.8857915Z ##[group]Run set -eux
2024-12-18T02:30:43.8858377Z set -eux
2024-12-18T02:30:43.8858770Z 
2024-12-18T02:30:43.8859213Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then
2024-12-18T02:30:43.8859995Z   echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping"
2024-12-18T02:30:43.8860902Z   # We don't want the job to fail if the directory doesn't exist
2024-12-18T02:30:43.8861660Z   exit 0
2024-12-18T02:30:43.8862074Z fi
2024-12-18T02:30:43.8862445Z 
2024-12-18T02:30:43.8862837Z if [[ "${DRY_RUN}" == "true" ]]; then
2024-12-18T02:30:43.8863718Z   python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \
2024-12-18T02:30:43.8864756Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2024-12-18T02:30:43.8865543Z     --metadata "${BENCHMARK_METADATA}" \
2024-12-18T02:30:43.8866201Z     --runners "${RUNNER_INFO}" \
2024-12-18T02:30:43.8866848Z     --dependencies "${DEPENDENCIES}" \
2024-12-18T02:30:43.8867461Z     --dry-run
2024-12-18T02:30:43.8867900Z else
2024-12-18T02:30:43.8868612Z   python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \
2024-12-18T02:30:43.8869647Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2024-12-18T02:30:43.8870429Z     --metadata "${BENCHMARK_METADATA}" \
2024-12-18T02:30:43.8871081Z     --runners "${RUNNER_INFO}" \
2024-12-18T02:30:43.8871699Z     --dependencies "${DEPENDENCIES}"
2024-12-18T02:30:43.8872298Z fi
2024-12-18T02:30:43.8880070Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:43.8880771Z env:
2024-12-18T02:30:43.8881151Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:43.8881976Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:43.8882930Z   BENCHMARK_RESULTS_DIR: test/test-reports
2024-12-18T02:30:43.8883618Z   DRY_RUN: false
2024-12-18T02:30:43.8886079Z   BENCHMARK_METADATA: {"timestamp": 1734489043, "schema_version": "v3", "name": "linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566861385}
2024-12-18T02:30:43.8888675Z   RUNNER_INFO: []
2024-12-18T02:30:43.8889108Z   DEPENDENCIES: {}
2024-12-18T02:30:43.8889542Z ##[endgroup]
2024-12-18T02:30:43.8914635Z + [[ ! -d test/test-reports ]]
2024-12-18T02:30:43.8914963Z + [[ false == \t\r\u\e ]]
2024-12-18T02:30:43.8917313Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/release/2.6/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1734489043, "schema_version": "v3", "name": "linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/release/2.6", "head_sha": "0cdf8b1d09254cfda66191d1bd01e3041c3c76f7", "workflow_id": 12383255652, "run_attempt": 1, "job_id": 34566861385}' --runners '[]' --dependencies '{}'
2024-12-18T02:30:44.1887160Z ##[group]Run cat test/**/*_toprint.log || true
2024-12-18T02:30:44.1887754Z cat test/**/*_toprint.log || true
2024-12-18T02:30:44.1893401Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.1893795Z env:
2024-12-18T02:30:44.1894025Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.1894499Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.1895006Z ##[endgroup]
2024-12-18T02:30:44.1964003Z cat: 'test/**/*_toprint.log': No such file or directory
2024-12-18T02:30:44.1998571Z ##[group]Run kill "$MONITOR_SCRIPT_PID"
2024-12-18T02:30:44.1998941Z kill "$MONITOR_SCRIPT_PID"
2024-12-18T02:30:44.2004349Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.2004753Z env:
2024-12-18T02:30:44.2004987Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.2005469Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.2005996Z   MONITOR_SCRIPT_PID: 39960
2024-12-18T02:30:44.2006268Z ##[endgroup]
2024-12-18T02:30:44.2155142Z Prepare all required actions
2024-12-18T02:30:44.2156031Z Getting action download info
2024-12-18T02:30:44.3780530Z Download action repository 'actions/upload-artifact@v4' (SHA:6f51ac03b9356f520e9adb1b1b7802705f340c2b)
2024-12-18T02:30:44.6468454Z ##[group]Run ./.github/actions/upload-test-artifacts
2024-12-18T02:30:44.6468848Z with:
2024-12-18T02:30:44.6469189Z   file-suffix: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T02:30:44.6469619Z   s3-bucket: gha-artifacts
2024-12-18T02:30:44.6469892Z env:
2024-12-18T02:30:44.6470125Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.6470636Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.6471152Z ##[endgroup]
2024-12-18T02:30:44.6501407Z ##[group]Run # Remove any previous test jsons if they exist
2024-12-18T02:30:44.6501893Z # Remove any previous test jsons if they exist
2024-12-18T02:30:44.6502287Z rm -f test-jsons-*.zip
2024-12-18T02:30:44.6502777Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json'
2024-12-18T02:30:44.6509697Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.6510080Z env:
2024-12-18T02:30:44.6510315Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.6510798Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.6511407Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T02:30:44.6511809Z ##[endgroup]
2024-12-18T02:30:44.6669237Z   adding: test/test-reports/td_exclusions-09caac6772c1e5935cf9.json (deflated 86%)
2024-12-18T02:30:44.6699790Z ##[group]Run # Remove any previous test reports if they exist
2024-12-18T02:30:44.6700288Z # Remove any previous test reports if they exist
2024-12-18T02:30:44.6700687Z rm -f test-reports-*.zip
2024-12-18T02:30:44.6701166Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv'
2024-12-18T02:30:44.6706908Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.6707314Z env:
2024-12-18T02:30:44.6707548Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.6708024Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.6708630Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T02:30:44.6709011Z ##[endgroup]
2024-12-18T02:30:44.6837509Z   adding: test/test-reports/python-pytest/distributed._tools.test_runtime_estimator/distributed._tools.test_runtime_estimator-4ba193032f404c40.xml (deflated 64%)
2024-12-18T02:30:44.6839561Z   adding: test/test-reports/python-pytest/distributed.test_inductor_collectives/distributed.test_inductor_collectives-d9a1fade2c178310.xml (deflated 94%)
2024-12-18T02:30:44.6841952Z   adding: test/test-reports/python-pytest/distributed.test_device_mesh/distributed.test_device_mesh-eef393ef5bc1357e.xml (deflated 86%)
2024-12-18T02:30:44.6843964Z   adding: test/test-reports/python-pytest/distributed._tensor.test_xla_integration/distributed._tensor.test_xla_integration-944b2fa363d44c26.xml (deflated 74%)
2024-12-18T02:30:44.6846289Z   adding: test/test-reports/python-pytest/distributed._tensor.test_convolution_ops/distributed._tensor.test_convolution_ops-285495751dc92f9a.xml (deflated 54%)
2024-12-18T02:30:44.6848315Z   adding: test/test-reports/python-pytest/distributed._tensor.test_random_ops/distributed._tensor.test_random_ops-1d4672b4a27bd51b.xml (deflated 87%)
2024-12-18T02:30:44.6850564Z   adding: test/test-reports/python-pytest/distributed.launcher.test_run/distributed.launcher.test_run-a94f92377ae80609.xml (deflated 84%)
2024-12-18T02:30:44.6852859Z   adding: test/test-reports/python-pytest/distributed._tensor.test_pointwise_ops/distributed._tensor.test_pointwise_ops-b797999e9b043045.xml (deflated 70%)
2024-12-18T02:30:44.6855692Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_init/distributed._composable.fsdp.test_fully_shard_init-cbfc57db9c4c5747.xml (deflated 92%)
2024-12-18T02:30:44.6858208Z   adding: test/test-reports/python-pytest/distributed._tensor.test_embedding_ops/distributed._tensor.test_embedding_ops-bf9e6618228c8ca4.xml (deflated 67%)
2024-12-18T02:30:44.6860634Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_clip_grad_norm_/distributed._composable.fsdp.test_fully_shard_clip_grad_norm_-df8117d190cdca26.xml (deflated 53%)
2024-12-18T02:30:44.6863276Z   adding: test/test-reports/python-pytest/distributed._tensor.test_view_ops/distributed._tensor.test_view_ops-9f502b8f53d3dc47.xml (deflated 64%)
2024-12-18T02:30:44.6865786Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_extensions/distributed._composable.fsdp.test_fully_shard_extensions-7af3aabbc85d65a9.xml (deflated 80%)
2024-12-18T02:30:44.6868258Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_wrap/distributed.fsdp.test_wrap-12b4d5a0a798a6f0.xml (deflated 94%)
2024-12-18T02:30:44.6869627Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_autograd/distributed._composable.fsdp.test_fully_shard_autograd-99dfd1e10c234df3.xml (deflated 68%)
2024-12-18T02:30:44.6871747Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_clip_grad_norm/distributed.fsdp.test_fsdp_clip_grad_norm-a5816dc1d74aee81.xml (deflated 28%)
2024-12-18T02:30:44.6874115Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_misc/distributed.fsdp.test_fsdp_misc-2b78dede585d0996.xml (deflated 90%)
2024-12-18T02:30:44.6876323Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-13d30df818a8c4ba.xml (deflated 37%)
2024-12-18T02:30:44.6878451Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-4cead3b205743cdc.xml (deflated 35%)
2024-12-18T02:30:44.6880597Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-8403873f81d91489.xml (deflated 35%)
2024-12-18T02:30:44.6882801Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-4603e88ce0e20567.xml (deflated 34%)
2024-12-18T02:30:44.6884836Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-b9100cf2306f0e09.xml (deflated 36%)
2024-12-18T02:30:44.6886954Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-f9afc1202c25dbe8.xml (deflated 35%)
2024-12-18T02:30:44.6889077Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-2cea07181e0ca65b.xml (deflated 35%)
2024-12-18T02:30:44.6891245Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-86734c3900d5d082.xml (deflated 34%)
2024-12-18T02:30:44.6893087Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-aecff88583f3f9cf.xml (deflated 34%)
2024-12-18T02:30:44.6895007Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-4a9a9493791b2582.xml (deflated 34%)
2024-12-18T02:30:44.6897006Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-dc44c9623733293f.xml (deflated 36%)
2024-12-18T02:30:44.6899115Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-96055f98c85488f8.xml (deflated 34%)
2024-12-18T02:30:44.6901222Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-e387641b152273e9.xml (deflated 34%)
2024-12-18T02:30:44.6903340Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-f9a5c4ee4489f854.xml (deflated 34%)
2024-12-18T02:30:44.6905295Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-6cee00c910fe6051.xml (deflated 34%)
2024-12-18T02:30:44.6907250Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-69e678e3e601a5c2.xml (deflated 35%)
2024-12-18T02:30:44.6909377Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-24d201cd1e8dce0d.xml (deflated 36%)
2024-12-18T02:30:44.6911459Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-328d9e712767a80f.xml (deflated 36%)
2024-12-18T02:30:44.6913570Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-16762da2690755ec.xml (deflated 36%)
2024-12-18T02:30:44.6915690Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-3c63e42530522deb.xml (deflated 36%)
2024-12-18T02:30:44.6917798Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-bde91bdb9670bd8b.xml (deflated 35%)
2024-12-18T02:30:44.6919914Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-917ec656ee5eca89.xml (deflated 34%)
2024-12-18T02:30:44.6922190Z   adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-f4b95ca81fbb4e0a.xml (deflated 33%)
2024-12-18T02:30:44.6924785Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_tensor_ops/distributed._shard.sharded_tensor.ops.test_tensor_ops-acdf6c00ed5525d5.xml (deflated 83%)
2024-12-18T02:30:44.6927679Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding/distributed._shard.sharded_tensor.ops.test_embedding-069c246de2e19001.xml (deflated 68%)
2024-12-18T02:30:44.6930613Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_embedding_bag/distributed._shard.sharded_tensor.ops.test_embedding_bag-5336eb94c91c93d8.xml (deflated 68%)
2024-12-18T02:30:44.6933439Z   adding: test/test-reports/python-pytest/distributed.flight_recorder.test_fr_analysis/distributed.flight_recorder.test_fr_analysis-cdd85ecb462dcf9b.xml (deflated 36%)
2024-12-18T02:30:44.6936036Z   adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor_compile/distributed._tensor.test_dtensor_compile-bba63de72c9aae6e.xml (deflated 84%)
2024-12-18T02:30:44.6938689Z   adding: test/test-reports/python-pytest/distributed._tensor.debug.test_op_coverage/distributed._tensor.debug.test_op_coverage-fb2012943de7371a.xml (deflated 35%)
2024-12-18T02:30:44.6941138Z   adding: test/test-reports/python-pytest/distributed._tools.test_mod_tracker/distributed._tools.test_mod_tracker-fae5f4dc0fe77c8f.xml (deflated 65%)
2024-12-18T02:30:44.6943580Z   adding: test/test-reports/python-pytest/distributed.test_compute_comm_reordering/distributed.test_compute_comm_reordering-26495ec9acb62996.xml (deflated 86%)
2024-12-18T02:30:44.6946303Z   adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_micro_pipeline_tp/distributed.tensor.parallel.test_micro_pipeline_tp-a2fbdbcccf57d7d4.xml (deflated 95%)
2024-12-18T02:30:44.6949265Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_nested_dict/distributed.checkpoint.test_nested_dict-8d084cf73c07ab2c.xml (deflated 51%)
2024-12-18T02:30:44.6951837Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_transformer/distributed.pipelining.test_transformer-b9596c0f0c573940.xml (deflated 40%)
2024-12-18T02:30:44.6954373Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_backward/distributed.pipelining.test_backward-385487c479565b59.xml (deflated 68%)
2024-12-18T02:30:44.6956913Z   adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.test_logger/distributed._shard.sharded_tensor.test_logger-b9d4b0ef9e2eb1c0.xml (deflated 37%)
2024-12-18T02:30:44.6959418Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_pipe/distributed.pipelining.test_pipe-7f0c044a4b02741f.xml (deflated 65%)
2024-12-18T02:30:44.6962402Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_compile/distributed._composable.fsdp.test_fully_shard_compile-0baaaf08859db615.xml (deflated 91%)
2024-12-18T02:30:44.6965142Z   adding: test/test-reports/python-pytest/distributed._tools.test_sac_estimator/distributed._tools.test_sac_estimator-01b88632a94229f0.xml (deflated 63%)
2024-12-18T02:30:44.6967435Z   adding: test/test-reports/python-pytest/distributed._tools.test_sac_ilp/distributed._tools.test_sac_ilp-eeefdd89bbc6736f.xml (deflated 75%)
2024-12-18T02:30:44.6969766Z   adding: test/test-reports/python-pytest/distributed.test_c10d_functional_native/distributed.test_c10d_functional_native-8198e1fe5436e21e.xml (deflated 93%)
2024-12-18T02:30:44.6972121Z   adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor/distributed._tensor.test_dtensor-d46710b8e5b64635.xml (deflated 86%)
2024-12-18T02:30:44.6974457Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_unflatten/distributed.pipelining.test_unflatten-dcfcee73b5ab97b8.xml (deflated 42%)
2024-12-18T02:30:44.6976645Z   adding: test/test-reports/python-pytest/distributed.checkpoint.fsdp.test_fsdp_dsd/distributed.checkpoint.fsdp.test_fsdp_dsd-fa3a0801e757a085.xml (deflated 76%)
2024-12-18T02:30:44.6978576Z   adding: test/test-reports/python-pytest/distributed.test_backends/distributed.test_backends-8befa40f1496da43.xml (deflated 49%)
2024-12-18T02:30:44.6981069Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_logging/distributed._composable.fsdp.test_fully_shard_logging-b53324075bc931d4.xml (deflated 28%)
2024-12-18T02:30:44.6983691Z   adding: test/test-reports/python-pytest/distributed.test_symmetric_memory/distributed.test_symmetric_memory-196bff82da8090ac.xml (deflated 97%)
2024-12-18T02:30:44.6986052Z   adding: test/test-reports/python-pytest/distributed._tools.test_memory_tracker/distributed._tools.test_memory_tracker-ccb2f38e084bc271.xml (deflated 44%)
2024-12-18T02:30:44.6988984Z   adding: test/test-reports/python-pytest/distributed._composable.test_composability.test_pp_composability/distributed._composable.test_composability.test_pp_composability-e2eccf082cd482f7.xml (deflated 95%)
2024-12-18T02:30:44.6991667Z   adding: test/test-reports/python-pytest/distributed.test_fake_pg/distributed.test_fake_pg-9582486da01cd01c.xml (deflated 81%)
2024-12-18T02:30:44.6993978Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_optim_state/distributed.checkpoint.test_fsdp_optim_state-3d6794a930f5f89a.xml (deflated 65%)
2024-12-18T02:30:44.6996707Z   adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_local_map/distributed._tensor.experimental.test_local_map-77b97677d546d3fb.xml (deflated 68%)
2024-12-18T02:30:44.6999389Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_format_utils/distributed.checkpoint.test_format_utils-0a13cd1a187930e9.xml (deflated 59%)
2024-12-18T02:30:44.7002054Z   adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode_features/distributed._tensor.debug.test_comm_mode_features-343298d5fddbbe96.xml (deflated 66%)
2024-12-18T02:30:44.7004942Z   adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fine_tuning/distributed.checkpoint.e2e.test_fine_tuning-159dbc46d82c4315.xml (deflated 37%)
2024-12-18T02:30:44.7007721Z   adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_tp_transform/distributed._tensor.experimental.test_tp_transform-7533c3b2fa146d96.xml (deflated 62%)
2024-12-18T02:30:44.7010488Z   adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_pipeline/distributed.checkpoint.e2e.test_pipeline-b17593282ffc05f3.xml (deflated 38%)
2024-12-18T02:30:44.7013001Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_traverse/distributed.checkpoint.test_traverse-f63463d9e2be4104.xml (deflated 76%)
2024-12-18T02:30:44.7015827Z   adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_random_state/distributed.tensor.parallel.test_tp_random_state-f5cdb40feac787f6.xml (deflated 46%)
2024-12-18T02:30:44.7018689Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_checkpoint/distributed.checkpoint.test_dtensor_checkpoint-9a92902be9a3f739.xml (deflated 47%)
2024-12-18T02:30:44.7021575Z   adding: test/test-reports/python-pytest/distributed._composable.test_replicate_with_compiler/distributed._composable.test_replicate_with_compiler-97ab9a2dc62d2a07.xml (deflated 84%)
2024-12-18T02:30:44.7024367Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_tp_checkpoint/distributed.checkpoint.test_tp_checkpoint-c69c851a6ac573b5.xml (deflated 65%)
2024-12-18T02:30:44.7027139Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_overlap/distributed._composable.fsdp.test_fully_shard_overlap-21bca210d6b83168.xml (deflated 62%)
2024-12-18T02:30:44.7029834Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_planner/distributed.checkpoint.test_planner-e1db2936d05ab3b8.xml (deflated 70%)
2024-12-18T02:30:44.7032627Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion-25e7279253052b6a.xml (deflated 48%)
2024-12-18T02:30:44.7035560Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict_utils/distributed.checkpoint.test_state_dict_utils-74c5892b2b15592e.xml (deflated 74%)
2024-12-18T02:30:44.7038058Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_shard_utils/distributed.fsdp.test_shard_utils-6fb7705af9f2f9b2.xml (deflated 63%)
2024-12-18T02:30:44.7040778Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_compatibility/distributed.checkpoint.test_compatibility-08c6031e01abfa6e.xml (deflated 69%)
2024-12-18T02:30:44.7043548Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_hsdp_checkpoint/distributed.checkpoint.test_hsdp_checkpoint-68d050caba46fc96.xml (deflated 79%)
2024-12-18T02:30:44.7046058Z   adding: test/test-reports/python-pytest/distributed.test_functional_api/distributed.test_functional_api-f9ef1aaa8482a207.xml (deflated 48%)
2024-12-18T02:30:44.7048635Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_state/distributed._composable.fsdp.test_fully_shard_state-5f6237866898534b.xml (deflated 81%)
2024-12-18T02:30:44.7051297Z   adding: test/test-reports/python-pytest/distributed.test_control_collectives/distributed.test_control_collectives-4333e1afcfc41ffb.xml (deflated 84%)
2024-12-18T02:30:44.7053945Z   adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode/distributed._tensor.debug.test_comm_mode-baddeee6562cdd66.xml (deflated 60%)
2024-12-18T02:30:44.7056441Z   adding: test/test-reports/python-pytest/distributed._composable.test_replicate/distributed._composable.test_replicate-8e14d7925a95d8cd.xml (deflated 87%)
2024-12-18T02:30:44.7059232Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_grad_scaler/distributed._composable.fsdp.test_fully_shard_grad_scaler-28bc56c03bc88c22.xml (deflated 47%)
2024-12-18T02:30:44.7062159Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_utils/distributed.checkpoint.test_utils-23ef8bfa44758975.xml (deflated 71%)
2024-12-18T02:30:44.7064430Z   adding: test/test-reports/python-pytest/distributed._tensor.test_utils/distributed._tensor.test_utils-094dab60559400db.xml (deflated 77%)
2024-12-18T02:30:44.7066779Z   adding: test/test-reports/python-pytest/distributed.pipelining.test_schedule/distributed.pipelining.test_schedule-cd00a1b19d57af8f.xml (deflated 90%)
2024-12-18T02:30:44.7069235Z   adding: test/test-reports/python-pytest/distributed._tensor.test_op_strategy/distributed._tensor.test_op_strategy-cd2ec8bcb7f74056.xml (deflated 84%)
2024-12-18T02:30:44.7071774Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_model_state/distributed.checkpoint.test_fsdp_model_state-21e497b3d242e3dd.xml (deflated 65%)
2024-12-18T02:30:44.7074673Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_comm/distributed._composable.fsdp.test_fully_shard_comm-11ac27133e34bc3a.xml (deflated 84%)
2024-12-18T02:30:44.7077221Z   adding: test/test-reports/python-pytest/distributed.rpc.test_share_memory/distributed.rpc.test_share_memory-62b88a34dd4f41b9.xml (deflated 48%)
2024-12-18T02:30:44.7079672Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_dtensor_state_dict/distributed.fsdp.test_fsdp_dtensor_state_dict-966926f603a788a2.xml (deflated 28%)
2024-12-18T02:30:44.7082272Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_checkpoint/distributed.checkpoint.test_checkpoint-9713390ca63be5e3.xml (deflated 84%)
2024-12-18T02:30:44.7084851Z   adding: test/test-reports/python-pytest/distributed.nn.jit.test_instantiator/distributed.nn.jit.test_instantiator-496e083a2b80001a.xml (deflated 61%)
2024-12-18T02:30:44.7087371Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_backward_prefetch/distributed.fsdp.test_fsdp_backward_prefetch-b0337b0752ba412f.xml (deflated 47%)
2024-12-18T02:30:44.7089879Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_pure_fp16/distributed.fsdp.test_fsdp_pure_fp16-367e23a139e7ba2a.xml (deflated 28%)
2024-12-18T02:30:44.7092308Z   adding: test/test-reports/python-pytest/distributed.test_c10d_object_collectives/distributed.test_c10d_object_collectives-770fd718eab73ac2.xml (deflated 80%)
2024-12-18T02:30:44.7094718Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_memory/distributed.fsdp.test_fsdp_memory-3810dfd12c7c1959.xml (deflated 64%)
2024-12-18T02:30:44.7097303Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_frozen/distributed._composable.fsdp.test_fully_shard_frozen-ed59051b9d27036c.xml (deflated 62%)
2024-12-18T02:30:44.7100217Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_file_system_checkpoint/distributed.checkpoint.test_file_system_checkpoint-e4aba706ba23b6d7.xml (deflated 80%)
2024-12-18T02:30:44.7102689Z   adding: test/test-reports/python-pytest/distributed.test_c10d_pypg/distributed.test_c10d_pypg-45403d88743d2338.xml (deflated 94%)
2024-12-18T02:30:44.7105150Z   adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_parallelize_api/distributed.tensor.parallel.test_parallelize_api-19235d7d1dfe710b.xml (deflated 83%)
2024-12-18T02:30:44.7107724Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_apply/distributed.fsdp.test_fsdp_apply-f28fc19c1106b96d.xml (deflated 28%)
2024-12-18T02:30:44.7110128Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_flatten_params/distributed.fsdp.test_fsdp_flatten_params-e89d92cbc482e778.xml (deflated 85%)
2024-12-18T02:30:44.7112612Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_traversal/distributed.fsdp.test_fsdp_traversal-6a2bbba98114cce2.xml (deflated 28%)
2024-12-18T02:30:44.7115104Z   adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict/distributed.checkpoint.test_state_dict-aad1ff3890f4adef.xml (deflated 84%)
2024-12-18T02:30:44.7117919Z   adding: test/test-reports/python-pytest/distributed.optim.test_zero_redundancy_optimizer/distributed.optim.test_zero_redundancy_optimizer-2c56c904de577b1f.xml (deflated 94%)
2024-12-18T02:30:44.7120666Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_multiple_wrapping/distributed.fsdp.test_fsdp_multiple_wrapping-496bcaa117cac8be.xml (deflated 28%)
2024-12-18T02:30:44.7123609Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_mixed_precision/distributed._composable.fsdp.test_fully_shard_mixed_precision-6679f68508451915.xml (deflated 82%)
2024-12-18T02:30:44.7126906Z   adding: test/test-reports/python-pytest/distributed._composable.test_composability.test_2d_composability/distributed._composable.test_composability.test_2d_composability-0cb1ee250f27e96f.xml (deflated 90%)
2024-12-18T02:30:44.7130217Z   adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_state_dict/distributed._composable.fsdp.test_fully_shard_state_dict-dced1065edc7c93c.xml (deflated 74%)
2024-12-18T02:30:44.7132803Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-5c37a0d427c974d5.xml (deflated 44%)
2024-12-18T02:30:44.7134932Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-b6f2f4c25ea1d778.xml (deflated 44%)
2024-12-18T02:30:44.7137046Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-98bd83de979c2d91.xml (deflated 44%)
2024-12-18T02:30:44.7139387Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-424d69b83edee191.xml (deflated 43%)
2024-12-18T02:30:44.7140743Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-e37132779dfe9a8e.xml (deflated 44%)
2024-12-18T02:30:44.7142007Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-210a2d3b8b05bd71.xml (deflated 44%)
2024-12-18T02:30:44.7143266Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-8e432b2c8e13b7e5.xml (deflated 44%)
2024-12-18T02:30:44.7144491Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-8024db990985f553.xml (deflated 44%)
2024-12-18T02:30:44.7145745Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-0f6601f3055af1e5.xml (deflated 35%)
2024-12-18T02:30:44.7146989Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-ed6b0c6d80ac2863.xml (deflated 42%)
2024-12-18T02:30:44.7148275Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-2151407e0ca94acb.xml (deflated 42%)
2024-12-18T02:30:44.7149571Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-6698d7fc9e46b06a.xml (deflated 35%)
2024-12-18T02:30:44.7150838Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-0e2c2123b761ad2b.xml (deflated 34%)
2024-12-18T02:30:44.7152114Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-a3bf4840c933da6c.xml (deflated 35%)
2024-12-18T02:30:44.7153356Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-2778c928a5f1712d.xml (deflated 42%)
2024-12-18T02:30:44.7154637Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-bac00e2c7d917fb9.xml (deflated 42%)
2024-12-18T02:30:44.7155920Z   adding: test/test-reports/python-pytest/distributed.test_pg_wrapper/distributed.test_pg_wrapper-48a63134871b5176.xml (deflated 34%)
2024-12-18T02:30:44.7157270Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_comm_hooks/distributed.fsdp.test_fsdp_comm_hooks-f82b377cb82e6f65.xml (deflated 94%)
2024-12-18T02:30:44.7158912Z   adding: test/test-reports/python-pytest/distributed.test_data_parallel/distributed.test_data_parallel-40d9312082afa8b7.xml (deflated 94%)
2024-12-18T02:30:44.7160273Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_core/distributed.fsdp.test_fsdp_core-dc776f6c10612432.xml (deflated 28%)
2024-12-18T02:30:44.7161691Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a1c2d408f44438e4.xml (deflated 35%)
2024-12-18T02:30:44.7163239Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4d2020982599b744.xml (deflated 36%)
2024-12-18T02:30:44.7164742Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a53afa90f832f7c2.xml (deflated 36%)
2024-12-18T02:30:44.7166317Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-509679422716834e.xml (deflated 35%)
2024-12-18T02:30:44.7167836Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3c5feef4804dcee8.xml (deflated 35%)
2024-12-18T02:30:44.7169329Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-247a49769f724fd3.xml (deflated 35%)
2024-12-18T02:30:44.7170797Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8fc7d23e58f61f4e.xml (deflated 35%)
2024-12-18T02:30:44.7172250Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4eb10681e3bd96d8.xml (deflated 35%)
2024-12-18T02:30:44.7173747Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e3ceea4cef383a3f.xml (deflated 35%)
2024-12-18T02:30:44.7175219Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-691cdc3d1321df75.xml (deflated 35%)
2024-12-18T02:30:44.7176721Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ddfe2ce174e43da2.xml (deflated 35%)
2024-12-18T02:30:44.7178209Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c7f2c816fca0c695.xml (deflated 35%)
2024-12-18T02:30:44.7179671Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ca08981b741e270a.xml (deflated 36%)
2024-12-18T02:30:44.7181170Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c67d2c9efc4ee050.xml (deflated 35%)
2024-12-18T02:30:44.7182655Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6aab284968c22c35.xml (deflated 35%)
2024-12-18T02:30:44.7184154Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c19d03cd6b22a9dd.xml (deflated 36%)
2024-12-18T02:30:44.7185651Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67d186b3d9646574.xml (deflated 35%)
2024-12-18T02:30:44.7187117Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68e95b8ef7030354.xml (deflated 56%)
2024-12-18T02:30:44.7188578Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-824995b2fbebf46f.xml (deflated 35%)
2024-12-18T02:30:44.7190051Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-91f752041b207e10.xml (deflated 35%)
2024-12-18T02:30:44.7191514Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-844725c16562ff87.xml (deflated 35%)
2024-12-18T02:30:44.7193090Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-330deb2ce0e3e7c8.xml (deflated 35%)
2024-12-18T02:30:44.7194590Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-60ece4ef08186963.xml (deflated 35%)
2024-12-18T02:30:44.7196064Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-086b8dba12d0f782.xml (deflated 35%)
2024-12-18T02:30:44.7197574Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8dff935e7c8e2c5f.xml (deflated 35%)
2024-12-18T02:30:44.7199105Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3ed3ab4881b5764b.xml (deflated 36%)
2024-12-18T02:30:44.7200588Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2db70ce354e000cb.xml (deflated 38%)
2024-12-18T02:30:44.7202053Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-121b3dd1268ab7d8.xml (deflated 36%)
2024-12-18T02:30:44.7203585Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b26c8fb9c4233c07.xml (deflated 36%)
2024-12-18T02:30:44.7205046Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a7fa539719ed3c0.xml (deflated 36%)
2024-12-18T02:30:44.7206526Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5012a177117b68b6.xml (deflated 35%)
2024-12-18T02:30:44.7208004Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-03c1ae4d32656cf5.xml (deflated 36%)
2024-12-18T02:30:44.7209492Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3477774081c163f.xml (deflated 35%)
2024-12-18T02:30:44.7210958Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0608e8b15ded8b39.xml (deflated 36%)
2024-12-18T02:30:44.7212432Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0e5b148d9daae474.xml (deflated 36%)
2024-12-18T02:30:44.7213892Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67123a6ee11a75d0.xml (deflated 36%)
2024-12-18T02:30:44.7215193Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-63442bd6bcdb1b00.xml (deflated 35%)
2024-12-18T02:30:44.7216624Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e89364f02434518d.xml (deflated 35%)
2024-12-18T02:30:44.7217910Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-81a90313cf02104f.xml (deflated 35%)
2024-12-18T02:30:44.7219210Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2b69e733fb8f9081.xml (deflated 35%)
2024-12-18T02:30:44.7220513Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5807e6c525a175f4.xml (deflated 35%)
2024-12-18T02:30:44.7221937Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-24645d0731cb77f2.xml (deflated 35%)
2024-12-18T02:30:44.7224098Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fdaed0f895132537.xml (deflated 35%)
2024-12-18T02:30:44.7225997Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-522c23b6b686772b.xml (deflated 35%)
2024-12-18T02:30:44.7227286Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-996a18f422f52d4e.xml (deflated 34%)
2024-12-18T02:30:44.7228581Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d5fe726fb29ae7ef.xml (deflated 35%)
2024-12-18T02:30:44.7229873Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-58a3d2d68522a9bc.xml (deflated 34%)
2024-12-18T02:30:44.7231156Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-edba3b689b39b5f9.xml (deflated 34%)
2024-12-18T02:30:44.7232542Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e60487db3f9246d.xml (deflated 35%)
2024-12-18T02:30:44.7233841Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef9e4f631ca2e380.xml (deflated 35%)
2024-12-18T02:30:44.7235243Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4738a7665ddb34ef.xml (deflated 35%)
2024-12-18T02:30:44.7236535Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-350541da16beb4d1.xml (deflated 35%)
2024-12-18T02:30:44.7237822Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4c27e79e41818e0e.xml (deflated 35%)
2024-12-18T02:30:44.7239314Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40881c46968e9326.xml (deflated 35%)
2024-12-18T02:30:44.7240615Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b371115f4f2ee947.xml (deflated 36%)
2024-12-18T02:30:44.7241915Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1108fa094611daf1.xml (deflated 36%)
2024-12-18T02:30:44.7243267Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b2816522ef5ef637.xml (deflated 35%)
2024-12-18T02:30:44.7244564Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-560baf7167cb7bce.xml (deflated 34%)
2024-12-18T02:30:44.7245999Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6560ed8a04e38e62.xml (deflated 35%)
2024-12-18T02:30:44.7247300Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f23fb21effe631e2.xml (deflated 35%)
2024-12-18T02:30:44.7248601Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c152a94f20238cbe.xml (deflated 35%)
2024-12-18T02:30:44.7249896Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1e26e97f5323324e.xml (deflated 36%)
2024-12-18T02:30:44.7251191Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-85d91eb994f4dda0.xml (deflated 35%)
2024-12-18T02:30:44.7252480Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-66b6263745c128d8.xml (deflated 35%)
2024-12-18T02:30:44.7253764Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-af86ef2d01447bdf.xml (deflated 35%)
2024-12-18T02:30:44.7255115Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-860b88fa4b9cf2dc.xml (deflated 36%)
2024-12-18T02:30:44.7256581Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-edbe24c88af61278.xml (deflated 35%)
2024-12-18T02:30:44.7257890Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9f0e828a65bfa2c0.xml (deflated 35%)
2024-12-18T02:30:44.7259190Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fb146725b9db0363.xml (deflated 35%)
2024-12-18T02:30:44.7260491Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-45e4d440d83d4316.xml (deflated 36%)
2024-12-18T02:30:44.7261876Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3bde058082ea8dff.xml (deflated 35%)
2024-12-18T02:30:44.7263183Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8ab5e010dcf12196.xml (deflated 36%)
2024-12-18T02:30:44.7264510Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-af1cd6e718b4b4be.xml (deflated 37%)
2024-12-18T02:30:44.7265793Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ce4be7162a8547c.xml (deflated 36%)
2024-12-18T02:30:44.7267088Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba3e587803265c9f.xml (deflated 37%)
2024-12-18T02:30:44.7268383Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c51018cc95b55208.xml (deflated 37%)
2024-12-18T02:30:44.7269676Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5e3a154e99d67d66.xml (deflated 36%)
2024-12-18T02:30:44.7270970Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d7bad35766ac102.xml (deflated 37%)
2024-12-18T02:30:44.7272264Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a9ff0ac926fb0837.xml (deflated 37%)
2024-12-18T02:30:44.7273561Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a0d07adafe715be1.xml (deflated 38%)
2024-12-18T02:30:44.7274863Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-044259ff12ef1073.xml (deflated 38%)
2024-12-18T02:30:44.7276161Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f1f2c1e0e38d346f.xml (deflated 37%)
2024-12-18T02:30:44.7277450Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a6f7b431bd5ed67f.xml (deflated 37%)
2024-12-18T02:30:44.7278750Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ea917bc45042efcf.xml (deflated 36%)
2024-12-18T02:30:44.7280045Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9612db03a4a503bd.xml (deflated 37%)
2024-12-18T02:30:44.7281339Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-10c3b73a0fc03e4d.xml (deflated 35%)
2024-12-18T02:30:44.7282639Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dfb1cde26b3f2fa8.xml (deflated 35%)
2024-12-18T02:30:44.7284082Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-13af22be8d152e63.xml (deflated 35%)
2024-12-18T02:30:44.7285445Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3aec729c78004c4a.xml (deflated 35%)
2024-12-18T02:30:44.7286742Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5e825cd1dabb74b7.xml (deflated 36%)
2024-12-18T02:30:44.7288026Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-311d31309ccb1eae.xml (deflated 35%)
2024-12-18T02:30:44.7289323Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-37f7be3a402ee3ab.xml (deflated 35%)
2024-12-18T02:30:44.7290620Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1924d07af40e6662.xml (deflated 36%)
2024-12-18T02:30:44.7291975Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0b9f594a1dd862b1.xml (deflated 36%)
2024-12-18T02:30:44.7293269Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3323b41fc292d4ce.xml (deflated 36%)
2024-12-18T02:30:44.7294561Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-10786727b886cd6f.xml (deflated 36%)
2024-12-18T02:30:44.7295861Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f5143454bd80c517.xml (deflated 35%)
2024-12-18T02:30:44.7297152Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d18620794e8752c.xml (deflated 36%)
2024-12-18T02:30:44.7298452Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f10ac44f57e51a01.xml (deflated 35%)
2024-12-18T02:30:44.7299734Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f4733289ab5f0690.xml (deflated 36%)
2024-12-18T02:30:44.7301029Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-919dc7760c028582.xml (deflated 36%)
2024-12-18T02:30:44.7302324Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d2ae09d14fecacd5.xml (deflated 36%)
2024-12-18T02:30:44.7303621Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-757997dfb2a6eaca.xml (deflated 35%)
2024-12-18T02:30:44.7320864Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3f5387e19b8b92cf.xml (deflated 35%)
2024-12-18T02:30:44.7322464Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-44759ef4364d57e2.xml (deflated 35%)
2024-12-18T02:30:44.7323856Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e33a49a56a5896f4.xml (deflated 36%)
2024-12-18T02:30:44.7325149Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a7d1aa4bfab2bfc.xml (deflated 35%)
2024-12-18T02:30:44.7326443Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f391584a5440c855.xml (deflated 36%)
2024-12-18T02:30:44.7327731Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f5921f5f892ac778.xml (deflated 36%)
2024-12-18T02:30:44.7329031Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6fa3158563f5d830.xml (deflated 35%)
2024-12-18T02:30:44.7330460Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e12ed839a941b292.xml (deflated 35%)
2024-12-18T02:30:44.7331751Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1c216ffc57e99c62.xml (deflated 37%)
2024-12-18T02:30:44.7333040Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-378eb42c3b6bf572.xml (deflated 35%)
2024-12-18T02:30:44.7334328Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0e2cb7d829d517fa.xml (deflated 35%)
2024-12-18T02:30:44.7335622Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e6c1c436d5cd3189.xml (deflated 35%)
2024-12-18T02:30:44.7336989Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b4d5d30df3e63f3.xml (deflated 35%)
2024-12-18T02:30:44.7338491Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d7577a4ab6b17118.xml (deflated 35%)
2024-12-18T02:30:44.7339956Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f76072c9e577c133.xml (deflated 36%)
2024-12-18T02:30:44.7341253Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eda91495c0db756c.xml (deflated 35%)
2024-12-18T02:30:44.7342564Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bbefee3a5cada7e8.xml (deflated 35%)
2024-12-18T02:30:44.7343868Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2442bb593f645dee.xml (deflated 35%)
2024-12-18T02:30:44.7345183Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7e594e18ffde1607.xml (deflated 36%)
2024-12-18T02:30:44.7346461Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-437bbdd582f7585c.xml (deflated 36%)
2024-12-18T02:30:44.7347752Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-27e02c921d12d24f.xml (deflated 35%)
2024-12-18T02:30:44.7349047Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7f9ac230b2f62d29.xml (deflated 36%)
2024-12-18T02:30:44.7350339Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2e4f5e4fd146d575.xml (deflated 35%)
2024-12-18T02:30:44.7351636Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4a87e144dbd45591.xml (deflated 35%)
2024-12-18T02:30:44.7352936Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7fb1434e11d212e7.xml (deflated 35%)
2024-12-18T02:30:44.7354223Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3f77586cbcde3819.xml (deflated 35%)
2024-12-18T02:30:44.7355513Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba918da939e3fd71.xml (deflated 36%)
2024-12-18T02:30:44.7356805Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f94e5e92e31c5704.xml (deflated 35%)
2024-12-18T02:30:44.7358085Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5d71b1ea2ecc013f.xml (deflated 35%)
2024-12-18T02:30:44.7359380Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-be42932a0ba05871.xml (deflated 35%)
2024-12-18T02:30:44.7360828Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b6104ff5f0e700f.xml (deflated 35%)
2024-12-18T02:30:44.7362116Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-960238242e75476e.xml (deflated 35%)
2024-12-18T02:30:44.7363461Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d6767cf8021f555.xml (deflated 35%)
2024-12-18T02:30:44.7364756Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-94dc848bd20ffab5.xml (deflated 35%)
2024-12-18T02:30:44.7366166Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-42b4f1464acc8e35.xml (deflated 36%)
2024-12-18T02:30:44.7367473Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a267c22676b2f300.xml (deflated 35%)
2024-12-18T02:30:44.7368749Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67afd124156a9398.xml (deflated 34%)
2024-12-18T02:30:44.7370042Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3d74fb7e4a1d54c.xml (deflated 35%)
2024-12-18T02:30:44.7371342Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bb06eab78a6995ca.xml (deflated 34%)
2024-12-18T02:30:44.7372635Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52a9fc75df03834d.xml (deflated 35%)
2024-12-18T02:30:44.7373925Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-61090fc826fb9978.xml (deflated 35%)
2024-12-18T02:30:44.7375222Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f47cd280aab21223.xml (deflated 35%)
2024-12-18T02:30:44.7376513Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eca0d35bed3ed228.xml (deflated 35%)
2024-12-18T02:30:44.7377809Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34b81c309741391e.xml (deflated 34%)
2024-12-18T02:30:44.7379099Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f6e01288e3113aaa.xml (deflated 34%)
2024-12-18T02:30:44.7380380Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f29423ff601db561.xml (deflated 35%)
2024-12-18T02:30:44.7381678Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b33d169205f68860.xml (deflated 35%)
2024-12-18T02:30:44.7382977Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-68f6320ff91ba11a.xml (deflated 36%)
2024-12-18T02:30:44.7384280Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c9504eb463f3c5ab.xml (deflated 35%)
2024-12-18T02:30:44.7385576Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-091001fd43f831af.xml (deflated 35%)
2024-12-18T02:30:44.7386869Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eef3834b7292f86c.xml (deflated 34%)
2024-12-18T02:30:44.7388175Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d2da9ff8412638d7.xml (deflated 35%)
2024-12-18T02:30:44.7389548Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c1674c1973c7fd20.xml (deflated 35%)
2024-12-18T02:30:44.7390837Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6c2315f3ee629298.xml (deflated 35%)
2024-12-18T02:30:44.7392123Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f6ab207cd5777c89.xml (deflated 34%)
2024-12-18T02:30:44.7393419Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b97cbdfe0e58ffac.xml (deflated 35%)
2024-12-18T02:30:44.7394717Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f8c503a80c89b79f.xml (deflated 35%)
2024-12-18T02:30:44.7396075Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-579ac0c2fd814146.xml (deflated 36%)
2024-12-18T02:30:44.7397372Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9a08d1e73e988354.xml (deflated 35%)
2024-12-18T02:30:44.7398666Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dcd179372dca79c9.xml (deflated 35%)
2024-12-18T02:30:44.7399961Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f908c7b5f920d488.xml (deflated 35%)
2024-12-18T02:30:44.7401254Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8930eab3ceac5370.xml (deflated 35%)
2024-12-18T02:30:44.7402552Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ede0e55d5008fd39.xml (deflated 35%)
2024-12-18T02:30:44.7403925Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7cdd25ad02336074.xml (deflated 34%)
2024-12-18T02:30:44.7405224Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52f37da59544a085.xml (deflated 35%)
2024-12-18T02:30:44.7406521Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-448b00b165d858a7.xml (deflated 35%)
2024-12-18T02:30:44.7407822Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-78a296d71700ac3b.xml (deflated 35%)
2024-12-18T02:30:44.7409117Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-91a2f1573189a6af.xml (deflated 35%)
2024-12-18T02:30:44.7410416Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b4204864afd6d149.xml (deflated 35%)
2024-12-18T02:30:44.7411714Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f78466371ecc9b1c.xml (deflated 35%)
2024-12-18T02:30:44.7413006Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f595645acd36a220.xml (deflated 35%)
2024-12-18T02:30:44.7414285Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-800732fb80e4741c.xml (deflated 35%)
2024-12-18T02:30:44.7415579Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6cd49b96c2812581.xml (deflated 35%)
2024-12-18T02:30:44.7416875Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d39ca8a8efdf2b2b.xml (deflated 34%)
2024-12-18T02:30:44.7418272Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-80f049e6f0464e92.xml (deflated 36%)
2024-12-18T02:30:44.7419574Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d0a4b1b413229c37.xml (deflated 35%)
2024-12-18T02:30:44.7420874Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9ef72e291d0f0a92.xml (deflated 35%)
2024-12-18T02:30:44.7422177Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-603cfbc62dd196b3.xml (deflated 35%)
2024-12-18T02:30:44.7423471Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5c1dc113e5a57cb6.xml (deflated 35%)
2024-12-18T02:30:44.7424854Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f122489297a1b6b5.xml (deflated 36%)
2024-12-18T02:30:44.7426142Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26cdbbc8ff4427d3.xml (deflated 37%)
2024-12-18T02:30:44.7427438Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-312fecee3214a52b.xml (deflated 37%)
2024-12-18T02:30:44.7428730Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f2081ea09aa3e49f.xml (deflated 37%)
2024-12-18T02:30:44.7430026Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-013113e80d29ee7a.xml (deflated 37%)
2024-12-18T02:30:44.7431322Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-89bc84152da71eaf.xml (deflated 37%)
2024-12-18T02:30:44.7432632Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-faad1416f55956e6.xml (deflated 37%)
2024-12-18T02:30:44.7433931Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d827093af8b620da.xml (deflated 38%)
2024-12-18T02:30:44.7435226Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c597347e34ca5712.xml (deflated 39%)
2024-12-18T02:30:44.7436519Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52f7695f59f41976.xml (deflated 36%)
2024-12-18T02:30:44.7437799Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6c1fe21c9150c9c6.xml (deflated 37%)
2024-12-18T02:30:44.7439297Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e06717930e62477d.xml (deflated 36%)
2024-12-18T02:30:44.7440592Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0f2042616de088bc.xml (deflated 36%)
2024-12-18T02:30:44.7441888Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0c5887e39448c12b.xml (deflated 37%)
2024-12-18T02:30:44.7443244Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ca6630f6a796da46.xml (deflated 37%)
2024-12-18T02:30:44.7444537Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9a9ce92b47f48508.xml (deflated 37%)
2024-12-18T02:30:44.7445836Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b5f29c0b4202f9a.xml (deflated 37%)
2024-12-18T02:30:44.7447139Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3874fe6920e1c366.xml (deflated 36%)
2024-12-18T02:30:44.7448580Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6cd9d1df7556db10.xml (deflated 38%)
2024-12-18T02:30:44.7449876Z   adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d0b71ca4c2e033f6.xml (deflated 36%)
2024-12-18T02:30:44.7451305Z   adding: test/test-reports/python-pytest/distributed._shard.sharding_plan.test_sharding_plan/distributed._shard.sharding_plan.test_sharding_plan-1ccdefbecfeeefa6.xml (deflated 75%)
2024-12-18T02:30:44.7452767Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_multiple_forward/distributed.fsdp.test_fsdp_multiple_forward-29a0ba1e93cf6673.xml (deflated 46%)
2024-12-18T02:30:44.7454261Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_sharded_grad_scaler/distributed.fsdp.test_fsdp_sharded_grad_scaler-d3ee8887903b0c5f.xml (deflated 93%)
2024-12-18T02:30:44.7455584Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_meta/distributed.fsdp.test_fsdp_meta-682efe6a40cab970.xml (deflated 90%)
2024-12-18T02:30:44.7456858Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_unshard_params/distributed.fsdp.test_fsdp_unshard_params-8a354b96a97b7d73.xml (deflated 89%)
2024-12-18T02:30:44.7458222Z   adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_mixed_precision/distributed.fsdp.test_fsdp_mixed_precision-2f97667cd668f7d9.xml (deflated 95%)
2024-12-18T02:30:44.7459515Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-3cfa0a760d9ef1cb.xml (deflated 36%)
2024-12-18T02:30:44.7460702Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-cdec7c21d3ac0592.xml (deflated 44%)
2024-12-18T02:30:44.7461898Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-22d8218703788dd2.xml (deflated 44%)
2024-12-18T02:30:44.7463091Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-446aa3d4157e3873.xml (deflated 44%)
2024-12-18T02:30:44.7464285Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-c295ec9da7710c05.xml (deflated 44%)
2024-12-18T02:30:44.7465475Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-746533b3b2c586cc.xml (deflated 44%)
2024-12-18T02:30:44.7466663Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-cf1c4ef59e4805bf.xml (deflated 44%)
2024-12-18T02:30:44.7467856Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-45ec70a43d352e14.xml (deflated 44%)
2024-12-18T02:30:44.7469049Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-78f689a00d10bd4c.xml (deflated 44%)
2024-12-18T02:30:44.7470222Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-6e9993091b307eb0.xml (deflated 44%)
2024-12-18T02:30:44.7471405Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-9ed286e4f874eede.xml (deflated 44%)
2024-12-18T02:30:44.7472585Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-c7cd7a185c404a41.xml (deflated 45%)
2024-12-18T02:30:44.7473748Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-4f75841e06704ebf.xml (deflated 46%)
2024-12-18T02:30:44.7474912Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-e2836f0d5f5ed4ea.xml (deflated 46%)
2024-12-18T02:30:44.7476081Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-825719dd447169c5.xml (deflated 45%)
2024-12-18T02:30:44.7477325Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-be72a5ad8663c7b4.xml (deflated 46%)
2024-12-18T02:30:44.7478494Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-52c551319a9558d7.xml (deflated 46%)
2024-12-18T02:30:44.7479673Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-fe6131d754ae9fa4.xml (deflated 46%)
2024-12-18T02:30:44.7480854Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-e70ab8c12879d75c.xml (deflated 46%)
2024-12-18T02:30:44.7482039Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-6fb134c3e498af79.xml (deflated 46%)
2024-12-18T02:30:44.7483431Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-b8f6a42196f5aac6.xml (deflated 46%)
2024-12-18T02:30:44.7484635Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-bdb44342d5a2f89e.xml (deflated 46%)
2024-12-18T02:30:44.7485822Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-2f312c610e20feb5.xml (deflated 46%)
2024-12-18T02:30:44.7487012Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-526b778e236de013.xml (deflated 46%)
2024-12-18T02:30:44.7488198Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-a6d131a66ec4a0be.xml (deflated 46%)
2024-12-18T02:30:44.7489382Z   adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-603c2b86aeec3b08.xml (deflated 45%)
2024-12-18T02:30:44.7490481Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-07338930072f576c.xml (deflated 36%)
2024-12-18T02:30:44.7491526Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-5b74495589d59eab.xml (deflated 37%)
2024-12-18T02:30:44.7492566Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ef54b51295f4d5dd.xml (deflated 40%)
2024-12-18T02:30:44.7493610Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-7cff066925e820c7.xml (deflated 37%)
2024-12-18T02:30:44.7494657Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8a3cd5cc9d7fbd44.xml (deflated 36%)
2024-12-18T02:30:44.7495701Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c3bab0f9b9555ff3.xml (deflated 36%)
2024-12-18T02:30:44.7496754Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-448f3f74a6511d9d.xml (deflated 37%)
2024-12-18T02:30:44.7497788Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c67bd1c4c76e62b0.xml (deflated 37%)
2024-12-18T02:30:44.7498838Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c464f9144ccd79d3.xml (deflated 37%)
2024-12-18T02:30:44.7499885Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-70989e356673c648.xml (deflated 37%)
2024-12-18T02:30:44.7500932Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ad57ea1725fc8052.xml (deflated 37%)
2024-12-18T02:30:44.7501977Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-7d941d09da43644c.xml (deflated 37%)
2024-12-18T02:30:44.7503024Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-58e7f4435381116c.xml (deflated 36%)
2024-12-18T02:30:44.7504069Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a1ea4acae9ce6e78.xml (deflated 37%)
2024-12-18T02:30:44.7505182Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e68e48ad10822666.xml (deflated 37%)
2024-12-18T02:30:44.7506234Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ba8858b0cb4a2035.xml (deflated 35%)
2024-12-18T02:30:44.7507278Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e06bc709cd259858.xml (deflated 36%)
2024-12-18T02:30:44.7508319Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-5ad806019bcf37ed.xml (deflated 35%)
2024-12-18T02:30:44.7509384Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b62f3aa1dd33a050.xml (deflated 35%)
2024-12-18T02:30:44.7510428Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-1cf4576a7ef0b953.xml (deflated 35%)
2024-12-18T02:30:44.7511533Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-08b234c5ef704e27.xml (deflated 36%)
2024-12-18T02:30:44.7512568Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-cfa7a82aa668e812.xml (deflated 35%)
2024-12-18T02:30:44.7513660Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8e97514b5f2db44f.xml (deflated 36%)
2024-12-18T02:30:44.7514702Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-252f004568bf9f37.xml (deflated 37%)
2024-12-18T02:30:44.7515750Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9b68f974fc8362be.xml (deflated 40%)
2024-12-18T02:30:44.7516796Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e35e5fa8102ec663.xml (deflated 36%)
2024-12-18T02:30:44.7517856Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-0e7eaf18cd47e699.xml (deflated 36%)
2024-12-18T02:30:44.7518912Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-44eb9e5f8de2207d.xml (deflated 34%)
2024-12-18T02:30:44.7519971Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-2afcbf5dad083e7a.xml (deflated 34%)
2024-12-18T02:30:44.7521022Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9fa94b8ffe5ba41d.xml (deflated 36%)
2024-12-18T02:30:44.7522081Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-66b97a392d4dee6e.xml (deflated 37%)
2024-12-18T02:30:44.7523204Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-26d4b404246b44fd.xml (deflated 36%)
2024-12-18T02:30:44.7524251Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-894e381530d714d7.xml (deflated 35%)
2024-12-18T02:30:44.7525301Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-dfba6110b287b10f.xml (deflated 36%)
2024-12-18T02:30:44.7526356Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9ea2cc1c5c336cd6.xml (deflated 36%)
2024-12-18T02:30:44.7527406Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9ce518bffe349c4e.xml (deflated 35%)
2024-12-18T02:30:44.7528444Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-d2a29fdedb147ff6.xml (deflated 35%)
2024-12-18T02:30:44.7529496Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a8a5825b1712520e.xml (deflated 35%)
2024-12-18T02:30:44.7530540Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8c387b3ecad51c8e.xml (deflated 35%)
2024-12-18T02:30:44.7531578Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-5e7e2ca7429dde17.xml (deflated 35%)
2024-12-18T02:30:44.7532631Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a92f25a57bfea139.xml (deflated 40%)
2024-12-18T02:30:44.7533749Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f9e46aa72877e252.xml (deflated 34%)
2024-12-18T02:30:44.7534797Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a8b0abca29126aeb.xml (deflated 34%)
2024-12-18T02:30:44.7535827Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-2ae19c48e4b045c8.xml (deflated 34%)
2024-12-18T02:30:44.7536872Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-21cd5ab70e271761.xml (deflated 34%)
2024-12-18T02:30:44.7537913Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c128693083df44f4.xml (deflated 34%)
2024-12-18T02:30:44.7539281Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-6d718dde7d688de1.xml (deflated 35%)
2024-12-18T02:30:44.7540330Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-406cdd150c24c510.xml (deflated 35%)
2024-12-18T02:30:44.7541374Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-dc208d8c1ff1b39d.xml (deflated 35%)
2024-12-18T02:30:44.7542415Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f50a56fe21662492.xml (deflated 35%)
2024-12-18T02:30:44.7543452Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f9a722841b05cb6a.xml (deflated 35%)
2024-12-18T02:30:44.7544475Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3901457f7f7af2b9.xml (deflated 34%)
2024-12-18T02:30:44.7545518Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-73289f1521defcb2.xml (deflated 34%)
2024-12-18T02:30:44.7546564Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-5872646c98cfd06d.xml (deflated 35%)
2024-12-18T02:30:44.7547611Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-472896ee7f90034e.xml (deflated 36%)
2024-12-18T02:30:44.7548648Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e052de617971ea86.xml (deflated 35%)
2024-12-18T02:30:44.7549690Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9feb6bb44a98d08a.xml (deflated 35%)
2024-12-18T02:30:44.7550730Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3494e3da0d953621.xml (deflated 35%)
2024-12-18T02:30:44.7551758Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b0a4e61c40353cfc.xml (deflated 36%)
2024-12-18T02:30:44.7552799Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-28517c570894be9f.xml (deflated 35%)
2024-12-18T02:30:44.7553840Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a99cb0024bb68a22.xml (deflated 37%)
2024-12-18T02:30:44.7554891Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f266c4ba5a9d3d7c.xml (deflated 35%)
2024-12-18T02:30:44.7555932Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-03678000ace776fc.xml (deflated 36%)
2024-12-18T02:30:44.7556968Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-1cd511f7170c7ad9.xml (deflated 35%)
2024-12-18T02:30:44.7558008Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-83f6c212dff33258.xml (deflated 35%)
2024-12-18T02:30:44.7559038Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-6bfacba9fc0f6d66.xml (deflated 35%)
2024-12-18T02:30:44.7560085Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-119c0474a10ff475.xml (deflated 35%)
2024-12-18T02:30:44.7561224Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-699bc2a5fcc1bc9a.xml (deflated 36%)
2024-12-18T02:30:44.7562270Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-2465c32ec0de21ce.xml (deflated 35%)
2024-12-18T02:30:44.7563406Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b434d7189e7f7229.xml (deflated 35%)
2024-12-18T02:30:44.7564460Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-265e90c37bcf3ce5.xml (deflated 35%)
2024-12-18T02:30:44.7565508Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c53a04e1ae804565.xml (deflated 34%)
2024-12-18T02:30:44.7566540Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-51c7a85d070a1e84.xml (deflated 35%)
2024-12-18T02:30:44.7567648Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-d5e803f06cbb1e9c.xml (deflated 35%)
2024-12-18T02:30:44.7568693Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f1256385b04968cb.xml (deflated 35%)
2024-12-18T02:30:44.7569725Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-74b1bf704981553f.xml (deflated 35%)
2024-12-18T02:30:44.7570765Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-acfef132434417fd.xml (deflated 35%)
2024-12-18T02:30:44.7571805Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-446189fe8d52a63b.xml (deflated 35%)
2024-12-18T02:30:44.7572842Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e60905319fee9243.xml (deflated 36%)
2024-12-18T02:30:44.7573882Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-733144061f3a62db.xml (deflated 35%)
2024-12-18T02:30:44.7574910Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3f37a616c9cd7305.xml (deflated 35%)
2024-12-18T02:30:44.7575954Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c874fe0b6d678b20.xml (deflated 35%)
2024-12-18T02:30:44.7577002Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-33faf6dd989cc553.xml (deflated 35%)
2024-12-18T02:30:44.7578044Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-bef478f4cd3fc842.xml (deflated 35%)
2024-12-18T02:30:44.7579082Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-47302aba1c55f757.xml (deflated 36%)
2024-12-18T02:30:44.7580121Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-6a0c732905a1cca8.xml (deflated 33%)
2024-12-18T02:30:44.7581162Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ab03c3fbe9d29b07.xml (deflated 33%)
2024-12-18T02:30:44.7582200Z   adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-7cf2380e15a9860c.xml (deflated 35%)
2024-12-18T02:30:44.7583370Z   adding: test/test-reports/python-pytest/distributed.elastic.events.lib_test/distributed.elastic.events.lib_test-fcd4faef825fe535.xml (deflated 76%)
2024-12-18T02:30:44.7584674Z   adding: test/test-reports/python-pytest/distributed.elastic.metrics.api_test/distributed.elastic.metrics.api_test-34ff317c8bbc2058.xml (deflated 59%)
2024-12-18T02:30:44.7586085Z   adding: test/test-reports/python-pytest/distributed.elastic.multiprocessing.api_test/distributed.elastic.multiprocessing.api_test-171af04f85c76713.xml (deflated 84%)
2024-12-18T02:30:44.7587556Z   adding: test/test-reports/python-pytest/distributed.elastic.timer.local_timer_example/distributed.elastic.timer.local_timer_example-171a09d27b825d0e.xml (deflated 51%)
2024-12-18T02:30:44.7588990Z   adding: test/test-reports/python-pytest/distributed.elastic.timer.local_timer_test/distributed.elastic.timer.local_timer_test-c606fc84dbe3c396.xml (deflated 80%)
2024-12-18T02:30:44.7590500Z   adding: test/test-reports/python-pytest/distributed.elastic.utils.distributed_test/distributed.elastic.utils.distributed_test-fe23f6cc685e8e68.xml (deflated 78%)
2024-12-18T02:30:44.7591899Z   adding: test/test-reports/python-pytest/distributed.elastic.utils.logging_test/distributed.elastic.utils.logging_test-d173306c2112a025.xml (deflated 51%)
2024-12-18T02:30:44.7593226Z   adding: test/test-reports/python-pytest/distributed.elastic.utils.util_test/distributed.elastic.utils.util_test-782ee009add62928.xml (deflated 81%)
2024-12-18T02:30:44.7594459Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b4be1473176d6d06.xml (deflated 37%)
2024-12-18T02:30:44.7595654Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-69912751687263e1.xml (deflated 43%)
2024-12-18T02:30:44.7596909Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02d4dedb96b32fec.xml (deflated 38%)
2024-12-18T02:30:44.7598119Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-935286f218ba65dc.xml (deflated 57%)
2024-12-18T02:30:44.7599319Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1de7242687ee9455.xml (deflated 37%)
2024-12-18T02:30:44.7600512Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3fd6ba71a6227050.xml (deflated 36%)
2024-12-18T02:30:44.7601710Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f656902f40c68e7a.xml (deflated 36%)
2024-12-18T02:30:44.7602904Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de34b56e8622a375.xml (deflated 35%)
2024-12-18T02:30:44.7604175Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ff381617bd3f0150.xml (deflated 36%)
2024-12-18T02:30:44.7605383Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d347b812d58ee065.xml (deflated 35%)
2024-12-18T02:30:44.7606582Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50976796050bdb2c.xml (deflated 35%)
2024-12-18T02:30:44.7607781Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-673f102863592ae9.xml (deflated 36%)
2024-12-18T02:30:44.7608982Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b9b0cf24c13b582.xml (deflated 42%)
2024-12-18T02:30:44.7610187Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b4055ccb7b6a1a4.xml (deflated 36%)
2024-12-18T02:30:44.7611392Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-876c7b363adfc156.xml (deflated 37%)
2024-12-18T02:30:44.7612663Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c64deb3eb8a8405.xml (deflated 36%)
2024-12-18T02:30:44.7613852Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9809e9c2bff9b5a1.xml (deflated 37%)
2024-12-18T02:30:44.7615054Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7357bc733a7bd64a.xml (deflated 37%)
2024-12-18T02:30:44.7616256Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d68844db21af6b49.xml (deflated 42%)
2024-12-18T02:30:44.7617450Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-016830b543a9516f.xml (deflated 36%)
2024-12-18T02:30:44.7618647Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-914d238886fb6f95.xml (deflated 35%)
2024-12-18T02:30:44.7619921Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c2ecc4f3d1056ead.xml (deflated 36%)
2024-12-18T02:30:44.7621120Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6de463cfa865b129.xml (deflated 35%)
2024-12-18T02:30:44.7622314Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-08559b8a8735d8b2.xml (deflated 36%)
2024-12-18T02:30:44.7623503Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ab764546def2bd19.xml (deflated 36%)
2024-12-18T02:30:44.7624703Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-afd5d77e86258d4d.xml (deflated 35%)
2024-12-18T02:30:44.7625951Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4635c71a973458c3.xml (deflated 35%)
2024-12-18T02:30:44.7627150Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1da200bea01117ec.xml (deflated 35%)
2024-12-18T02:30:44.7628349Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-44f5876e09895ced.xml (deflated 36%)
2024-12-18T02:30:44.7629545Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca27029df9a2662e.xml (deflated 35%)
2024-12-18T02:30:44.7630741Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50894baa4d83a3c6.xml (deflated 43%)
2024-12-18T02:30:44.7631947Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ef8e3e78ea19f55.xml (deflated 43%)
2024-12-18T02:30:44.7633132Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-79f2a5b19542df26.xml (deflated 35%)
2024-12-18T02:30:44.7634323Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d24bd1998d821290.xml (deflated 35%)
2024-12-18T02:30:44.7635518Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5b78243df3b1ea0.xml (deflated 45%)
2024-12-18T02:30:44.7636714Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8944825c9637bb07.xml (deflated 45%)
2024-12-18T02:30:44.7637906Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32946608cffd344e.xml (deflated 35%)
2024-12-18T02:30:44.7639286Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-859162dfd602a017.xml (deflated 35%)
2024-12-18T02:30:44.7640486Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-40ae7196aaca4db2.xml (deflated 44%)
2024-12-18T02:30:44.7641675Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-831fe32e1b660648.xml (deflated 35%)
2024-12-18T02:30:44.7642869Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-53e10db24d9976c6.xml (deflated 35%)
2024-12-18T02:30:44.7644128Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3d902d148f8257a.xml (deflated 36%)
2024-12-18T02:30:44.7645317Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d5aff76ab04a1080.xml (deflated 36%)
2024-12-18T02:30:44.7646519Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5525f39532974295.xml (deflated 35%)
2024-12-18T02:30:44.7647842Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98c340dace6cb11c.xml (deflated 36%)
2024-12-18T02:30:44.7649040Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be59cd2fe3734124.xml (deflated 36%)
2024-12-18T02:30:44.7650240Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3b046cee23af79c.xml (deflated 36%)
2024-12-18T02:30:44.7651440Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a631f9459c3be5a3.xml (deflated 35%)
2024-12-18T02:30:44.7652635Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2a3238fd368f909.xml (deflated 36%)
2024-12-18T02:30:44.7653889Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-524eb4a7b6e9f418.xml (deflated 36%)
2024-12-18T02:30:44.7655090Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a4f6c8b03cddcd3d.xml (deflated 36%)
2024-12-18T02:30:44.7656288Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-014cf11c3c160ff2.xml (deflated 35%)
2024-12-18T02:30:44.7657484Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35a3e07e7670fb2a.xml (deflated 35%)
2024-12-18T02:30:44.7658669Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-416f2a3732832391.xml (deflated 35%)
2024-12-18T02:30:44.7659864Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f148ede880e5a033.xml (deflated 36%)
2024-12-18T02:30:44.7661063Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-756a41ffefa8e5b2.xml (deflated 35%)
2024-12-18T02:30:44.7662255Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6be811580936f2a6.xml (deflated 35%)
2024-12-18T02:30:44.7663439Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-596c2ab12b7bccc8.xml (deflated 35%)
2024-12-18T02:30:44.7664642Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d5d61583b5f94069.xml (deflated 35%)
2024-12-18T02:30:44.7665841Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-878e0e21d8b4dbf0.xml (deflated 35%)
2024-12-18T02:30:44.7667046Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8aca1e029654dbad.xml (deflated 35%)
2024-12-18T02:30:44.7668249Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad6236f4f5b3d1b4.xml (deflated 36%)
2024-12-18T02:30:44.7669458Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d48eba73f7f93d8b.xml (deflated 36%)
2024-12-18T02:30:44.7670654Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8d4b0610969d5208.xml (deflated 36%)
2024-12-18T02:30:44.7671848Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f98c9c85a0d1816c.xml (deflated 36%)
2024-12-18T02:30:44.7673033Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-350f0d5a79faaf1c.xml (deflated 35%)
2024-12-18T02:30:44.7674235Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-818e57ea2e8937f8.xml (deflated 35%)
2024-12-18T02:30:44.7675439Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a6c7713af45e6b2c.xml (deflated 35%)
2024-12-18T02:30:44.7676703Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c2541ab0f489118.xml (deflated 36%)
2024-12-18T02:30:44.7677899Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3a78bcf858f9345.xml (deflated 35%)
2024-12-18T02:30:44.7679099Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db69708b367d0fa5.xml (deflated 43%)
2024-12-18T02:30:44.7680299Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-26b45cf3397d8ac3.xml (deflated 43%)
2024-12-18T02:30:44.7681500Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eab613aa47bd9815.xml (deflated 44%)
2024-12-18T02:30:44.7682816Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0d698c20c410af50.xml (deflated 43%)
2024-12-18T02:30:44.7684097Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-45df1737e2cb7ac3.xml (deflated 43%)
2024-12-18T02:30:44.7685296Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a883a7a3e226f7d6.xml (deflated 43%)
2024-12-18T02:30:44.7686501Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0460321be235391a.xml (deflated 43%)
2024-12-18T02:30:44.7687696Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-73d3f4a1c93f85b1.xml (deflated 44%)
2024-12-18T02:30:44.7688897Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2773e068c79f83dc.xml (deflated 44%)
2024-12-18T02:30:44.7690100Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be0cb17c5e51d4bb.xml (deflated 44%)
2024-12-18T02:30:44.7691305Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74464015faea29e5.xml (deflated 45%)
2024-12-18T02:30:44.7692491Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f0ba7ac771a90c4c.xml (deflated 44%)
2024-12-18T02:30:44.7693689Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-56a7551e2b385640.xml (deflated 44%)
2024-12-18T02:30:44.7694885Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8716df8470cb336.xml (deflated 44%)
2024-12-18T02:30:44.7696080Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fd3648a035f5ac5e.xml (deflated 44%)
2024-12-18T02:30:44.7697288Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-76c5ab5bab1e0300.xml (deflated 45%)
2024-12-18T02:30:44.7698492Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02667c5a212ef583.xml (deflated 44%)
2024-12-18T02:30:44.7699694Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e443b05ab38547c8.xml (deflated 44%)
2024-12-18T02:30:44.7700894Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bfed11b02f201164.xml (deflated 45%)
2024-12-18T02:30:44.7702086Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70aaa4ebe8a5d6d8.xml (deflated 44%)
2024-12-18T02:30:44.7703299Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2e13c7c6a6df4a6.xml (deflated 44%)
2024-12-18T02:30:44.7704502Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-abf7b49cf9734c78.xml (deflated 44%)
2024-12-18T02:30:44.7705791Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f571eadc5e4913b.xml (deflated 44%)
2024-12-18T02:30:44.7706992Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-91723c0ef0244f33.xml (deflated 44%)
2024-12-18T02:30:44.7708192Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-42c2b6ed5dd918f0.xml (deflated 36%)
2024-12-18T02:30:44.7709391Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a0fa6a12398315af.xml (deflated 36%)
2024-12-18T02:30:44.7710593Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-048e9ced515c2bf1.xml (deflated 35%)
2024-12-18T02:30:44.7711841Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e73a44ee2a4682a2.xml (deflated 35%)
2024-12-18T02:30:44.7713052Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d14946bd585bbfc.xml (deflated 35%)
2024-12-18T02:30:44.7714402Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f128edfc76a81a1.xml (deflated 36%)
2024-12-18T02:30:44.7715602Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc604d4c56db6900.xml (deflated 35%)
2024-12-18T02:30:44.7716807Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-707d488cf6763347.xml (deflated 35%)
2024-12-18T02:30:44.7718024Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d9af17b24aada5fb.xml (deflated 50%)
2024-12-18T02:30:44.7719241Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ce63ba9ca325a8b3.xml (deflated 36%)
2024-12-18T02:30:44.7720454Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7eef7676d1eea702.xml (deflated 35%)
2024-12-18T02:30:44.7721657Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6729273c3f9fafde.xml (deflated 35%)
2024-12-18T02:30:44.7722851Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fcc7e4044db4548f.xml (deflated 42%)
2024-12-18T02:30:44.7724111Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-af35dc555cdd8a87.xml (deflated 42%)
2024-12-18T02:30:44.7725322Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-137cd55bfa7898f7.xml (deflated 41%)
2024-12-18T02:30:44.7726534Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e0a738cbf5e1d2b4.xml (deflated 42%)
2024-12-18T02:30:44.7727735Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d139152cb752957b.xml (deflated 42%)
2024-12-18T02:30:44.7728939Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-761a87e09b05512c.xml (deflated 42%)
2024-12-18T02:30:44.7730147Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d055996e32fb3411.xml (deflated 42%)
2024-12-18T02:30:44.7731348Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f4c00d661a3832a.xml (deflated 35%)
2024-12-18T02:30:44.7732538Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7971ed02e46d39d1.xml (deflated 35%)
2024-12-18T02:30:44.7733797Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2b8ece4021e96718.xml (deflated 35%)
2024-12-18T02:30:44.7734988Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9555a734d67f876b.xml (deflated 36%)
2024-12-18T02:30:44.7736193Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aee7e713daa37ce5.xml (deflated 47%)
2024-12-18T02:30:44.7737387Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a5a863ba213378f.xml (deflated 47%)
2024-12-18T02:30:44.7738828Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4181a9bc93651d1f.xml (deflated 47%)
2024-12-18T02:30:44.7740139Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ea3bd1e8db4abf58.xml (deflated 36%)
2024-12-18T02:30:44.7741351Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-827ff6e6da81d6ee.xml (deflated 35%)
2024-12-18T02:30:44.7742539Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d720b1d8ca2e3b77.xml (deflated 35%)
2024-12-18T02:30:44.7743741Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8a805288bb68a113.xml (deflated 36%)
2024-12-18T02:30:44.7744937Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9164101ee23d2f2d.xml (deflated 35%)
2024-12-18T02:30:44.7746127Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ef398a6e9807374.xml (deflated 35%)
2024-12-18T02:30:44.7747338Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-83cce0dd3b8ea632.xml (deflated 35%)
2024-12-18T02:30:44.7748538Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09a56d069244e37f.xml (deflated 35%)
2024-12-18T02:30:44.7749731Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5753167bd54a9c79.xml (deflated 35%)
2024-12-18T02:30:44.7750929Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a88fb59c1d1ebc26.xml (deflated 35%)
2024-12-18T02:30:44.7752116Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-20964d9b334f3646.xml (deflated 35%)
2024-12-18T02:30:44.7753314Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9341bf29d311acf4.xml (deflated 35%)
2024-12-18T02:30:44.7754514Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2a454c80ae75452e.xml (deflated 43%)
2024-12-18T02:30:44.7755720Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1f1bb1855a0bd56.xml (deflated 35%)
2024-12-18T02:30:44.7756926Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2b9b7fed1276d91.xml (deflated 36%)
2024-12-18T02:30:44.7758128Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-12e8cc4d1d4ca16d.xml (deflated 36%)
2024-12-18T02:30:44.7759324Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-692019828da18332.xml (deflated 36%)
2024-12-18T02:30:44.7760526Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5cfdfa4687790f5.xml (deflated 35%)
2024-12-18T02:30:44.7761731Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b18da0fa2ede9e1.xml (deflated 36%)
2024-12-18T02:30:44.7762997Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-959651bc9b462af3.xml (deflated 35%)
2024-12-18T02:30:44.7764257Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c97b7bb49b5b022.xml (deflated 48%)
2024-12-18T02:30:44.7765463Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bf3574e946302fc.xml (deflated 35%)
2024-12-18T02:30:44.7766666Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db09a4a5dd75b9b9.xml (deflated 35%)
2024-12-18T02:30:44.7767873Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-34cb4ba35e52a031.xml (deflated 35%)
2024-12-18T02:30:44.7769141Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee9eb328b4b5a58f.xml (deflated 35%)
2024-12-18T02:30:44.7770348Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-99b805851839a036.xml (deflated 42%)
2024-12-18T02:30:44.7771549Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6fee2c5aab9dfc35.xml (deflated 35%)
2024-12-18T02:30:44.7772741Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f95d3e20e3fffc2.xml (deflated 36%)
2024-12-18T02:30:44.7773948Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d665fe3ca084043c.xml (deflated 35%)
2024-12-18T02:30:44.7775139Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58ae4611e0b082ad.xml (deflated 35%)
2024-12-18T02:30:44.7776343Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e445bd2e2123ac80.xml (deflated 35%)
2024-12-18T02:30:44.7777550Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1912b46946427b4f.xml (deflated 35%)
2024-12-18T02:30:44.7778748Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-07ceaf42ef18bfda.xml (deflated 35%)
2024-12-18T02:30:44.7779951Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-582ff321a54d1091.xml (deflated 37%)
2024-12-18T02:30:44.7781152Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-737ed4d28d39e061.xml (deflated 36%)
2024-12-18T02:30:44.7782338Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d6a2b0b632587009.xml (deflated 37%)
2024-12-18T02:30:44.7783539Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ff2b192a2738c6cc.xml (deflated 36%)
2024-12-18T02:30:44.7784742Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d86e78a8e368664.xml (deflated 36%)
2024-12-18T02:30:44.7785936Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fa52184813c36bf8.xml (deflated 36%)
2024-12-18T02:30:44.7787135Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1c57cbc9faa80b8.xml (deflated 36%)
2024-12-18T02:30:44.7788329Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-620723a6d3596d6c.xml (deflated 36%)
2024-12-18T02:30:44.7789520Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-05e234e0cf570689.xml (deflated 35%)
2024-12-18T02:30:44.7790722Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-47a6af8d14e0c387.xml (deflated 36%)
2024-12-18T02:30:44.7791972Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a565cda6f000cf65.xml (deflated 44%)
2024-12-18T02:30:44.7793181Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ace8cbab2324c19.xml (deflated 43%)
2024-12-18T02:30:44.7794383Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6180705e37d79eaa.xml (deflated 36%)
2024-12-18T02:30:44.7795572Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-66657c2b7328604c.xml (deflated 36%)
2024-12-18T02:30:44.7796763Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5f05953ca475643a.xml (deflated 35%)
2024-12-18T02:30:44.7798046Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8dc3ecb80978e72c.xml (deflated 35%)
2024-12-18T02:30:44.7799249Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4fe32fb192070e52.xml (deflated 35%)
2024-12-18T02:30:44.7800449Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ab5805c8e5be5ae.xml (deflated 43%)
2024-12-18T02:30:44.7801637Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c03f79f232503a5f.xml (deflated 36%)
2024-12-18T02:30:44.7802834Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d4119696fa815740.xml (deflated 47%)
2024-12-18T02:30:44.7804113Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2b9c7210e292a08.xml (deflated 36%)
2024-12-18T02:30:44.7805318Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-63a716e64c27615e.xml (deflated 35%)
2024-12-18T02:30:44.7806525Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02ac195c412b48fd.xml (deflated 35%)
2024-12-18T02:30:44.7807731Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ba6dd020f4be37eb.xml (deflated 36%)
2024-12-18T02:30:44.7808944Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9fdd291e866ecba.xml (deflated 35%)
2024-12-18T02:30:44.7810144Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2751488d28fd5b17.xml (deflated 36%)
2024-12-18T02:30:44.7811334Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c0b47bfa57d8794.xml (deflated 35%)
2024-12-18T02:30:44.7812541Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd0f89ce328e8a49.xml (deflated 35%)
2024-12-18T02:30:44.7813741Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0465d52d05096c27.xml (deflated 36%)
2024-12-18T02:30:44.7814936Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c35815a35dfdd2a8.xml (deflated 36%)
2024-12-18T02:30:44.7816138Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6fe35f509131a008.xml (deflated 35%)
2024-12-18T02:30:44.7817340Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b3a37c9d5b18163.xml (deflated 35%)
2024-12-18T02:30:44.7818536Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ecfb823796444488.xml (deflated 36%)
2024-12-18T02:30:44.7819791Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-671a7b1e2e076b83.xml (deflated 35%)
2024-12-18T02:30:44.7820982Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8dd4e7a3fdd928b5.xml (deflated 43%)
2024-12-18T02:30:44.7822180Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edfa001059320016.xml (deflated 35%)
2024-12-18T02:30:44.7823382Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c241366c359e435.xml (deflated 36%)
2024-12-18T02:30:44.7824580Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4d120b8d8c0fc9c.xml (deflated 35%)
2024-12-18T02:30:44.7825839Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ad90b5b8512917b.xml (deflated 35%)
2024-12-18T02:30:44.7827049Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-31bb6c45494b833f.xml (deflated 37%)
2024-12-18T02:30:44.7828249Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e15bb8d41ed88313.xml (deflated 36%)
2024-12-18T02:30:44.7829451Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-030de98a5b02610c.xml (deflated 35%)
2024-12-18T02:30:44.7830643Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b2e5542326b62ce2.xml (deflated 36%)
2024-12-18T02:30:44.7831847Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9420eeeaa1aecb1d.xml (deflated 35%)
2024-12-18T02:30:44.7833055Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4037e582430fefe7.xml (deflated 35%)
2024-12-18T02:30:44.7834264Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-06349d2a33e3d64c.xml (deflated 36%)
2024-12-18T02:30:44.7835464Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6638fbf777e4d7c0.xml (deflated 35%)
2024-12-18T02:30:44.7836670Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3519cadf7dd4a0ae.xml (deflated 36%)
2024-12-18T02:30:44.7837868Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1303881373636e0f.xml (deflated 37%)
2024-12-18T02:30:44.7839244Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80c0a0a15b23d076.xml (deflated 35%)
2024-12-18T02:30:44.7840457Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8db740606fdedfc8.xml (deflated 36%)
2024-12-18T02:30:44.7841660Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c7fee96aae901a9.xml (deflated 35%)
2024-12-18T02:30:44.7842867Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7563754f4a920d68.xml (deflated 36%)
2024-12-18T02:30:44.7844117Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be9a0fb5bcd87a8e.xml (deflated 36%)
2024-12-18T02:30:44.7845321Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17146934e1e2cb71.xml (deflated 35%)
2024-12-18T02:30:44.7846520Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c863deaf63e3d503.xml (deflated 35%)
2024-12-18T02:30:44.7847725Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d69c28948c3c3972.xml (deflated 35%)
2024-12-18T02:30:44.7849034Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c5034339571c6602.xml (deflated 35%)
2024-12-18T02:30:44.7850231Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f17c73756d506ceb.xml (deflated 44%)
2024-12-18T02:30:44.7851417Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-13f17ee0fe63b558.xml (deflated 45%)
2024-12-18T02:30:44.7852612Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70727834a13150ee.xml (deflated 45%)
2024-12-18T02:30:44.7853805Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ba037a4248213605.xml (deflated 45%)
2024-12-18T02:30:44.7855080Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8c70d9cb1b12ad39.xml (deflated 45%)
2024-12-18T02:30:44.7856284Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2eef55a338908c8c.xml (deflated 43%)
2024-12-18T02:30:44.7857481Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-82934b4b6ee0881a.xml (deflated 43%)
2024-12-18T02:30:44.7858676Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-64423a73daaeb61d.xml (deflated 43%)
2024-12-18T02:30:44.7859877Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c6108f5732e52ef1.xml (deflated 36%)
2024-12-18T02:30:44.7861069Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a4c6501de64cbfbd.xml (deflated 36%)
2024-12-18T02:30:44.7862275Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1c9f2d5db18b588c.xml (deflated 43%)
2024-12-18T02:30:44.7863476Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-031209ff4392d5bd.xml (deflated 43%)
2024-12-18T02:30:44.7864683Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ddbd303eb38f1b1e.xml (deflated 35%)
2024-12-18T02:30:44.7865889Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5df535a4cde0f400.xml (deflated 35%)
2024-12-18T02:30:44.7867088Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ccfc44096f4349a7.xml (deflated 35%)
2024-12-18T02:30:44.7868285Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-804d37c5e7f92ce0.xml (deflated 35%)
2024-12-18T02:30:44.7869493Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cfceb6cf8dcda96e.xml (deflated 35%)
2024-12-18T02:30:44.7870690Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8720d661054338eb.xml (deflated 34%)
2024-12-18T02:30:44.7871889Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebab5cd615e0cd54.xml (deflated 35%)
2024-12-18T02:30:44.7873088Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-757b2ea46e044da2.xml (deflated 35%)
2024-12-18T02:30:44.7874286Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d60c7fd668bd8445.xml (deflated 35%)
2024-12-18T02:30:44.7875481Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48651988c5a15839.xml (deflated 35%)
2024-12-18T02:30:44.7876673Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09ced25634f28d21.xml (deflated 35%)
2024-12-18T02:30:44.7877942Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bb1adaba33c8833f.xml (deflated 36%)
2024-12-18T02:30:44.7879151Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51a455bfbe3ef1e4.xml (deflated 35%)
2024-12-18T02:30:44.7880351Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b0cbdabb44d0c6f7.xml (deflated 36%)
2024-12-18T02:30:44.7881554Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3b732f9051b68e62.xml (deflated 35%)
2024-12-18T02:30:44.7882751Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-852632d785787d59.xml (deflated 35%)
2024-12-18T02:30:44.7884098Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-efcf5a315d0aac26.xml (deflated 35%)
2024-12-18T02:30:44.7885309Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b46e8c7fbf161de0.xml (deflated 36%)
2024-12-18T02:30:44.7886519Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb011e1e305d8332.xml (deflated 36%)
2024-12-18T02:30:44.7887722Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5c027d29205e1c72.xml (deflated 36%)
2024-12-18T02:30:44.7888920Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c1feea552658c0a2.xml (deflated 45%)
2024-12-18T02:30:44.7890104Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca919605307bd9bb.xml (deflated 44%)
2024-12-18T02:30:44.7891310Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51e3589d554125d0.xml (deflated 37%)
2024-12-18T02:30:44.7892503Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48af2f812a5b5a5a.xml (deflated 43%)
2024-12-18T02:30:44.7893694Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-91af67b8a0f90942.xml (deflated 42%)
2024-12-18T02:30:44.7894898Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f2ea104ca4a1f34c.xml (deflated 36%)
2024-12-18T02:30:44.7896096Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-85730736a91bc83f.xml (deflated 37%)
2024-12-18T02:30:44.7897296Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f61fb924e264538f.xml (deflated 36%)
2024-12-18T02:30:44.7898497Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3e7bc4ac3763e29.xml (deflated 36%)
2024-12-18T02:30:44.7899681Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4124e6cfb5a8e635.xml (deflated 42%)
2024-12-18T02:30:44.7900876Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b31360d8b897a5cb.xml (deflated 42%)
2024-12-18T02:30:44.7902070Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe08a69414e6e46c.xml (deflated 35%)
2024-12-18T02:30:44.7903265Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cfcb463d9d03abbf.xml (deflated 35%)
2024-12-18T02:30:44.7904466Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f6c7a8f79a87489a.xml (deflated 35%)
2024-12-18T02:30:44.7905719Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4dabb898965d2ac5.xml (deflated 36%)
2024-12-18T02:30:44.7906916Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b98f850a51168ce5.xml (deflated 36%)
2024-12-18T02:30:44.7908112Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5339911529690b64.xml (deflated 35%)
2024-12-18T02:30:44.7909303Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-abaeb752ba73a557.xml (deflated 35%)
2024-12-18T02:30:44.7910490Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f8dbcecc8ec18175.xml (deflated 35%)
2024-12-18T02:30:44.7911761Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d08feca908d59dd2.xml (deflated 41%)
2024-12-18T02:30:44.7912968Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35373db0dfae61fc.xml (deflated 41%)
2024-12-18T02:30:44.7914175Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-942d75cce589ae9f.xml (deflated 42%)
2024-12-18T02:30:44.7915377Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-37b6fb3463a392bb.xml (deflated 35%)
2024-12-18T02:30:44.7916583Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b8560a6ae716f5c8.xml (deflated 36%)
2024-12-18T02:30:44.7917787Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50fbcbe0465c1e35.xml (deflated 35%)
2024-12-18T02:30:44.7918989Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a76c42862de19d9.xml (deflated 35%)
2024-12-18T02:30:44.7920175Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48b114fb987b106d.xml (deflated 35%)
2024-12-18T02:30:44.7921379Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe130b7ebf911500.xml (deflated 36%)
2024-12-18T02:30:44.7922578Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b322bc26567ffff.xml (deflated 36%)
2024-12-18T02:30:44.7923841Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2de4f46e360b9ad.xml (deflated 35%)
2024-12-18T02:30:44.7925044Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac75227b4fbad17a.xml (deflated 35%)
2024-12-18T02:30:44.7926253Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee37a19483d47c2c.xml (deflated 36%)
2024-12-18T02:30:44.7927458Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9326a76615d99a1d.xml (deflated 36%)
2024-12-18T02:30:44.7928671Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4f8d71f7b5f14678.xml (deflated 35%)
2024-12-18T02:30:44.7929862Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-496bcd009e9f99d8.xml (deflated 35%)
2024-12-18T02:30:44.7931068Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-76b43269552af5e8.xml (deflated 37%)
2024-12-18T02:30:44.7932268Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cde4f6ff55023407.xml (deflated 43%)
2024-12-18T02:30:44.7933473Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc1c3b2530bd23d3.xml (deflated 37%)
2024-12-18T02:30:44.7934742Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7fdd966c65eee893.xml (deflated 57%)
2024-12-18T02:30:44.7935951Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-99d076d5b37f730d.xml (deflated 37%)
2024-12-18T02:30:44.7937152Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7022d5d44323f72.xml (deflated 36%)
2024-12-18T02:30:44.7938547Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1112987f3c38fe9.xml (deflated 36%)
2024-12-18T02:30:44.7939741Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9517f27f95f0e5d.xml (deflated 35%)
2024-12-18T02:30:44.7941071Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f36ddd85eb13b3cf.xml (deflated 35%)
2024-12-18T02:30:44.7942285Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-15dd1dc00e9bfd17.xml (deflated 35%)
2024-12-18T02:30:44.7943492Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-33a5ec08a44f750a.xml (deflated 35%)
2024-12-18T02:30:44.7944693Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2e0014f2e784158f.xml (deflated 36%)
2024-12-18T02:30:44.7945900Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dfdb7a71bb90bcac.xml (deflated 42%)
2024-12-18T02:30:44.7947105Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-95753a0a9d6d3615.xml (deflated 36%)
2024-12-18T02:30:44.7948309Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74179784eded992f.xml (deflated 37%)
2024-12-18T02:30:44.7949501Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2d7ecb694d28aae9.xml (deflated 36%)
2024-12-18T02:30:44.7950701Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd42168819c927e0.xml (deflated 36%)
2024-12-18T02:30:44.7951900Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43c1149cdcead294.xml (deflated 37%)
2024-12-18T02:30:44.7953096Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c528d2b47d44fc7f.xml (deflated 42%)
2024-12-18T02:30:44.7954290Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4619dd4718df6956.xml (deflated 36%)
2024-12-18T02:30:44.7955488Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc32b605db839d06.xml (deflated 35%)
2024-12-18T02:30:44.7956688Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e99f158919dd44e6.xml (deflated 36%)
2024-12-18T02:30:44.7957892Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b8f9fdd288ade72d.xml (deflated 36%)
2024-12-18T02:30:44.7959079Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-986d71b0473c3b0d.xml (deflated 35%)
2024-12-18T02:30:44.7960274Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc980f316bdfb2e3.xml (deflated 36%)
2024-12-18T02:30:44.7961479Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6b4de0e2bedd14fd.xml (deflated 36%)
2024-12-18T02:30:44.7962692Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2edbe212fb5f890a.xml (deflated 35%)
2024-12-18T02:30:44.7964039Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7bf8c395b516435b.xml (deflated 36%)
2024-12-18T02:30:44.7965253Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d913d59020ddda01.xml (deflated 36%)
2024-12-18T02:30:44.7966452Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0b5778185a1f9b84.xml (deflated 35%)
2024-12-18T02:30:44.7967653Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-012af12765b0ac60.xml (deflated 43%)
2024-12-18T02:30:44.7968842Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9fc4020b3273c43e.xml (deflated 43%)
2024-12-18T02:30:44.7970104Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-afcee4bf33bce5cd.xml (deflated 35%)
2024-12-18T02:30:44.7971323Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-77bec5fede4c8035.xml (deflated 35%)
2024-12-18T02:30:44.7972528Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5da150c52078bb86.xml (deflated 45%)
2024-12-18T02:30:44.7973727Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7345b77c5e21ec76.xml (deflated 45%)
2024-12-18T02:30:44.7974926Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-742f438e8ac2296f.xml (deflated 35%)
2024-12-18T02:30:44.7976121Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8696c2417b11934c.xml (deflated 35%)
2024-12-18T02:30:44.7977319Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2597600921c2458c.xml (deflated 44%)
2024-12-18T02:30:44.7978510Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc9ce76815270479.xml (deflated 35%)
2024-12-18T02:30:44.7979696Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-394d46e72049e004.xml (deflated 35%)
2024-12-18T02:30:44.7980888Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f621967c53a35eb0.xml (deflated 36%)
2024-12-18T02:30:44.7982085Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-61a06834d331e2d6.xml (deflated 36%)
2024-12-18T02:30:44.7983284Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f666a14a5cbfcc2.xml (deflated 35%)
2024-12-18T02:30:44.7984497Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d76b5ee7529d8f2e.xml (deflated 35%)
2024-12-18T02:30:44.7985695Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4e68625bcee2ee01.xml (deflated 36%)
2024-12-18T02:30:44.7986892Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-27bdb7c22107b5a6.xml (deflated 36%)
2024-12-18T02:30:44.7988090Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8df7663ff9a36c90.xml (deflated 35%)
2024-12-18T02:30:44.7989272Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-31a402bfae9b423a.xml (deflated 36%)
2024-12-18T02:30:44.7990473Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1fce43948d0c6e54.xml (deflated 35%)
2024-12-18T02:30:44.7991722Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a88e5a5c835196d.xml (deflated 36%)
2024-12-18T02:30:44.7992914Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-388cfa4673016298.xml (deflated 36%)
2024-12-18T02:30:44.7994108Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0da98ce1914e536e.xml (deflated 36%)
2024-12-18T02:30:44.7995304Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ab1cc176c481dccf.xml (deflated 35%)
2024-12-18T02:30:44.7996505Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0777f1ecf4b1bc46.xml (deflated 35%)
2024-12-18T02:30:44.7997763Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c34dc30233d4e85f.xml (deflated 35%)
2024-12-18T02:30:44.7998960Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bdbbf77bdb6b1c44.xml (deflated 35%)
2024-12-18T02:30:44.8000165Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-34fef86aed3458fd.xml (deflated 35%)
2024-12-18T02:30:44.8001360Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-853b6d96f3b1a107.xml (deflated 35%)
2024-12-18T02:30:44.8002558Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b79de59340b46a84.xml (deflated 36%)
2024-12-18T02:30:44.8003829Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6ac90c04b68e5008.xml (deflated 35%)
2024-12-18T02:30:44.8005036Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-acceadb1a15e24f3.xml (deflated 35%)
2024-12-18T02:30:44.8006245Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a1bee20068f9421a.xml (deflated 35%)
2024-12-18T02:30:44.8007448Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-14be19feea8b3534.xml (deflated 36%)
2024-12-18T02:30:44.8008635Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8d5b1c5250a7c07.xml (deflated 36%)
2024-12-18T02:30:44.8009828Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3f80d78a026b1b7b.xml (deflated 35%)
2024-12-18T02:30:44.8011025Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1f4ac170886d0f5.xml (deflated 35%)
2024-12-18T02:30:44.8012224Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e3ae871a989cf332.xml (deflated 35%)
2024-12-18T02:30:44.8013424Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a5e9508fd30f1657.xml (deflated 36%)
2024-12-18T02:30:44.8014617Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-64f5e944180610a0.xml (deflated 35%)
2024-12-18T02:30:44.8015814Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9c91b52ce4fa0c28.xml (deflated 43%)
2024-12-18T02:30:44.8017016Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe6cda2e01faa7b7.xml (deflated 43%)
2024-12-18T02:30:44.8018207Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bcc1f84001327259.xml (deflated 43%)
2024-12-18T02:30:44.8019402Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-704cd219238d683d.xml (deflated 43%)
2024-12-18T02:30:44.8020682Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88fe8b2cf2e56509.xml (deflated 43%)
2024-12-18T02:30:44.8021895Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4cd2fdcbe13f9a0.xml (deflated 43%)
2024-12-18T02:30:44.8023099Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-beef681700d85bce.xml (deflated 43%)
2024-12-18T02:30:44.8024296Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d01d5188d2f5fe51.xml (deflated 44%)
2024-12-18T02:30:44.8025494Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7417c035a9b17a51.xml (deflated 44%)
2024-12-18T02:30:44.8026742Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-54c874437f7d6035.xml (deflated 44%)
2024-12-18T02:30:44.8027929Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-29ac2a33561cddb7.xml (deflated 45%)
2024-12-18T02:30:44.8029128Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a30850189d656cd1.xml (deflated 44%)
2024-12-18T02:30:44.8030329Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6e9d01a0d43f8af1.xml (deflated 44%)
2024-12-18T02:30:44.8031527Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f7f027b4b2d22437.xml (deflated 44%)
2024-12-18T02:30:44.8032722Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-893adc0c92ecc1d2.xml (deflated 44%)
2024-12-18T02:30:44.8033931Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3ffa87e8b92cbd6.xml (deflated 44%)
2024-12-18T02:30:44.8035138Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5605b77f08c39ca3.xml (deflated 45%)
2024-12-18T02:30:44.8036337Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-53798695fdcbdfcf.xml (deflated 44%)
2024-12-18T02:30:44.8037524Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7a6181ebaf8b7e9d.xml (deflated 45%)
2024-12-18T02:30:44.8038893Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1c04089c18503232.xml (deflated 44%)
2024-12-18T02:30:44.8040097Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6843c92e78a748c1.xml (deflated 44%)
2024-12-18T02:30:44.8041304Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f064df47b863c0d4.xml (deflated 44%)
2024-12-18T02:30:44.8042517Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca39d5cf9dfbfab5.xml (deflated 44%)
2024-12-18T02:30:44.8043794Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9999ebee13d967ea.xml (deflated 44%)
2024-12-18T02:30:44.8044997Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6dd77f317b278411.xml (deflated 36%)
2024-12-18T02:30:44.8046193Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2dfa512c685b0472.xml (deflated 37%)
2024-12-18T02:30:44.8047378Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-63f1f4b65ddb7f00.xml (deflated 35%)
2024-12-18T02:30:44.8048590Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-401090b77fdc0e42.xml (deflated 35%)
2024-12-18T02:30:44.8049902Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32c2e1bb0779ba9e.xml (deflated 35%)
2024-12-18T02:30:44.8051103Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2e087837432569cb.xml (deflated 35%)
2024-12-18T02:30:44.8052307Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a3a5ce5de8aba45.xml (deflated 35%)
2024-12-18T02:30:44.8053510Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b4596977ed867b6.xml (deflated 35%)
2024-12-18T02:30:44.8054711Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7e1e7efb4927875.xml (deflated 50%)
2024-12-18T02:30:44.8055986Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4cd5927fafcb5cd8.xml (deflated 35%)
2024-12-18T02:30:44.8057190Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2056b375a1db359.xml (deflated 36%)
2024-12-18T02:30:44.8058374Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b39d41311ef05344.xml (deflated 35%)
2024-12-18T02:30:44.8059571Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0eb0ff729e405a32.xml (deflated 42%)
2024-12-18T02:30:44.8060764Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1b0ad2879f824ea2.xml (deflated 42%)
2024-12-18T02:30:44.8061970Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6bd735dfa162c81b.xml (deflated 41%)
2024-12-18T02:30:44.8063171Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-092dbc999696ca6c.xml (deflated 42%)
2024-12-18T02:30:44.8064360Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-91b5593028888689.xml (deflated 42%)
2024-12-18T02:30:44.8065557Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-19bf7d1858c85b7f.xml (deflated 42%)
2024-12-18T02:30:44.8066749Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-284f320d174e84de.xml (deflated 42%)
2024-12-18T02:30:44.8067926Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65409f097d604f69.xml (deflated 36%)
2024-12-18T02:30:44.8069121Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6413fc34878de1b5.xml (deflated 35%)
2024-12-18T02:30:44.8070319Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2449f5d990e400d6.xml (deflated 36%)
2024-12-18T02:30:44.8071522Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d54941c3dc299441.xml (deflated 35%)
2024-12-18T02:30:44.8072717Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5938aad4c3276e3a.xml (deflated 47%)
2024-12-18T02:30:44.8073920Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac2f91f131235bb1.xml (deflated 47%)
2024-12-18T02:30:44.8075121Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-26a4f5e9a3ba2ea9.xml (deflated 47%)
2024-12-18T02:30:44.8076324Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00a6f885866fb98e.xml (deflated 36%)
2024-12-18T02:30:44.8077884Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00c428ed3d32e68c.xml (deflated 36%)
2024-12-18T02:30:44.8079088Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1a4bd055482e5a0.xml (deflated 36%)
2024-12-18T02:30:44.8080283Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be982f523931654f.xml (deflated 35%)
2024-12-18T02:30:44.8081486Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ae8fa1f726a746be.xml (deflated 35%)
2024-12-18T02:30:44.8082690Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-613fa30b7a5c958f.xml (deflated 35%)
2024-12-18T02:30:44.8084028Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51de42590ed72b5d.xml (deflated 35%)
2024-12-18T02:30:44.8085234Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-469b5ed5befd7d1b.xml (deflated 36%)
2024-12-18T02:30:44.8086434Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5d2e4996a6c428f5.xml (deflated 35%)
2024-12-18T02:30:44.8087620Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eaeecb4448adda08.xml (deflated 35%)
2024-12-18T02:30:44.8088826Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-312e576095bcb349.xml (deflated 35%)
2024-12-18T02:30:44.8090025Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-83cd32ebd31f5a51.xml (deflated 35%)
2024-12-18T02:30:44.8091233Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17a7e0f7826d5964.xml (deflated 43%)
2024-12-18T02:30:44.8092434Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a985ff40fa115939.xml (deflated 36%)
2024-12-18T02:30:44.8093629Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f9d9798bd52355db.xml (deflated 35%)
2024-12-18T02:30:44.8094828Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c357aef63bf3541.xml (deflated 35%)
2024-12-18T02:30:44.8096031Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-56abb9ddffe657fc.xml (deflated 36%)
2024-12-18T02:30:44.8097219Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-95de4abe2c6260ff.xml (deflated 35%)
2024-12-18T02:30:44.8098418Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-08182b55fd3fc582.xml (deflated 36%)
2024-12-18T02:30:44.8099623Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-913466f99ff66735.xml (deflated 35%)
2024-12-18T02:30:44.8100819Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e3775bd5ad81cb07.xml (deflated 49%)
2024-12-18T02:30:44.8102019Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a5e47194f5f4ac8.xml (deflated 36%)
2024-12-18T02:30:44.8103215Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f75b0a51bc7f240.xml (deflated 35%)
2024-12-18T02:30:44.8104409Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c3b6a2c3ab562051.xml (deflated 35%)
2024-12-18T02:30:44.8105606Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-505c8df52882a71d.xml (deflated 35%)
2024-12-18T02:30:44.8106846Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e55012b598e007ee.xml (deflated 42%)
2024-12-18T02:30:44.8108039Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e6042f2377d79b12.xml (deflated 35%)
2024-12-18T02:30:44.8109237Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eab07b80eadfb843.xml (deflated 36%)
2024-12-18T02:30:44.8110437Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d734cf3c94e75894.xml (deflated 35%)
2024-12-18T02:30:44.8111634Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43ad3d2647739985.xml (deflated 35%)
2024-12-18T02:30:44.8112882Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7a7de8364a37a751.xml (deflated 35%)
2024-12-18T02:30:44.8114083Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-948db1109ffa9220.xml (deflated 35%)
2024-12-18T02:30:44.8115280Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-68dc9aad445f986c.xml (deflated 36%)
2024-12-18T02:30:44.8116466Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2ab256d85ad9a8c.xml (deflated 37%)
2024-12-18T02:30:44.8117663Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0651c6ed83d7f72e.xml (deflated 36%)
2024-12-18T02:30:44.8118853Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-898fe851bca73855.xml (deflated 37%)
2024-12-18T02:30:44.8120053Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5561fe3edc4511dc.xml (deflated 36%)
2024-12-18T02:30:44.8121250Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-015db4264ea3e531.xml (deflated 36%)
2024-12-18T02:30:44.8122446Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-29e523fd80856740.xml (deflated 36%)
2024-12-18T02:30:44.8123703Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e996b0de3ce750da.xml (deflated 36%)
2024-12-18T02:30:44.8124900Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8864fc305200126.xml (deflated 36%)
2024-12-18T02:30:44.8126103Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9c4d497153928ac4.xml (deflated 35%)
2024-12-18T02:30:44.8127295Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d61d9e6eb50ca83.xml (deflated 35%)
2024-12-18T02:30:44.8128499Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a68d73f60f1b315f.xml (deflated 44%)
2024-12-18T02:30:44.8129702Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8c6dbf29cccf06cb.xml (deflated 43%)
2024-12-18T02:30:44.8130900Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d775de16533ba367.xml (deflated 36%)
2024-12-18T02:30:44.8132102Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-826e01afa8c8e8e2.xml (deflated 35%)
2024-12-18T02:30:44.8133305Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-114d8aee2511566b.xml (deflated 35%)
2024-12-18T02:30:44.8134505Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7f310f2c8d5037b7.xml (deflated 36%)
2024-12-18T02:30:44.8135856Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4dca8b9a5fd1838f.xml (deflated 36%)
2024-12-18T02:30:44.8137046Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d5a433d6e88cdf0a.xml (deflated 43%)
2024-12-18T02:30:44.8138245Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a4110748833b1ce.xml (deflated 36%)
2024-12-18T02:30:44.8139622Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-182f4c497f26d80a.xml (deflated 47%)
2024-12-18T02:30:44.8140826Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8261c73bd773e43.xml (deflated 36%)
2024-12-18T02:30:44.8142123Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6777e4fb64184b8e.xml (deflated 35%)
2024-12-18T02:30:44.8143348Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d381bc04d1b7424.xml (deflated 35%)
2024-12-18T02:30:44.8144547Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b6dde5f49055f37.xml (deflated 36%)
2024-12-18T02:30:44.8145748Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6bc8300892a243a8.xml (deflated 35%)
2024-12-18T02:30:44.8146936Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc5471481321b9d5.xml (deflated 36%)
2024-12-18T02:30:44.8148143Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4dd76a5e81bea273.xml (deflated 35%)
2024-12-18T02:30:44.8149356Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bbe1d94bda0055f6.xml (deflated 35%)
2024-12-18T02:30:44.8150567Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e0f0ce55867fd15.xml (deflated 36%)
2024-12-18T02:30:44.8151777Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a0ffbcc11db023eb.xml (deflated 36%)
2024-12-18T02:30:44.8152987Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-73bd6fe6373ff168.xml (deflated 36%)
2024-12-18T02:30:44.8154187Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d4add920ca731e11.xml (deflated 35%)
2024-12-18T02:30:44.8155396Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c0fa78b46f0de33c.xml (deflated 36%)
2024-12-18T02:30:44.8156602Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b913c680ced4213d.xml (deflated 35%)
2024-12-18T02:30:44.8157810Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0d48bfa5ec86f8d9.xml (deflated 43%)
2024-12-18T02:30:44.8159018Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39517dd42403bf02.xml (deflated 35%)
2024-12-18T02:30:44.8160221Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0dd097ff00a9d293.xml (deflated 36%)
2024-12-18T02:30:44.8161422Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4fd2816ddc9e64ac.xml (deflated 35%)
2024-12-18T02:30:44.8162631Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2127e819cd2a6a8e.xml (deflated 35%)
2024-12-18T02:30:44.8163978Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad7e3e75e6f8639e.xml (deflated 37%)
2024-12-18T02:30:44.8165185Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80fc90a7c23c0954.xml (deflated 36%)
2024-12-18T02:30:44.8166375Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb8655673e3c77d1.xml (deflated 36%)
2024-12-18T02:30:44.8167578Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aa2fce276a45b90a.xml (deflated 36%)
2024-12-18T02:30:44.8168785Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a06a0e8dad78ce8.xml (deflated 35%)
2024-12-18T02:30:44.8170044Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8aea28032dd27c66.xml (deflated 35%)
2024-12-18T02:30:44.8171242Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1236ba881a6ea38a.xml (deflated 35%)
2024-12-18T02:30:44.8172435Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8c6b44739da09052.xml (deflated 35%)
2024-12-18T02:30:44.8173635Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b66aec4f6c182f7d.xml (deflated 36%)
2024-12-18T02:30:44.8174829Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5822b07158297136.xml (deflated 37%)
2024-12-18T02:30:44.8176011Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70731b169f19d913.xml (deflated 35%)
2024-12-18T02:30:44.8177211Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32d423509a0c4959.xml (deflated 35%)
2024-12-18T02:30:44.8178410Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-882833789a3ae6b0.xml (deflated 35%)
2024-12-18T02:30:44.8179607Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8272417b8dc60a97.xml (deflated 36%)
2024-12-18T02:30:44.8180809Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70f4c7c87dea8e41.xml (deflated 36%)
2024-12-18T02:30:44.8182008Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e3a489774fdc53f5.xml (deflated 35%)
2024-12-18T02:30:44.8183211Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ad4c41cc3dfd285.xml (deflated 35%)
2024-12-18T02:30:44.8184418Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a5d9593ef5e98a1e.xml (deflated 35%)
2024-12-18T02:30:44.8185610Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a5ce1591601f4e0a.xml (deflated 35%)
2024-12-18T02:30:44.8186812Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd08a665376a61ab.xml (deflated 45%)
2024-12-18T02:30:44.8188012Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7cce41a7a6292edb.xml (deflated 44%)
2024-12-18T02:30:44.8189210Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a7e0da94993b7183.xml (deflated 45%)
2024-12-18T02:30:44.8190413Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74b17447eec5ddc9.xml (deflated 45%)
2024-12-18T02:30:44.8191611Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fa9272d67f5a18d6.xml (deflated 45%)
2024-12-18T02:30:44.8192876Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1499091ea85c474d.xml (deflated 43%)
2024-12-18T02:30:44.8194074Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65c6b95df91b5fbc.xml (deflated 43%)
2024-12-18T02:30:44.8195275Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ad7ee38d3c88d9f.xml (deflated 43%)
2024-12-18T02:30:44.8196469Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fdb93dc4235bbed5.xml (deflated 36%)
2024-12-18T02:30:44.8197665Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-756f63c7f606f377.xml (deflated 36%)
2024-12-18T02:30:44.8198915Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a3325fdc500ef722.xml (deflated 43%)
2024-12-18T02:30:44.8200127Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72f50c301dc03a47.xml (deflated 43%)
2024-12-18T02:30:44.8201328Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7b1f7222b20f3f80.xml (deflated 35%)
2024-12-18T02:30:44.8202532Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e840f0155636aae6.xml (deflated 36%)
2024-12-18T02:30:44.8203820Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-41f1eb225fce30f8.xml (deflated 35%)
2024-12-18T02:30:44.8205028Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7fb62b802659d704.xml (deflated 35%)
2024-12-18T02:30:44.8206220Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-69c017f0aed42d89.xml (deflated 35%)
2024-12-18T02:30:44.8207428Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e16198a1af548113.xml (deflated 35%)
2024-12-18T02:30:44.8208631Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1a356f96e99ff6b.xml (deflated 35%)
2024-12-18T02:30:44.8209840Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d73d4f6f3a53cf0d.xml (deflated 35%)
2024-12-18T02:30:44.8211051Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fdc4c3facddee204.xml (deflated 35%)
2024-12-18T02:30:44.8212255Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32ac2e63bdec9950.xml (deflated 35%)
2024-12-18T02:30:44.8213469Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-49ebfadeb27048f3.xml (deflated 35%)
2024-12-18T02:30:44.8214671Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5f9c3ae691e66859.xml (deflated 36%)
2024-12-18T02:30:44.8215856Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ea1d814483da268a.xml (deflated 35%)
2024-12-18T02:30:44.8217054Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ee6d2687b00369c.xml (deflated 35%)
2024-12-18T02:30:44.8218243Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88d6544799707407.xml (deflated 35%)
2024-12-18T02:30:44.8219434Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e04259ea05960e44.xml (deflated 35%)
2024-12-18T02:30:44.8220631Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e34ad13540a5608.xml (deflated 35%)
2024-12-18T02:30:44.8221901Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-20b6738aa639e7bc.xml (deflated 35%)
2024-12-18T02:30:44.8223095Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f8149e59a9f9317.xml (deflated 36%)
2024-12-18T02:30:44.8224290Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70b32d52822ac617.xml (deflated 36%)
2024-12-18T02:30:44.8225470Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f82cd16e794313c7.xml (deflated 45%)
2024-12-18T02:30:44.8226668Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7cc299ef05904a1.xml (deflated 44%)
2024-12-18T02:30:44.8227940Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8186d6454cb7ac3f.xml (deflated 35%)
2024-12-18T02:30:44.8229141Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-17658f2a60878fdc.xml (deflated 43%)
2024-12-18T02:30:44.8230337Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7d6251d4dc2f454b.xml (deflated 42%)
2024-12-18T02:30:44.8231535Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-adc59ed811ee8e81.xml (deflated 35%)
2024-12-18T02:30:44.8232068Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-876197194e8186e5.xml (deflated 36%)
2024-12-18T02:30:44.8232621Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35159d8b6b7cea80.xml (deflated 36%)
2024-12-18T02:30:44.8233166Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de1deb98ad529ad7.xml (deflated 35%)
2024-12-18T02:30:44.8233721Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ab5d4f9fdb705723.xml (deflated 42%)
2024-12-18T02:30:44.8234258Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ce76574650b9f5c6.xml (deflated 42%)
2024-12-18T02:30:44.8234810Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8dcb4e1eca033855.xml (deflated 35%)
2024-12-18T02:30:44.8235349Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7cf04bc8224d1668.xml (deflated 36%)
2024-12-18T02:30:44.8235900Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6538f84e80ce5667.xml (deflated 35%)
2024-12-18T02:30:44.8236440Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cd5e292577cd9167.xml (deflated 37%)
2024-12-18T02:30:44.8236977Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f78c323428ae6325.xml (deflated 35%)
2024-12-18T02:30:44.8237528Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-24fcddf7f032b840.xml (deflated 35%)
2024-12-18T02:30:44.8238067Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f46cf8452a9102d7.xml (deflated 35%)
2024-12-18T02:30:44.8238795Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c47c79dd9f0b32d3.xml (deflated 35%)
2024-12-18T02:30:44.8239332Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-af1829d891653985.xml (deflated 42%)
2024-12-18T02:30:44.8239980Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e060d0f219193b22.xml (deflated 41%)
2024-12-18T02:30:44.8240516Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2cd53a5406da41e1.xml (deflated 42%)
2024-12-18T02:30:44.8241071Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-045ec2bee30ca2e9.xml (deflated 35%)
2024-12-18T02:30:44.8241614Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3ccaa726716cfc3c.xml (deflated 36%)
2024-12-18T02:30:44.8242167Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aeb0ace25d416d51.xml (deflated 35%)
2024-12-18T02:30:44.8242842Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c06641be3e607686.xml (deflated 35%)
2024-12-18T02:30:44.8243527Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bab37833c06487e6.xml (deflated 36%)
2024-12-18T02:30:44.8244096Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8d4615184f4c804.xml (deflated 36%)
2024-12-18T02:30:44.8244720Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d56c256e8abd130d.xml (deflated 36%)
2024-12-18T02:30:44.8245290Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-556b6bfb23438f56.xml (deflated 36%)
2024-12-18T02:30:44.8246069Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e12019c0023b15db.xml (deflated 35%)
2024-12-18T02:30:44.8246672Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-60f2d9ee83d597ef.xml (deflated 36%)
2024-12-18T02:30:44.8247292Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-216086ef40a4955b.xml (deflated 36%)
2024-12-18T02:30:44.8247864Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ceb98284e03f728.xml (deflated 35%)
2024-12-18T02:30:44.8248490Z   adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c08065992d7e1a45.xml (deflated 35%)
2024-12-18T02:30:44.8249281Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-bc50f200dcf1e6af.xml (deflated 38%)
2024-12-18T02:30:44.8250163Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-897c3b110af49df0.xml (deflated 38%)
2024-12-18T02:30:44.8250951Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ba2bfb694c1943f7.xml (deflated 48%)
2024-12-18T02:30:44.8251789Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-7644f3e3209a09f1.xml (deflated 49%)
2024-12-18T02:30:44.8252576Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-86d57bd633d532c9.xml (deflated 48%)
2024-12-18T02:30:44.8253448Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ad29352ff4a8b4f9.xml (deflated 48%)
2024-12-18T02:30:44.8254255Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-e3d18deb07927da1.xml (deflated 37%)
2024-12-18T02:30:44.8255102Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-767d45471301ecca.xml (deflated 37%)
2024-12-18T02:30:44.8255961Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-b7a92790a6a7fba3.xml (deflated 48%)
2024-12-18T02:30:44.8256791Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-0cd6ee008e3f02e8.xml (deflated 49%)
2024-12-18T02:30:44.8257579Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ec91a849340c2f3a.xml (deflated 48%)
2024-12-18T02:30:44.8258456Z   adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-df488fe9767246c0.xml (deflated 48%)
2024-12-18T02:30:44.8305609Z ##[group]Run # Remove any previous usage logs if they exist
2024-12-18T02:30:44.8305811Z # Remove any previous usage logs if they exist
2024-12-18T02:30:44.8305923Z rm -f logs-*.zip
2024-12-18T02:30:44.8306233Z # this workflow is also run in bazel build test, but we dont generate usage reports for it
2024-12-18T02:30:44.8306377Z # so check to see if the file exists first
2024-12-18T02:30:44.8306495Z if [ -f 'usage_log.txt' ]; then
2024-12-18T02:30:44.8306664Z     zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt'
2024-12-18T02:30:44.8306755Z fi
2024-12-18T02:30:44.8307011Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then
2024-12-18T02:30:44.8307207Z     zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log'
2024-12-18T02:30:44.8307307Z fi
2024-12-18T02:30:44.8312720Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.8312839Z env:
2024-12-18T02:30:44.8312953Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.8313248Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.8313450Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T02:30:44.8313548Z ##[endgroup]
2024-12-18T02:30:44.8584518Z   adding: usage_log.txt (deflated 96%)
2024-12-18T02:30:44.8684394Z ##[group]Run # Remove any previous debugging artifacts if they exist
2024-12-18T02:30:44.8684615Z # Remove any previous debugging artifacts if they exist
2024-12-18T02:30:44.8684736Z rm -f debug-*.zip
2024-12-18T02:30:44.8684845Z if [ -d 'test/debug' ]; then
2024-12-18T02:30:44.8685007Z   zip -r "debug-${FILE_SUFFIX}.zip" test/debug
2024-12-18T02:30:44.8685094Z fi
2024-12-18T02:30:44.8691010Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:44.8691099Z env:
2024-12-18T02:30:44.8691210Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.8691548Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.8691737Z   FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_34566861385
2024-12-18T02:30:44.8691842Z ##[endgroup]
2024-12-18T02:30:44.8792266Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T02:30:44.8792365Z with:
2024-12-18T02:30:44.8792490Z   s3-bucket: gha-artifacts
2024-12-18T02:30:44.8792638Z   s3-prefix: pytorch/pytorch/12383255652/1/artifact

2024-12-18T02:30:44.8792754Z   retention-days: 14
2024-12-18T02:30:44.8792859Z   if-no-files-found: warn
2024-12-18T02:30:44.8792963Z   path: test-jsons-*.zip
2024-12-18T02:30:44.8793072Z   name: artifact
2024-12-18T02:30:44.8793165Z   region: us-east-1
2024-12-18T02:30:44.8793264Z env:
2024-12-18T02:30:44.8793367Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:44.8793658Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:44.8793763Z ##[endgroup]
2024-12-18T02:30:45.2375397Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T02:30:45.2376196Z With the provided path, there will be 1 file uploaded
2024-12-18T02:30:45.2376669Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact
2024-12-18T02:30:45.2417086Z Starting upload of test-jsons-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:45.3680353Z Finished upload of test-jsons-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:45.3858609Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T02:30:45.3858966Z with:
2024-12-18T02:30:45.3859190Z   s3-bucket: gha-artifacts
2024-12-18T02:30:45.3859527Z   s3-prefix: pytorch/pytorch/12383255652/1/artifact

2024-12-18T02:30:45.3859892Z   retention-days: 14
2024-12-18T02:30:45.3860162Z   if-no-files-found: error
2024-12-18T02:30:45.3860454Z   path: test-reports-*.zip
2024-12-18T02:30:45.3860719Z   name: artifact
2024-12-18T02:30:45.3860977Z   region: us-east-1
2024-12-18T02:30:45.3861220Z env:
2024-12-18T02:30:45.3861590Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:45.3862084Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:45.3862578Z ##[endgroup]
2024-12-18T02:30:45.7207546Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T02:30:45.7208068Z With the provided path, there will be 1 file uploaded
2024-12-18T02:30:45.7208534Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact
2024-12-18T02:30:45.7250181Z Starting upload of test-reports-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:45.9638960Z Finished upload of test-reports-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:45.9816574Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T02:30:45.9816936Z with:
2024-12-18T02:30:45.9817161Z   s3-bucket: gha-artifacts
2024-12-18T02:30:45.9817503Z   s3-prefix: pytorch/pytorch/12383255652/1/artifact

2024-12-18T02:30:45.9817875Z   retention-days: 14
2024-12-18T02:30:45.9818142Z   if-no-files-found: ignore
2024-12-18T02:30:45.9818455Z   path: logs-*.zip
2024-12-18T02:30:45.9818691Z   name: artifact
2024-12-18T02:30:45.9818935Z   region: us-east-1
2024-12-18T02:30:45.9819179Z env:
2024-12-18T02:30:45.9819403Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:45.9819872Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:45.9820363Z ##[endgroup]
2024-12-18T02:30:46.3131480Z NOTE: s3-prefix specified, ignoring name parameter
2024-12-18T02:30:46.3132000Z With the provided path, there will be 1 file uploaded
2024-12-18T02:30:46.3132480Z Uploading to s3 prefix: pytorch/pytorch/12383255652/1/artifact
2024-12-18T02:30:46.3172111Z Starting upload of logs-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:46.4434221Z Finished upload of logs-test-distributed-2-2-linux.2xlarge_34566861385.zip
2024-12-18T02:30:46.4612219Z ##[group]Run seemethere/upload-artifact-s3@v5
2024-12-18T02:30:46.4612581Z with:
2024-12-18T02:30:46.4612801Z   s3-bucket: gha-artifacts
2024-12-18T02:30:46.4613168Z   s3-prefix: pytorch/pytorch/12383255652/1/artifact

2024-12-18T02:30:46.4613533Z   retention-days: 14
2024-12-18T02:30:46.4613803Z   if-no-files-found: ignore
2024-12-18T02:30:46.4614097Z   path: debug-*.zip
2024-12-18T02:30:46.4614332Z   name: artifact
2024-12-18T02:30:46.4614572Z   region: us-east-1
2024-12-18T02:30:46.4614818Z env:
2024-12-18T02:30:46.4615049Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:46.4615527Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:46.4616073Z ##[endgroup]
2024-12-18T02:30:46.7866019Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded.
2024-12-18T02:30:46.8049342Z ##[group]Run # shellcheck disable=SC2156
2024-12-18T02:30:46.8049744Z # shellcheck disable=SC2156
2024-12-18T02:30:46.8050339Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \;
2024-12-18T02:30:46.8056202Z shell: /usr/bin/bash -e {0}
2024-12-18T02:30:46.8056659Z env:
2024-12-18T02:30:46.8056888Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:46.8057367Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:46.8057863Z ##[endgroup]
2024-12-18T02:30:47.0317356Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@release/2.6
2024-12-18T02:30:47.0317841Z with:
2024-12-18T02:30:47.0318059Z env:
2024-12-18T02:30:47.0318273Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:47.0318759Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:47.0319266Z ##[endgroup]
2024-12-18T02:30:47.0341746Z ##[group]Run set -eou pipefail
2024-12-18T02:30:47.0342092Z set -eou pipefail
2024-12-18T02:30:47.0342373Z 
2024-12-18T02:30:47.0342746Z echo "Holding runner for 2 hours until all ssh sessions have logged out"
2024-12-18T02:30:47.0343229Z for _ in $(seq 1440); do
2024-12-18T02:30:47.0343579Z     # Break if no ssh session exists anymore
2024-12-18T02:30:47.0343963Z     if [ "$(who)" = "" ]; then
2024-12-18T02:30:47.0344277Z       break
2024-12-18T02:30:47.0344513Z     fi
2024-12-18T02:30:47.0344799Z     echo "."
2024-12-18T02:30:47.0345056Z     sleep 5
2024-12-18T02:30:47.0345297Z done
2024-12-18T02:30:47.0350901Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:47.0351292Z env:
2024-12-18T02:30:47.0351525Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:47.0352001Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:47.0352498Z ##[endgroup]
2024-12-18T02:30:47.0388461Z Holding runner for 2 hours until all ssh sessions have logged out
2024-12-18T02:30:47.0458610Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T02:30:47.0459192Z # ignore expansion of "docker ps -q" since it could be empty
2024-12-18T02:30:47.0459630Z # shellcheck disable=SC2046
2024-12-18T02:30:47.0459993Z docker stop $(docker ps -q) || true
2024-12-18T02:30:47.0460340Z # Prune all of the docker images
2024-12-18T02:30:47.0460679Z docker system prune -af
2024-12-18T02:30:47.0466229Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:30:47.0466620Z env:
2024-12-18T02:30:47.0466857Z   GIT_DEFAULT_BRANCH: main
2024-12-18T02:30:47.0467335Z   DOCKER_CONTAINER_ID: 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:47.0467835Z ##[endgroup]
2024-12-18T02:30:57.6968795Z 0eebb67298eb
2024-12-18T02:30:58.1571780Z Deleted Containers:
2024-12-18T02:30:58.1572236Z 0eebb67298eb814309772e69c73fca9aff409fa291f29c1305b01e827699a06a
2024-12-18T02:30:58.1572574Z 
2024-12-18T02:31:05.4046352Z Deleted Images:
2024-12-18T02:31:05.4047342Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11:45e1356b47a284893081276eff3000b7b534f3b1
2024-12-18T02:31:05.4049053Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11@sha256:8ce44960e47173a8d6260b111dd55523c2bac3a784dcddfb2273090443b4b985
2024-12-18T02:31:05.4050104Z deleted: sha256:ba75b8db23c6110013be41fbdb3cc39e97537b627e86e17327cbf783b8db17b3
2024-12-18T02:31:05.4050767Z deleted: sha256:aeb31b248ae8adf4509f5e01d580207d387071af5f4f4297e3d9e39f5d1cc262
2024-12-18T02:31:05.4051416Z deleted: sha256:1e223a22a3d6338cc364952bcd646dee47934aff3d19b2f8b6489e42e91a43b1
2024-12-18T02:31:05.4052109Z deleted: sha256:586c95ff7e9b84395f0ce9c35b6548a5e98ca6bc5f0b038241e81926b56d723c
2024-12-18T02:31:05.4052758Z deleted: sha256:246abd68085ecb1d1a3eb1428ee0747da876ca48f9ec048280dfbeff0074ac95
2024-12-18T02:31:05.4053418Z deleted: sha256:b92b2ff7f6ce6a5451cf921dfc731379c0a9b007f246e3daed7c60b4d5137d99
2024-12-18T02:31:05.4054069Z deleted: sha256:f8d8126016d906f5c73a3fcca17bda1ed3452ff4dff252a3c03888a3d7b42ab2
2024-12-18T02:31:05.4054967Z deleted: sha256:2c3a02b8657cf1dcac006b6b543b9142ab90226c4c7d1f53777b43acad05c1a7
2024-12-18T02:31:05.4055900Z deleted: sha256:c22810e8c09be9d6d45c72f1ffe0fb192d95e0bed3ddbf61f0c79dba2c90018a
2024-12-18T02:31:05.4056702Z deleted: sha256:73f699de8e4c822099cdff6d3d18d8b6fa3239d3dedc650a17639c28ceb510c5
2024-12-18T02:31:05.4057354Z deleted: sha256:d3ed5a77027814959f0fd12e5b80744c711d60fa30dc6a445d6f832eb1a5496e
2024-12-18T02:31:05.4058000Z deleted: sha256:1a7c842ce650c9021a132560fea5b18c14e778c9ecc47ea829ca8794136767b3
2024-12-18T02:31:05.4058633Z deleted: sha256:0f8a619247ee52fa526795a2224bc4f38fb6c26cf9fcc15c159076fa20d6d431
2024-12-18T02:31:05.4059280Z deleted: sha256:6bbd71156d8f32d92d6c43614c216e81dbd839bbae04550d948ba35abab0275c
2024-12-18T02:31:05.4059931Z deleted: sha256:3ef4fd24c00a30cfe335415866299c884d6eec5e214a6ce6266476eb5609a251
2024-12-18T02:31:05.4060590Z deleted: sha256:c051dbcd3b39a81b527fbabd88ea3e0f59fa8ac8219b3d9985db56e47094aa04
2024-12-18T02:31:05.4061257Z deleted: sha256:4d0ec5432feffd89ad55ce2d2f8dee8df2ee77d52f67154330eff867b49e10cc
2024-12-18T02:31:05.4061920Z deleted: sha256:d4d31c12cf2f8627decfcdb0305d3c29b36e45209894e6f1bf32306279a80eb2
2024-12-18T02:31:05.4062558Z deleted: sha256:0e9fff3f3281d5c4fe945357a13b019f1e3c8f703a864837330ce7bc37ef7874
2024-12-18T02:31:05.4063210Z deleted: sha256:f2f7b89123825ac5fb1c96b24c83014857425516b9b723ff9f0f39e01b55b0ba
2024-12-18T02:31:05.4064083Z deleted: sha256:6d0f5923b72e6c51119f010a01113b33c3b1908340235020c2e88f16e4ff95fc
2024-12-18T02:31:05.4064724Z deleted: sha256:5416d3f4bde212b3aa132a395a893b97d8d82cfff3f5c1adeb81fd195c56e120
2024-12-18T02:31:05.4065381Z deleted: sha256:0f2b68696d6f02eb26ed1ee845dbcbe074d1f20e975f6bfe674b4ae92e47f1ee
2024-12-18T02:31:05.4066032Z deleted: sha256:ac6c71881760b93ebcab71ccc8586ca73d23dd649971c817fcc72043735715fa
2024-12-18T02:31:05.4066679Z deleted: sha256:8ec7dc3fe13c5ac656e1ce8a9d4085e3ae6bffafe95863b06bfcd1dadd0c50b7
2024-12-18T02:31:05.4067350Z deleted: sha256:295d66ca14c997cdb9573b02a83922ddb7de0761bbf5116c64fafcd90abdd5d1
2024-12-18T02:31:05.4067993Z deleted: sha256:db23495642b38685d72ac449cd76cf7924ca1d6a16b0a06892588518bceb6b17
2024-12-18T02:31:05.4068651Z deleted: sha256:878e24ba2da51ef71abb9f5f0696ae05491b2a43b01c2bc64ecfb734c83554fc
2024-12-18T02:31:05.4069316Z deleted: sha256:0e6f24fb0632d6dc796fdb8a05f84c308e1f888c1884fedcf200c751675c80c9
2024-12-18T02:31:05.4069960Z deleted: sha256:7d6980d8a243b5f504c57d0619fb57e0e378298f52184a53ec757fd44a6d18cc
2024-12-18T02:31:05.4070597Z deleted: sha256:45b06526bf9f4acdae25f6ae3547220f80d8ca70bf3daf5b150c35046175f5e1
2024-12-18T02:31:05.4071249Z deleted: sha256:a539530bf66d9b75e34736f432dffca8005f4bb9246577c9e59a9bbacefe4e13
2024-12-18T02:31:05.4071892Z deleted: sha256:86a6dbb8582051332e0a6a65a2264f436e66454e84176171faf0e29a3afe70e7
2024-12-18T02:31:05.4072531Z deleted: sha256:160a24c1f8ab9f6e412b9452281eb8037ee100735b78d95aea1934c9628c1293
2024-12-18T02:31:05.4073186Z deleted: sha256:dd910b80f21074c66b36f8caf667bd36b8eb08a7e1ae20664198f3ce120ab2e8
2024-12-18T02:31:05.4073839Z deleted: sha256:3fc1aa7a4da8301c2ae6b29f652a136e2ef805e92863f121870955e37ff6970e
2024-12-18T02:31:05.4074482Z deleted: sha256:1cc14ebec8bc75a3313bbd143f89284ae8195c2b3604e3557c203c20c0cd1d6b
2024-12-18T02:31:05.4075146Z deleted: sha256:ed26e0eaaa30bc5ff07733f6079732409c415c81dc9d8efb220c15e7df3bacd2
2024-12-18T02:31:05.4075794Z deleted: sha256:a57c3e94b916cf07f67523e57781993dad7cbd839292a3346971863814b5db7b
2024-12-18T02:31:05.4076426Z deleted: sha256:5651b9c446349755343e61dd7f5434cb82ed57cd0d1197ba453654984f300129
2024-12-18T02:31:05.4077069Z deleted: sha256:19dda05ec0ff3f6c1e9e6fb3f954974b239b401d7cb8603eada0464aa62f45f9
2024-12-18T02:31:05.4077724Z deleted: sha256:ac5748f8b22f42e238491aff23acfd76b9e50ef45e5a05bb3ae9339010657a4a
2024-12-18T02:31:05.4078427Z deleted: sha256:5c0906a40108fc75d8b32a9686621080f65255ac3e8d71bd97798da03c95e53e
2024-12-18T02:31:05.4079130Z deleted: sha256:4614766629331e5858a201b0d5bcb6a37013c71baef80f7e87c35e9e8ea8dc49
2024-12-18T02:31:05.4079769Z deleted: sha256:8d6b9a23baf8985c711ed535e499ad6979e90f8e74798c89c0c238d0fe278f0a
2024-12-18T02:31:05.4080538Z deleted: sha256:31cc38ea0198ecdd3ec451700807ce4a7ffaea00aec0d6da1daa7e156d5e60e2
2024-12-18T02:31:05.4081197Z deleted: sha256:80aa0d10ad3f8def7708276348016c03bd68fbd921d66ab54ae962da9097a1fb
2024-12-18T02:31:05.4081942Z deleted: sha256:b2cec93458c1528084d7c8f5ecb5b247f400e1cd5c4c5494e772fc730384d9b5
2024-12-18T02:31:05.4082584Z deleted: sha256:c07a3cbfdb9f456cab10ff7a9b5e6d8a9b1539d1651912123378ca79a4beee6b
2024-12-18T02:31:05.4083317Z deleted: sha256:af532aa89116bf717712b89a57c9b263b1875b98cfd5cf26e02cf41be2fc1013
2024-12-18T02:31:05.4083972Z deleted: sha256:17d75eb3114e3c9c1bfd66df1a7238914dcdf84b07724b4b5bf6cfc85348e9e6
2024-12-18T02:31:05.4084627Z deleted: sha256:9a1cdfa255a7727e862de25c192deb6f6c25e97c06474dd2dcf2e6ce92d902dd
2024-12-18T02:31:05.4085284Z deleted: sha256:b566aff8fcc130a4a7b53c56a44aa82176e34a6a86c2f3aafcfed3076bc349d3
2024-12-18T02:31:05.4085939Z deleted: sha256:45bee2354cf9957f14ae5bba48434310bb76f6d7b9bb8e618c1f17246cb51fc8
2024-12-18T02:31:05.4086579Z deleted: sha256:9e190be19e27140bf038fc4e451552b3fa3beb9ba1710492970ddd1f0e3fa029
2024-12-18T02:31:05.4087223Z deleted: sha256:9e1415a7ba8cca6ab5c74a6b7e0e8fb8b1c6421a89fb377981012309bf6b4f0c
2024-12-18T02:31:05.4087886Z deleted: sha256:2c567bed494c25ee2d27912c572112c534e4d63eabc6fd7cf4e725b57648a148
2024-12-18T02:31:05.4088523Z deleted: sha256:1e999f6c5f49af604968d674e81018998a7379d85f759e4bb5d37703c53b86e0
2024-12-18T02:31:05.4089158Z deleted: sha256:b30ade727a853d719f75f79626a47e323ee040ba4b74b86704d2c672cd8d26c5
2024-12-18T02:31:05.4089800Z deleted: sha256:8c34eb0148fbde02b056ee5159c674405b4e6c45b9c928c0d09991986f29cc3b
2024-12-18T02:31:05.4090429Z deleted: sha256:f246ca8961e72fae0e36c74fc8131454e1c74dd99788ab4c46de695a81fd705a
2024-12-18T02:31:05.4091080Z deleted: sha256:e65c9bd66e2c9e0185c429e37a4f1d46b929d0d30feddf9a93df46d89b8d42ec
2024-12-18T02:31:05.4091721Z deleted: sha256:3774863ff6f02735140a4d72693c5dc3547b83350de6ce336c527ba7d5467308
2024-12-18T02:31:05.4092359Z deleted: sha256:e17e166aadec0c7f25954419e95e3b47b4f7f8a6f39c737385baa39612d44e92
2024-12-18T02:31:05.4093010Z deleted: sha256:5fba9281815179bbce0a79bcd0f801431cf639d81d1c96302454d4cb255d9a65
2024-12-18T02:31:05.4093651Z deleted: sha256:7895c77f0946ac84964a102e6b0396aa9afd7b5bb5f399f95192743d65d278fd
2024-12-18T02:31:05.4094279Z deleted: sha256:a914a87f9b9df03ec837d8145959e294fc40b53db7200f4aa19df708aa917d0a
2024-12-18T02:31:05.4094929Z deleted: sha256:4e851ff77a00ea886affd52d302a788fa1dc6e5086f3da273dd3f892f5a25a87
2024-12-18T02:31:05.4095574Z deleted: sha256:24a67e4c1291641c80c27612beff31554f87aa99a361451b48e38bdd390ee52b
2024-12-18T02:31:05.4096204Z deleted: sha256:e5108cb11e4a0399e9d2e97768480b2162c8ed08c7d3d928881716b58f7d6a06
2024-12-18T02:31:05.4096848Z deleted: sha256:3645dcd9fb7cfddd3837947579db0257dde78596304428d1daa92ff2626c03e7
2024-12-18T02:31:05.4097481Z deleted: sha256:fa1875e33008bfe122d5fcc20dc79d779bc53905359af1113332936ff17cb1b9
2024-12-18T02:31:05.4098130Z deleted: sha256:f8bed40e703ff2a2ab99ee6033afc7b6e9cc3646747798260c6dfce01d340567
2024-12-18T02:31:05.4098786Z deleted: sha256:86f67a8ebecb756d3a39f7bdc902541146354a466c2b1a41f9622248435537b9
2024-12-18T02:31:05.4099420Z deleted: sha256:10f4b37f40901aa6a384f56d192a951db810177e640e4899d9e5433219784696
2024-12-18T02:31:05.4100048Z deleted: sha256:433436db19108287e6066ef506f03435459f1f8030a4e71272598e9bcdd8fed1
2024-12-18T02:31:05.4100681Z deleted: sha256:9df77c78b35d6913e368eaf4da3a8a30bb84956b53b93535adbf83e3f080bb45
2024-12-18T02:31:05.4101325Z deleted: sha256:9c5a001178848db25de9aa27faa5a3a970e9adb6a5de5af11f551b3cf8c640af
2024-12-18T02:31:05.4101977Z deleted: sha256:49215fb32aff9c76cd9b1a48305b7ca3b262a769826cdef352c6a2ddd6b61e2e
2024-12-18T02:31:05.4102628Z deleted: sha256:266e809a72cfd156276f0d2cfe1d7f560ce71ecfff0871ad75a54b46a888458c
2024-12-18T02:31:05.4103272Z deleted: sha256:7824aef9285092646c0e847bacc350150b5593e4dd50d476c97a7b9ef2bd5832
2024-12-18T02:31:05.4103902Z deleted: sha256:dd2955a3c1730d510a7b8727749ea263b29c24004e3db0591c5e01187fd04ebb
2024-12-18T02:31:05.4104622Z deleted: sha256:776fdef2552a20b841f6123adef24358398ce96b0bcf4f063b77b43af75ccabe
2024-12-18T02:31:05.4105249Z deleted: sha256:3debd486979133b9fb2d2b60175532b65f25959777e148056b24d48630ea7580
2024-12-18T02:31:05.4105934Z deleted: sha256:350913dc408831d71f1d6cad376922537125851c919370a8e50e31d3ec2cda0b
2024-12-18T02:31:05.4106572Z deleted: sha256:4083e3d0e14e534d7532677ae2dfcf0f4e61f9727daa77bc6a457d19af86531b
2024-12-18T02:31:05.4107222Z deleted: sha256:a3a312998a133afbd1f853f9dbb938fd2df577d715601d8fa7b1795957486c55
2024-12-18T02:31:05.4107876Z deleted: sha256:a01dc28d4cb6dc69779fd9a36faa6d962d11c32e2bcafa3bb518e9739eb830be
2024-12-18T02:31:05.4108538Z deleted: sha256:e6b80ded1eac5dc87de66c217fe26ced6a84403732f31a66603a4ef84e51a629
2024-12-18T02:31:05.4109180Z deleted: sha256:4f1b3dba7d93f46f40596ef2ad87c27bff39abb592f484286a507403d8a5f2ae
2024-12-18T02:31:05.4109826Z deleted: sha256:6831241403c4ce00ca6d2e124af8eae501c2e9b27433704edf468abd652dfacd
2024-12-18T02:31:05.4110468Z deleted: sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465
2024-12-18T02:31:05.4110859Z 
2024-12-18T02:31:05.4143039Z Total reclaimed space: 22.98GB
2024-12-18T02:31:05.4240901Z Post job cleanup.
2024-12-18T02:31:05.4311311Z Post job cleanup.
2024-12-18T02:31:05.5101446Z [command]/usr/bin/git version
2024-12-18T02:31:05.5213301Z git version 2.40.1
2024-12-18T02:31:05.5253930Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/27d7ddae-d38e-4058-885c-5fb797d4a03a' before making global git config changes
2024-12-18T02:31:05.5254905Z Adding repository directory to the temporary git global config as a safe directory
2024-12-18T02:31:05.5258107Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2024-12-18T02:31:05.5297476Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-12-18T02:31:05.5322809Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-12-18T02:31:05.5691988Z Entering 'android/libs/fbjni'
2024-12-18T02:31:05.5744522Z Entering 'third_party/FP16'
2024-12-18T02:31:05.5794443Z Entering 'third_party/FXdiv'
2024-12-18T02:31:05.5844951Z Entering 'third_party/NNPACK'
2024-12-18T02:31:05.5894265Z Entering 'third_party/NVTX'
2024-12-18T02:31:05.5943876Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T02:31:05.5993290Z Entering 'third_party/XNNPACK'
2024-12-18T02:31:05.6059143Z Entering 'third_party/benchmark'
2024-12-18T02:31:05.6109511Z Entering 'third_party/composable_kernel'
2024-12-18T02:31:05.6165339Z Entering 'third_party/cpp-httplib'
2024-12-18T02:31:05.6215542Z Entering 'third_party/cpuinfo'
2024-12-18T02:31:05.6266573Z Entering 'third_party/cudnn_frontend'
2024-12-18T02:31:05.6316574Z Entering 'third_party/cutlass'
2024-12-18T02:31:05.6374656Z Entering 'third_party/eigen'
2024-12-18T02:31:05.6426408Z Entering 'third_party/fbgemm'
2024-12-18T02:31:05.6478955Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T02:31:05.6528085Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T02:31:05.6578424Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T02:31:05.6633342Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T02:31:05.6682788Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T02:31:05.6732465Z Entering 'third_party/flatbuffers'
2024-12-18T02:31:05.6786443Z Entering 'third_party/fmt'
2024-12-18T02:31:05.6837633Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T02:31:05.6888861Z Entering 'third_party/gloo'
2024-12-18T02:31:05.6940497Z Entering 'third_party/googletest'
2024-12-18T02:31:05.6990100Z Entering 'third_party/ideep'
2024-12-18T02:31:05.7038723Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T02:31:05.7096719Z Entering 'third_party/ittapi'
2024-12-18T02:31:05.7148067Z Entering 'third_party/kineto'
2024-12-18T02:31:05.7198312Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T02:31:05.7248960Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T02:31:05.7300639Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T02:31:05.7350839Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T02:31:05.7401580Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T02:31:05.7452252Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T02:31:05.7507261Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T02:31:05.7558534Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T02:31:05.7608545Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T02:31:05.7660347Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T02:31:05.7712415Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T02:31:05.7762501Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T02:31:05.7813671Z Entering 'third_party/mimalloc'
2024-12-18T02:31:05.7864822Z Entering 'third_party/nccl/nccl'
2024-12-18T02:31:05.7915754Z Entering 'third_party/nlohmann'
2024-12-18T02:31:05.7967021Z Entering 'third_party/onnx'
2024-12-18T02:31:05.8033065Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T02:31:05.8087170Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T02:31:05.8141353Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T02:31:05.8192321Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T02:31:05.8243288Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T02:31:05.8293035Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T02:31:05.8343610Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T02:31:05.8391821Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T02:31:05.8441622Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T02:31:05.8490509Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T02:31:05.8541897Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T02:31:05.8593371Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T02:31:05.8664453Z Entering 'third_party/pocketfft'
2024-12-18T02:31:05.8714946Z Entering 'third_party/protobuf'
2024-12-18T02:31:05.8768327Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T02:31:05.8818277Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T02:31:05.8870386Z Entering 'third_party/psimd'
2024-12-18T02:31:05.8922253Z Entering 'third_party/pthreadpool'
2024-12-18T02:31:05.8974112Z Entering 'third_party/pybind11'
2024-12-18T02:31:05.9025235Z Entering 'third_party/python-peachpy'
2024-12-18T02:31:05.9075857Z Entering 'third_party/sleef'
2024-12-18T02:31:05.9126759Z Entering 'third_party/tensorpipe'
2024-12-18T02:31:05.9178708Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T02:31:05.9229293Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T02:31:05.9279258Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T02:31:05.9329927Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T02:31:05.9378909Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T02:31:05.9448763Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-12-18T02:31:05.9466376Z http.https://github.com/.extraheader
2024-12-18T02:31:05.9474469Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2024-12-18T02:31:05.9499491Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-12-18T02:31:05.9775342Z Entering 'android/libs/fbjni'
2024-12-18T02:31:05.9811689Z http.https://github.com/.extraheader
2024-12-18T02:31:05.9843724Z Entering 'third_party/FP16'
2024-12-18T02:31:05.9879026Z http.https://github.com/.extraheader
2024-12-18T02:31:05.9910750Z Entering 'third_party/FXdiv'
2024-12-18T02:31:05.9945590Z http.https://github.com/.extraheader
2024-12-18T02:31:05.9977622Z Entering 'third_party/NNPACK'
2024-12-18T02:31:06.0013037Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0047177Z Entering 'third_party/NVTX'
2024-12-18T02:31:06.0082274Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0114863Z Entering 'third_party/VulkanMemoryAllocator'
2024-12-18T02:31:06.0151081Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0183428Z Entering 'third_party/XNNPACK'
2024-12-18T02:31:06.0217706Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0264584Z Entering 'third_party/benchmark'
2024-12-18T02:31:06.0297984Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0328197Z Entering 'third_party/composable_kernel'
2024-12-18T02:31:06.0361504Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0397751Z Entering 'third_party/cpp-httplib'
2024-12-18T02:31:06.0430783Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0462376Z Entering 'third_party/cpuinfo'
2024-12-18T02:31:06.0495825Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0526972Z Entering 'third_party/cudnn_frontend'
2024-12-18T02:31:06.0560637Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0591930Z Entering 'third_party/cutlass'
2024-12-18T02:31:06.0625453Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0666680Z Entering 'third_party/eigen'
2024-12-18T02:31:06.0701930Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0736018Z Entering 'third_party/fbgemm'
2024-12-18T02:31:06.0770324Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0802360Z Entering 'third_party/fbgemm/third_party/asmjit'
2024-12-18T02:31:06.0835971Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0867624Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2024-12-18T02:31:06.0900121Z http.https://github.com/.extraheader
2024-12-18T02:31:06.0930927Z Entering 'third_party/fbgemm/third_party/cutlass'
2024-12-18T02:31:06.0965021Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1002231Z Entering 'third_party/fbgemm/third_party/googletest'
2024-12-18T02:31:06.1035459Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1067068Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2024-12-18T02:31:06.1100571Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1132984Z Entering 'third_party/flatbuffers'
2024-12-18T02:31:06.1167864Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1201673Z Entering 'third_party/fmt'
2024-12-18T02:31:06.1235593Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1267662Z Entering 'third_party/gemmlowp/gemmlowp'
2024-12-18T02:31:06.1301645Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1333156Z Entering 'third_party/gloo'
2024-12-18T02:31:06.1367084Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1399209Z Entering 'third_party/googletest'
2024-12-18T02:31:06.1433217Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1466869Z Entering 'third_party/ideep'
2024-12-18T02:31:06.1501894Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1533436Z Entering 'third_party/ideep/mkl-dnn'
2024-12-18T02:31:06.1567003Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1607037Z Entering 'third_party/ittapi'
2024-12-18T02:31:06.1642217Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1673132Z Entering 'third_party/kineto'
2024-12-18T02:31:06.1706621Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1741128Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2024-12-18T02:31:06.1773495Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1806450Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2024-12-18T02:31:06.1841716Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1875975Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2024-12-18T02:31:06.1910529Z http.https://github.com/.extraheader
2024-12-18T02:31:06.1944466Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2024-12-18T02:31:06.1979115Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2012353Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2024-12-18T02:31:06.2047283Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2079450Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2024-12-18T02:31:06.2113531Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2148651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2024-12-18T02:31:06.2183537Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2216524Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2024-12-18T02:31:06.2252993Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2286680Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2024-12-18T02:31:06.2320689Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2357408Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2024-12-18T02:31:06.2392630Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2426468Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2024-12-18T02:31:06.2462287Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2494997Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2024-12-18T02:31:06.2530520Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2567091Z Entering 'third_party/mimalloc'
2024-12-18T02:31:06.2602784Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2635435Z Entering 'third_party/nccl/nccl'
2024-12-18T02:31:06.2671607Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2703980Z Entering 'third_party/nlohmann'
2024-12-18T02:31:06.2739250Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2772011Z Entering 'third_party/onnx'
2024-12-18T02:31:06.2806640Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2855619Z Entering 'third_party/onnx/third_party/pybind11'
2024-12-18T02:31:06.2890150Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2924722Z Entering 'third_party/opentelemetry-cpp'
2024-12-18T02:31:06.2961101Z http.https://github.com/.extraheader
2024-12-18T02:31:06.2994702Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2024-12-18T02:31:06.3029092Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3060381Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2024-12-18T02:31:06.3094035Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3125667Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2024-12-18T02:31:06.3160574Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3191582Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2024-12-18T02:31:06.3226047Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3259466Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2024-12-18T02:31:06.3293337Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3324449Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2024-12-18T02:31:06.3359579Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3390631Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2024-12-18T02:31:06.3424009Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3457104Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2024-12-18T02:31:06.3491016Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3524676Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2024-12-18T02:31:06.3558587Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3591960Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2024-12-18T02:31:06.3625827Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3679662Z Entering 'third_party/pocketfft'
2024-12-18T02:31:06.3714842Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3748038Z Entering 'third_party/protobuf'
2024-12-18T02:31:06.3781942Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3816388Z Entering 'third_party/protobuf/third_party/benchmark'
2024-12-18T02:31:06.3851077Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3881509Z Entering 'third_party/protobuf/third_party/googletest'
2024-12-18T02:31:06.3914745Z http.https://github.com/.extraheader
2024-12-18T02:31:06.3947961Z Entering 'third_party/psimd'
2024-12-18T02:31:06.3982411Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4013576Z Entering 'third_party/pthreadpool'
2024-12-18T02:31:06.4047316Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4078229Z Entering 'third_party/pybind11'
2024-12-18T02:31:06.4112642Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4145053Z Entering 'third_party/python-peachpy'
2024-12-18T02:31:06.4178434Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4209887Z Entering 'third_party/sleef'
2024-12-18T02:31:06.4245069Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4276675Z Entering 'third_party/tensorpipe'
2024-12-18T02:31:06.4310870Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4342719Z Entering 'third_party/tensorpipe/third_party/googletest'
2024-12-18T02:31:06.4376108Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4406979Z Entering 'third_party/tensorpipe/third_party/libnop'
2024-12-18T02:31:06.4440678Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4471002Z Entering 'third_party/tensorpipe/third_party/libuv'
2024-12-18T02:31:06.4504162Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4535391Z Entering 'third_party/tensorpipe/third_party/pybind11'
2024-12-18T02:31:06.4568963Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4598980Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2024-12-18T02:31:06.4632831Z http.https://github.com/.extraheader
2024-12-18T02:31:06.4748699Z A job completed hook has been configured by the self-hosted runner administrator
2024-12-18T02:31:06.4772104Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2024-12-18T02:31:06.4777457Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2024-12-18T02:31:06.4777856Z ##[endgroup]
2024-12-18T02:31:14.1730479Z Cleaning up orphan processes