2025-03-14T03:51:53.7956292Z Current runner version: '2.322.0'
2025-03-14T03:51:53.7963489Z Runner name: 'i-0fff31ea0babea20d'
2025-03-14T03:51:53.7964428Z Runner group name: 'Default'
2025-03-14T03:51:53.7965465Z Machine name: 'ip-10-0-67-24'
2025-03-14T03:51:53.7968706Z ##[group]GITHUB_TOKEN Permissions
2025-03-14T03:51:53.7971414Z Contents: read
2025-03-14T03:51:53.7972049Z Metadata: read
2025-03-14T03:51:53.7972697Z ##[endgroup]
2025-03-14T03:51:53.7976115Z Secret source: Actions
2025-03-14T03:51:53.7977167Z Prepare workflow directory
2025-03-14T03:51:54.0952783Z Prepare all required actions
2025-03-14T03:51:54.0997510Z Getting action download info
2025-03-14T03:51:54.2924345Z Download action repository 'pytorch/pytorch@main' (SHA:aed0b7a742a2d7b7901790622829cbd2135049a4)
2025-03-14T03:52:07.1672802Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6)
2025-03-14T03:52:07.4339120Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a)
2025-03-14T03:52:07.6231445Z Download action repository 'actions/upload-artifact@v4' (SHA:4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1)
2025-03-14T03:52:08.0163022Z Getting action download info
2025-03-14T03:52:08.1362521Z Download action repository 'actions/checkout@v4' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683)
2025-03-14T03:52:08.3382351Z Uses: pytorch/pytorch/.github/workflows/target_determination.yml@refs/heads/main (aed0b7a742a2d7b7901790622829cbd2135049a4)
2025-03-14T03:52:08.3384629Z Complete job name: before-test / target-determination
2025-03-14T03:52:08.3817148Z A job started hook has been configured by the self-hosted runner administrator
2025-03-14T03:52:08.3922927Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2025-03-14T03:52:08.3932364Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:08.3933051Z ##[endgroup]
2025-03-14T03:52:10.1710345Z Runner Type: lf.linux.2xlarge
2025-03-14T03:52:10.1710883Z Instance Type: c5.2xlarge
2025-03-14T03:52:10.1711225Z AMI Name: unknown
2025-03-14T03:52:10.1735822Z AMI ID: ami-05b10e08d247fb927
2025-03-14T03:52:15.7536382Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main
2025-03-14T03:52:15.7536889Z with:
2025-03-14T03:52:15.7537119Z   submodules: false
2025-03-14T03:52:15.7537397Z   fetch-depth: 0
2025-03-14T03:52:15.7537648Z ##[endgroup]
2025-03-14T03:52:15.7619400Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T03:52:15.7620433Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T03:52:15.7627626Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:15.7628051Z ##[endgroup]
2025-03-14T03:52:15.7751424Z ##[group]Run # Use all available CPUs for fetching
2025-03-14T03:52:15.7751900Z # Use all available CPUs for fetching
2025-03-14T03:52:15.7752276Z cd "${GITHUB_WORKSPACE}"
2025-03-14T03:52:15.7752707Z git config --global fetch.parallel 0
2025-03-14T03:52:15.7753137Z git config --global submodule.fetchJobs 0
2025-03-14T03:52:15.7753534Z 
2025-03-14T03:52:15.7753926Z # Clean workspace. The default checkout action should also do this, but
2025-03-14T03:52:15.7754436Z # do it here as well just in case
2025-03-14T03:52:15.7754781Z if [[ -d .git ]]; then
2025-03-14T03:52:15.7755100Z   if [ -z "${NO_SUDO}" ]; then
2025-03-14T03:52:15.7755427Z     sudo git clean -ffdx
2025-03-14T03:52:15.7755732Z   else
2025-03-14T03:52:15.7755999Z     git clean -ffdx
2025-03-14T03:52:15.7756284Z   fi
2025-03-14T03:52:15.7756514Z fi
2025-03-14T03:52:15.7762711Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:15.7763144Z env:
2025-03-14T03:52:15.7763370Z   NO_SUDO: 
2025-03-14T03:52:15.7763603Z ##[endgroup]
2025-03-14T03:52:15.9880510Z Removing .additional_ci_files/
2025-03-14T03:52:15.9880928Z Removing .pytest_cache/
2025-03-14T03:52:15.9881212Z Removing build/
2025-03-14T03:52:15.9881468Z Removing dist/
2025-03-14T03:52:15.9881837Z Removing logs-test-default-5-5-lf.linux.2xlarge_38752119937.zip
2025-03-14T03:52:15.9882495Z Removing test-jsons-test-default-5-5-lf.linux.2xlarge_38752119937.zip
2025-03-14T03:52:15.9883115Z Removing test-reports-test-default-5-5-lf.linux.2xlarge_38752119937.zip
2025-03-14T03:52:15.9883646Z Removing test/.pytorch-disabled-tests.json
2025-03-14T03:52:15.9884017Z Removing test/__pycache__/
2025-03-14T03:52:15.9884330Z Removing test/autograd/__pycache__/
2025-03-14T03:52:15.9884671Z Removing test/dynamo/__pycache__/
2025-03-14T03:52:15.9884986Z Removing test/export/__pycache__/
2025-03-14T03:52:15.9885315Z Removing test/inductor/__pycache__/
2025-03-14T03:52:15.9885649Z Removing test/test-reports/
2025-03-14T03:52:15.9885963Z Removing test/torch_np/__pycache__/
2025-03-14T03:52:15.9886292Z Removing tools/__pycache__/
2025-03-14T03:52:15.9886597Z Removing tools/stats/__pycache__/
2025-03-14T03:52:15.9887005Z Removing tools/stats/upload_utilization_stats/__pycache__/
2025-03-14T03:52:15.9887435Z Removing tools/testing/__pycache__/
2025-03-14T03:52:15.9887841Z Removing tools/testing/target_determination/__pycache__/
2025-03-14T03:52:15.9888377Z Removing tools/testing/target_determination/heuristics/__pycache__/
2025-03-14T03:52:15.9888826Z Removing usage_log.txt
2025-03-14T03:52:16.0004474Z ##[group]Run actions/checkout@v4
2025-03-14T03:52:16.0004814Z with:
2025-03-14T03:52:16.0005086Z   ref: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T03:52:16.0005432Z   fetch-depth: 0
2025-03-14T03:52:16.0005692Z   submodules: false
2025-03-14T03:52:16.0005996Z   show-progress: false
2025-03-14T03:52:16.0006384Z   repository: pytorch/pytorch
2025-03-14T03:52:16.0006925Z   token: ***
2025-03-14T03:52:16.0007172Z   ssh-strict: true
2025-03-14T03:52:16.0007414Z   ssh-user: git
2025-03-14T03:52:16.0007735Z   persist-credentials: true
2025-03-14T03:52:16.0008172Z   clean: true
2025-03-14T03:52:16.0008664Z   sparse-checkout-cone-mode: true
2025-03-14T03:52:16.0008990Z   fetch-tags: false
2025-03-14T03:52:16.0009269Z   lfs: false
2025-03-14T03:52:16.0009513Z   set-safe-directory: true
2025-03-14T03:52:16.0009828Z ##[endgroup]
2025-03-14T03:52:16.1146398Z Syncing repository: pytorch/pytorch
2025-03-14T03:52:16.1147801Z ##[group]Getting Git version info
2025-03-14T03:52:16.1148320Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2025-03-14T03:52:16.1149043Z [command]/usr/bin/git version
2025-03-14T03:52:16.1149353Z git version 2.47.1
2025-03-14T03:52:16.1160871Z ##[endgroup]
2025-03-14T03:52:16.1170589Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/84ad0770-a012-4079-ab06-7f74b999eb69/.gitconfig'
2025-03-14T03:52:16.1188696Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/84ad0770-a012-4079-ab06-7f74b999eb69' before making global git config changes
2025-03-14T03:52:16.1189742Z Adding repository directory to the temporary git global config as a safe directory
2025-03-14T03:52:16.1193547Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T03:52:16.1231311Z [command]/usr/bin/git config --local --get remote.origin.url
2025-03-14T03:52:16.1248872Z https://github.com/pytorch/pytorch
2025-03-14T03:52:16.1262797Z ##[group]Removing previously created refs, to avoid conflicts
2025-03-14T03:52:16.1266048Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD
2025-03-14T03:52:16.1285073Z HEAD
2025-03-14T03:52:16.1318417Z ##[endgroup]
2025-03-14T03:52:16.1322154Z [command]/usr/bin/git submodule status
2025-03-14T03:52:16.1669809Z  7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe)
2025-03-14T03:52:16.1780083Z  4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081)
2025-03-14T03:52:16.1871400Z  b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327)
2025-03-14T03:52:16.1980826Z  c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0)
2025-03-14T03:52:16.2004451Z  e170594ac7cf1dac584da473d4ca9301087090c1 third_party/NVTX (v3.1.0)
2025-03-14T03:52:16.2236674Z  a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 third_party/VulkanMemoryAllocator (v2.1.0-705-ga6bfc23)
2025-03-14T03:52:16.2778098Z  51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a010365)
2025-03-14T03:52:16.2823389Z  0d98dba29d66e93259db7daa53a9327df767a415 third_party/benchmark (v1.6.1)
2025-03-14T03:52:16.2862022Z  8086bbe3a78d931eb96fe12fdc014082e18d18d3 third_party/composable_kernel (mock-tag-test-6-g8086bbe3a)
2025-03-14T03:52:16.3016500Z  3b6597bba913d51161383657829b7e644e59c006 third_party/cpp-httplib (v0.15.3-20-g3b6597b)
2025-03-14T03:52:16.3200815Z  1e83a2fdd3102f65c6f1fb602c1b320486218a99 third_party/cpuinfo (1e83a2f)
2025-03-14T03:52:16.3380237Z  91b7532f3386768bba4f444ee7672b497f34da8a third_party/cudnn_frontend (v0.5-44-g91b7532)
2025-03-14T03:52:16.3482099Z  afa1772203677c5118fcd82537a9c8fefbcc7008 third_party/cutlass (v3.8.0)
2025-03-14T03:52:16.4230608Z  3147391d946bb4b6c68edd901f2add6ac1f31f8c third_party/eigen (3.4.0)
2025-03-14T03:52:16.4637082Z  dbc3157bf256f1339b3fa1fef2be89ac4078be0e third_party/fbgemm (v0.4.1-446-gdbc3157b)
2025-03-14T03:52:16.4737137Z  979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4)
2025-03-14T03:52:16.4759822Z  01834de25e4bf3975a9a00e816292b1ad0fe184b third_party/flatbuffers (v23.3.3)
2025-03-14T03:52:16.5189911Z  123913715afeb8a437e6388b4473fcc4753e1c9a third_party/fmt (11.1.4)
2025-03-14T03:52:16.5300182Z  3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17)
2025-03-14T03:52:16.5420062Z  5354032ea08eadd7fc4456477f7f7c6308818509 third_party/gloo (5354032)
2025-03-14T03:52:16.5676754Z  b514bdc898e2951020cbdca1304b75f5950d1f59 third_party/googletest (release-1.8.0-3484-gb514bdc8)
2025-03-14T03:52:16.5759548Z  719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1)
2025-03-14T03:52:16.5819933Z  5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 third_party/ittapi (v3.23.0-14-g5b8a7d7)
2025-03-14T03:52:16.6068855Z  2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 third_party/kineto (remotes/origin/sraikund/test-53-g2859721)
2025-03-14T03:52:16.6093257Z  ef685a13cfbe8d418aa2ed34350e21e4938358b6 third_party/kleidiai (v1.3.0)
2025-03-14T03:52:16.6117095Z  b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 third_party/mimalloc (v1.8.2)
2025-03-14T03:52:16.6606648Z  87cda1d6646592ac5866dc703c8e1839046a6806 third_party/nlohmann (v3.10.1-113-g87cda1d6)
2025-03-14T03:52:16.6933810Z  b8baa8446686496da4cc8fda09f2b6fe65c2a02c third_party/onnx (v1.17.0)
2025-03-14T03:52:16.6958675Z  a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2)
2025-03-14T03:52:16.6984021Z  9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe third_party/pocketfft (release_for_eigen-11-g9d3ab05)
2025-03-14T03:52:16.7388036Z  d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b)
2025-03-14T03:52:16.7460771Z  072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master)
2025-03-14T03:52:16.7514711Z  4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e)
2025-03-14T03:52:16.7563890Z  a2e59f0e7065404b44dfe92a28aca47ba1378dc4 third_party/pybind11 (v2.11.0-182-ga2e59f0e)
2025-03-14T03:52:16.7633893Z  f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated)
2025-03-14T03:52:16.7741538Z  56e1f79cb140fb9326d612d0be06b5250565cade third_party/sleef (3.7-33-g56e1f79)
2025-03-14T03:52:16.7805788Z  52791a2fd214b2a9dc5759d36725909c1daa7f2e third_party/tensorpipe (remotes/origin/master)
2025-03-14T03:52:16.7816188Z ##[group]Cleaning the repository
2025-03-14T03:52:16.7820186Z [command]/usr/bin/git clean -ffdx
2025-03-14T03:52:16.8012699Z [command]/usr/bin/git reset --hard HEAD
2025-03-14T03:52:17.8642496Z Updating files:  73% (12127/16541)
2025-03-14T03:52:17.8775213Z Updating files:  74% (12241/16541)
2025-03-14T03:52:17.8891523Z Updating files:  75% (12406/16541)
2025-03-14T03:52:17.9127706Z Updating files:  76% (12572/16541)
2025-03-14T03:52:17.9344340Z Updating files:  77% (12737/16541)
2025-03-14T03:52:17.9605038Z Updating files:  78% (12902/16541)
2025-03-14T03:52:17.9818885Z Updating files:  79% (13068/16541)
2025-03-14T03:52:18.0057587Z Updating files:  80% (13233/16541)
2025-03-14T03:52:18.0182110Z Updating files:  81% (13399/16541)
2025-03-14T03:52:18.0319620Z Updating files:  82% (13564/16541)
2025-03-14T03:52:18.0476414Z Updating files:  83% (13730/16541)
2025-03-14T03:52:18.0618248Z Updating files:  84% (13895/16541)
2025-03-14T03:52:18.0733400Z Updating files:  85% (14060/16541)
2025-03-14T03:52:18.0877288Z Updating files:  86% (14226/16541)
2025-03-14T03:52:18.0983814Z Updating files:  87% (14391/16541)
2025-03-14T03:52:18.1142668Z Updating files:  88% (14557/16541)
2025-03-14T03:52:18.1341193Z Updating files:  89% (14722/16541)
2025-03-14T03:52:18.1452550Z Updating files:  90% (14887/16541)
2025-03-14T03:52:18.1583455Z Updating files:  91% (15053/16541)
2025-03-14T03:52:18.1736056Z Updating files:  92% (15218/16541)
2025-03-14T03:52:18.1924855Z Updating files:  93% (15384/16541)
2025-03-14T03:52:18.2143764Z Updating files:  94% (15549/16541)
2025-03-14T03:52:18.2323193Z Updating files:  95% (15714/16541)
2025-03-14T03:52:18.2469613Z Updating files:  96% (15880/16541)
2025-03-14T03:52:18.2776921Z Updating files:  97% (16045/16541)
2025-03-14T03:52:18.2936530Z Updating files:  98% (16211/16541)
2025-03-14T03:52:18.3101806Z Updating files:  99% (16376/16541)
2025-03-14T03:52:18.3102182Z Updating files: 100% (16541/16541)
2025-03-14T03:52:18.3102509Z Updating files: 100% (16541/16541), done.
2025-03-14T03:52:18.3283702Z HEAD is now at bd72c961cb2 Remove temp changes
2025-03-14T03:52:18.3357483Z ##[endgroup]
2025-03-14T03:52:18.3359398Z ##[group]Disabling automatic garbage collection
2025-03-14T03:52:18.3365038Z [command]/usr/bin/git config --local gc.auto 0
2025-03-14T03:52:18.3393843Z ##[endgroup]
2025-03-14T03:52:18.3394381Z ##[group]Setting up auth
2025-03-14T03:52:18.3399546Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-03-14T03:52:18.3434296Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-03-14T03:52:18.3707857Z Entering 'android/libs/fbjni'
2025-03-14T03:52:18.3759912Z Entering 'third_party/FP16'
2025-03-14T03:52:18.3810521Z Entering 'third_party/FXdiv'
2025-03-14T03:52:18.3859563Z Entering 'third_party/NNPACK'
2025-03-14T03:52:18.3910734Z Entering 'third_party/NVTX'
2025-03-14T03:52:18.3960942Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T03:52:18.4010820Z Entering 'third_party/XNNPACK'
2025-03-14T03:52:18.4076746Z Entering 'third_party/benchmark'
2025-03-14T03:52:18.4127707Z Entering 'third_party/composable_kernel'
2025-03-14T03:52:18.4184702Z Entering 'third_party/cpp-httplib'
2025-03-14T03:52:18.4234886Z Entering 'third_party/cpuinfo'
2025-03-14T03:52:18.4285960Z Entering 'third_party/cudnn_frontend'
2025-03-14T03:52:18.4336223Z Entering 'third_party/cutlass'
2025-03-14T03:52:18.4394847Z Entering 'third_party/eigen'
2025-03-14T03:52:18.4447009Z Entering 'third_party/fbgemm'
2025-03-14T03:52:18.4497519Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T03:52:18.4545785Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T03:52:18.4595023Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T03:52:18.4650693Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T03:52:18.4700887Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T03:52:18.4751069Z Entering 'third_party/flash-attention'
2025-03-14T03:52:18.4803157Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T03:52:18.4859328Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T03:52:18.4918490Z Entering 'third_party/flatbuffers'
2025-03-14T03:52:18.4971176Z Entering 'third_party/fmt'
2025-03-14T03:52:18.5021798Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T03:52:18.5071395Z Entering 'third_party/gloo'
2025-03-14T03:52:18.5122496Z Entering 'third_party/googletest'
2025-03-14T03:52:18.5173510Z Entering 'third_party/ideep'
2025-03-14T03:52:18.5223606Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T03:52:18.5281166Z Entering 'third_party/ittapi'
2025-03-14T03:52:18.5331854Z Entering 'third_party/kineto'
2025-03-14T03:52:18.5382516Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T03:52:18.5432003Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T03:52:18.5482880Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T03:52:18.5533477Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T03:52:18.5583752Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T03:52:18.5632692Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T03:52:18.5684403Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T03:52:18.5733884Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T03:52:18.5783490Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T03:52:18.5833961Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T03:52:18.5887421Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T03:52:18.5937000Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T03:52:18.5989370Z Entering 'third_party/kleidiai'
2025-03-14T03:52:18.6040998Z Entering 'third_party/mimalloc'
2025-03-14T03:52:18.6091691Z Entering 'third_party/nlohmann'
2025-03-14T03:52:18.6142922Z Entering 'third_party/onnx'
2025-03-14T03:52:18.6210102Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T03:52:18.6263274Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T03:52:18.6315234Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T03:52:18.6365635Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T03:52:18.6416078Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T03:52:18.6464726Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T03:52:18.6515242Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T03:52:18.6564336Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T03:52:18.6613299Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T03:52:18.6660892Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T03:52:18.6713473Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T03:52:18.6765267Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T03:52:18.6836145Z Entering 'third_party/pocketfft'
2025-03-14T03:52:18.6888374Z Entering 'third_party/protobuf'
2025-03-14T03:52:18.6942107Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T03:52:18.6992863Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T03:52:18.7043641Z Entering 'third_party/psimd'
2025-03-14T03:52:18.7093575Z Entering 'third_party/pthreadpool'
2025-03-14T03:52:18.7143238Z Entering 'third_party/pybind11'
2025-03-14T03:52:18.7193092Z Entering 'third_party/python-peachpy'
2025-03-14T03:52:18.7242997Z Entering 'third_party/sleef'
2025-03-14T03:52:18.7292991Z Entering 'third_party/tensorpipe'
2025-03-14T03:52:18.7343375Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T03:52:18.7392246Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T03:52:18.7440806Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T03:52:18.7491113Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T03:52:18.7538699Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T03:52:18.7606550Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-03-14T03:52:18.7633066Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-03-14T03:52:18.7904908Z Entering 'android/libs/fbjni'
2025-03-14T03:52:18.7956186Z Entering 'third_party/FP16'
2025-03-14T03:52:18.8006412Z Entering 'third_party/FXdiv'
2025-03-14T03:52:18.8056992Z Entering 'third_party/NNPACK'
2025-03-14T03:52:18.8108515Z Entering 'third_party/NVTX'
2025-03-14T03:52:18.8159935Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T03:52:18.8210883Z Entering 'third_party/XNNPACK'
2025-03-14T03:52:18.8277681Z Entering 'third_party/benchmark'
2025-03-14T03:52:18.8330774Z Entering 'third_party/composable_kernel'
2025-03-14T03:52:18.8389813Z Entering 'third_party/cpp-httplib'
2025-03-14T03:52:18.8440709Z Entering 'third_party/cpuinfo'
2025-03-14T03:52:18.8491602Z Entering 'third_party/cudnn_frontend'
2025-03-14T03:52:18.8541898Z Entering 'third_party/cutlass'
2025-03-14T03:52:18.8600790Z Entering 'third_party/eigen'
2025-03-14T03:52:18.8654495Z Entering 'third_party/fbgemm'
2025-03-14T03:52:18.8705582Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T03:52:18.8754829Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T03:52:18.8806017Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T03:52:18.8862874Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T03:52:18.8911956Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T03:52:18.8962759Z Entering 'third_party/flash-attention'
2025-03-14T03:52:18.9014582Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T03:52:18.9071086Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T03:52:18.9132099Z Entering 'third_party/flatbuffers'
2025-03-14T03:52:18.9186953Z Entering 'third_party/fmt'
2025-03-14T03:52:18.9237436Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T03:52:18.9288222Z Entering 'third_party/gloo'
2025-03-14T03:52:18.9340095Z Entering 'third_party/googletest'
2025-03-14T03:52:18.9393539Z Entering 'third_party/ideep'
2025-03-14T03:52:18.9442614Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T03:52:18.9500814Z Entering 'third_party/ittapi'
2025-03-14T03:52:18.9550914Z Entering 'third_party/kineto'
2025-03-14T03:52:18.9600712Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T03:52:18.9649221Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T03:52:18.9700406Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T03:52:18.9750490Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T03:52:18.9801281Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T03:52:18.9849759Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T03:52:18.9901869Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T03:52:18.9951060Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T03:52:19.0001535Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T03:52:19.0053000Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T03:52:19.0105322Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T03:52:19.0155289Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T03:52:19.0206139Z Entering 'third_party/kleidiai'
2025-03-14T03:52:19.0258228Z Entering 'third_party/mimalloc'
2025-03-14T03:52:19.0309554Z Entering 'third_party/nlohmann'
2025-03-14T03:52:19.0361024Z Entering 'third_party/onnx'
2025-03-14T03:52:19.0427118Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T03:52:19.0479292Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T03:52:19.0530421Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T03:52:19.0579251Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T03:52:19.0628445Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T03:52:19.0677054Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T03:52:19.0728986Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T03:52:19.0777310Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T03:52:19.0826167Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T03:52:19.0874843Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T03:52:19.0926860Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T03:52:19.0978500Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T03:52:19.1048485Z Entering 'third_party/pocketfft'
2025-03-14T03:52:19.1101420Z Entering 'third_party/protobuf'
2025-03-14T03:52:19.1155151Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T03:52:19.1205051Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T03:52:19.1255878Z Entering 'third_party/psimd'
2025-03-14T03:52:19.1306308Z Entering 'third_party/pthreadpool'
2025-03-14T03:52:19.1357801Z Entering 'third_party/pybind11'
2025-03-14T03:52:19.1408666Z Entering 'third_party/python-peachpy'
2025-03-14T03:52:19.1458734Z Entering 'third_party/sleef'
2025-03-14T03:52:19.1509238Z Entering 'third_party/tensorpipe'
2025-03-14T03:52:19.1558720Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T03:52:19.1609723Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T03:52:19.1658787Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T03:52:19.1710101Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T03:52:19.1757636Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T03:52:19.1832043Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2025-03-14T03:52:19.1877008Z ##[endgroup]
2025-03-14T03:52:19.1877795Z ##[group]Fetching the repository
2025-03-14T03:52:19.1887334Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/*
2025-03-14T03:52:19.4577188Z From https://github.com/pytorch/pytorch
2025-03-14T03:52:19.4577760Z  - [deleted]                 (none)                  -> ciflow/inductor/149174
2025-03-14T03:52:19.5011727Z  - [deleted]                 (none)                  -> ciflow/mps/149174
2025-03-14T03:52:19.5012602Z  - [deleted]                 (none)                  -> ciflow/trunk/149166
2025-03-14T03:52:21.1833835Z    8636b394e08..9db33f3cda6  gh/malfet/227/base      -> origin/gh/malfet/227/base
2025-03-14T03:52:21.1838079Z    259919aeab3..4b1f10d8c28  gh/malfet/227/head      -> origin/gh/malfet/227/head
2025-03-14T03:52:21.1843478Z  + 4c129ff8a05...13ad80715a8 gh/malfet/227/orig      -> origin/gh/malfet/227/orig  (forced update)
2025-03-14T03:52:21.1863775Z    c179971bfcd..aed0b7a742a  main                    -> origin/main
2025-03-14T03:52:21.1874613Z  + 277cb23fd22...c4b8be3d09f update_submodule_FBGEMM -> origin/update_submodule_FBGEMM  (forced update)
2025-03-14T03:52:21.1880059Z    4098a229a04..49570cb4024  viable/strict           -> origin/viable/strict
2025-03-14T03:52:21.1885853Z    1579a02c823..3ffd7552df1  wdvr/iss145259_alt      -> origin/wdvr/iss145259_alt
2025-03-14T03:52:21.1893460Z  * [new tag]                 ciflow/inductor/149176  -> ciflow/inductor/149176
2025-03-14T03:52:21.1895101Z  t [tag update]              ciflow/mps/149123       -> ciflow/mps/149123
2025-03-14T03:52:21.1899282Z  * [new tag]                 ciflow/trunk/146289     -> ciflow/trunk/146289
2025-03-14T03:52:21.2424142Z [command]/usr/bin/git rev-parse --verify --quiet aed0b7a742a2d7b7901790622829cbd2135049a4^{object}
2025-03-14T03:52:21.2446436Z aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T03:52:21.2450654Z ##[endgroup]
2025-03-14T03:52:21.2451209Z ##[group]Determining the checkout info
2025-03-14T03:52:21.2451791Z ##[endgroup]
2025-03-14T03:52:21.2455925Z [command]/usr/bin/git sparse-checkout disable
2025-03-14T03:52:21.3910886Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig
2025-03-14T03:52:21.3937528Z ##[group]Checking out the ref
2025-03-14T03:52:21.3941500Z [command]/usr/bin/git checkout --progress --force aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T03:52:21.5243325Z Previous HEAD position was bd72c961cb2 Remove temp changes
2025-03-14T03:52:21.5252826Z HEAD is now at aed0b7a742a [c10d] Add param recording for uniqueID broadcasting and allgather (#149166)
2025-03-14T03:52:21.5280254Z ##[endgroup]
2025-03-14T03:52:21.5316136Z [command]/usr/bin/git log -1 --format=%H
2025-03-14T03:52:21.5337874Z aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T03:52:21.5524595Z Prepare all required actions
2025-03-14T03:52:21.5525126Z Getting action download info
2025-03-14T03:52:21.6565593Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e)
2025-03-14T03:52:21.8169510Z ##[group]Run ./.github/actions/setup-linux
2025-03-14T03:52:21.8169871Z ##[endgroup]
2025-03-14T03:52:21.8255176Z ##[group]Run set -euo pipefail
2025-03-14T03:52:21.8255568Z set -euo pipefail
2025-03-14T03:52:21.8255882Z function get_ec2_metadata() {
2025-03-14T03:52:21.8256273Z   # Pulled from instance metadata endpoint for EC2
2025-03-14T03:52:21.8256943Z   # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html
2025-03-14T03:52:21.8257542Z   category=$1
2025-03-14T03:52:21.8257923Z   # If it is GCP runner (runner name contains gcp), do not run this
2025-03-14T03:52:21.8258408Z   runner_name_str=i-0fff31ea0babea20d
2025-03-14T03:52:21.8258809Z   if [[ -f /.inarc ]]; then
2025-03-14T03:52:21.8259177Z     echo "ARC Runner, no info on ec2 metadata"
2025-03-14T03:52:21.8259590Z   elif [[ $runner_name_str == *"gcp"* ]]; then
2025-03-14T03:52:21.8260074Z     echo "Runner is from Google Cloud Platform, No info on ec2 metadata"
2025-03-14T03:52:21.8260528Z   else
2025-03-14T03:52:21.8261420Z     curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}"
2025-03-14T03:52:21.8262503Z   fi
2025-03-14T03:52:21.8262738Z }
2025-03-14T03:52:21.8263017Z echo "ami-id: $(get_ec2_metadata ami-id)"
2025-03-14T03:52:21.8263457Z echo "instance-id: $(get_ec2_metadata instance-id)"
2025-03-14T03:52:21.8263965Z echo "instance-type: $(get_ec2_metadata instance-type)"
2025-03-14T03:52:21.8264418Z echo "system info $(uname -a)"
2025-03-14T03:52:21.8270435Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:21.8270841Z ##[endgroup]
2025-03-14T03:52:21.8401485Z ami-id: ami-05b10e08d247fb927
2025-03-14T03:52:21.8500194Z instance-id: i-0fff31ea0babea20d
2025-03-14T03:52:21.8596027Z instance-type: c5.2xlarge
2025-03-14T03:52:21.8606001Z system info Linux ip-10-0-67-24.ec2.internal 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
2025-03-14T03:52:21.8637548Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T03:52:21.8638546Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T03:52:21.8645032Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:21.8645432Z ##[endgroup]
2025-03-14T03:52:21.8705090Z ##[group]Run if systemctl is-active --quiet docker; then
2025-03-14T03:52:21.8705572Z if systemctl is-active --quiet docker; then
2025-03-14T03:52:21.8705971Z     echo "Docker daemon is running...";
2025-03-14T03:52:21.8706321Z else
2025-03-14T03:52:21.8706693Z     echo "Starting docker deamon..." && sudo systemctl start docker;
2025-03-14T03:52:21.8707142Z fi
2025-03-14T03:52:21.8712582Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:21.8712988Z ##[endgroup]
2025-03-14T03:52:21.8780933Z Docker daemon is running...
2025-03-14T03:52:21.8829763Z ##[group]Run nick-fields/retry@v3.0.0
2025-03-14T03:52:21.8830097Z with:
2025-03-14T03:52:21.8830320Z   shell: bash
2025-03-14T03:52:21.8830566Z   timeout_minutes: 5
2025-03-14T03:52:21.8830826Z   max_attempts: 3
2025-03-14T03:52:21.8831068Z   retry_wait_seconds: 30
2025-03-14T03:52:21.8833653Z   command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\")
aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
    --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"

# For LF Runners we need to make sure we also login to Meta's ECR docker registry too.
META_AWS_ACCOUNT_ID=308535385114
if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then
    aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
        --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"
fi

2025-03-14T03:52:21.8836081Z   polling_interval_seconds: 1
2025-03-14T03:52:21.8836374Z   warning_on_retry: true
2025-03-14T03:52:21.8836658Z   continue_on_error: false
2025-03-14T03:52:21.8836932Z env:
2025-03-14T03:52:21.8837164Z   AWS_RETRY_MODE: standard
2025-03-14T03:52:21.8837444Z   AWS_MAX_ATTEMPTS: 5
2025-03-14T03:52:21.8837707Z   AWS_DEFAULT_REGION: us-east-1
2025-03-14T03:52:21.8838014Z ##[endgroup]
2025-03-14T03:52:23.0160291Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T03:52:23.0161347Z Configure a credential helper to remove this warning. See
2025-03-14T03:52:23.0162190Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T03:52:23.0162602Z 
2025-03-14T03:52:23.0162726Z Login Succeeded
2025-03-14T03:52:23.5463515Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T03:52:23.5464646Z Configure a credential helper to remove this warning. See
2025-03-14T03:52:23.5465694Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T03:52:23.5466454Z 
2025-03-14T03:52:23.5466653Z Login Succeeded
2025-03-14T03:52:23.9642934Z Command completed after 1 attempt(s).
2025-03-14T03:52:23.9703049Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T03:52:23.9703641Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T03:52:23.9704131Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T03:52:23.9710491Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:23.9710909Z ##[endgroup]
2025-03-14T03:52:23.9793786Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T03:52:23.9794391Z # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T03:52:23.9794830Z # shellcheck disable=SC2046
2025-03-14T03:52:23.9795189Z docker stop $(docker ps -q) || true
2025-03-14T03:52:23.9795559Z # Prune all of the docker images
2025-03-14T03:52:23.9795908Z docker system prune -af
2025-03-14T03:52:23.9801326Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:23.9801735Z ##[endgroup]
2025-03-14T03:52:24.0022720Z "docker stop" requires at least 1 argument.
2025-03-14T03:52:24.0023443Z See 'docker stop --help'.
2025-03-14T03:52:24.0024230Z 
2025-03-14T03:52:24.0024563Z Usage:  docker stop [OPTIONS] CONTAINER [CONTAINER...]
2025-03-14T03:52:24.0025049Z 
2025-03-14T03:52:24.0025229Z Stop one or more running containers
2025-03-14T03:52:24.0167716Z Total reclaimed space: 0B
2025-03-14T03:52:24.0206476Z ##[group]Run set +e
2025-03-14T03:52:24.0206782Z set +e
2025-03-14T03:52:24.0207033Z set -x
2025-03-14T03:52:24.0207258Z 
2025-03-14T03:52:24.0207517Z PT_DOMAIN=download.pytorch.org
2025-03-14T03:52:24.0208137Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400,
2025-03-14T03:52:24.0208946Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last
2025-03-14T03:52:24.0209508Z # one is returned at random
2025-03-14T03:52:24.0209925Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1)
2025-03-14T03:52:24.0210314Z 
2025-03-14T03:52:24.0210580Z if [ -z "${RESOLVED_IP}" ]; then
2025-03-14T03:52:24.0211206Z   echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..."
2025-03-14T03:52:24.0211768Z   RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1)
2025-03-14T03:52:24.0212193Z 
2025-03-14T03:52:24.0212447Z   if [ -z "${RESOLVED_IP}" ]; then
2025-03-14T03:52:24.0212844Z     echo "Couldn't resolve ${PT_DOMAIN}, exiting..."
2025-03-14T03:52:24.0213232Z     exit 1
2025-03-14T03:52:24.0213482Z   fi
2025-03-14T03:52:24.0213711Z fi
2025-03-14T03:52:24.0213933Z 
2025-03-14T03:52:24.0214195Z if grep -r "${PT_DOMAIN}" /etc/hosts; then
2025-03-14T03:52:24.0214582Z   # Clean up any old records first
2025-03-14T03:52:24.0214965Z   sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts
2025-03-14T03:52:24.0215328Z fi
2025-03-14T03:52:24.0215557Z 
2025-03-14T03:52:24.0215873Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts
2025-03-14T03:52:24.0216305Z cat /etc/hosts
2025-03-14T03:52:24.0222088Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:24.0222499Z ##[endgroup]
2025-03-14T03:52:24.0244513Z + PT_DOMAIN=download.pytorch.org
2025-03-14T03:52:24.0250058Z ++ dig -4 +short download.pytorch.org
2025-03-14T03:52:24.0250652Z ++ tail -n1
2025-03-14T03:52:24.0961691Z + RESOLVED_IP=18.160.10.22
2025-03-14T03:52:24.0962247Z + '[' -z 18.160.10.22 ']'
2025-03-14T03:52:24.0962564Z + grep -r download.pytorch.org /etc/hosts
2025-03-14T03:52:24.0973358Z 18.160.10.22 download.pytorch.org
2025-03-14T03:52:24.0974600Z + sudo sed -i /download.pytorch.org/d /etc/hosts
2025-03-14T03:52:24.1754635Z + echo '18.160.10.22 download.pytorch.org'
2025-03-14T03:52:24.1755356Z + sudo tee -a /etc/hosts
2025-03-14T03:52:24.3626385Z 18.160.10.22 download.pytorch.org
2025-03-14T03:52:24.3641671Z + cat /etc/hosts
2025-03-14T03:52:24.3649710Z 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
2025-03-14T03:52:24.3655857Z ::1         localhost6 localhost6.localdomain6
2025-03-14T03:52:24.3656273Z 18.160.10.22 download.pytorch.org
2025-03-14T03:52:24.3697389Z Prepare all required actions
2025-03-14T03:52:24.3732958Z ##[group]Run ./.github/actions/get-workflow-job-id
2025-03-14T03:52:24.3733315Z with:
2025-03-14T03:52:24.3733744Z   github-token: ***
2025-03-14T03:52:24.3734002Z ##[endgroup]
2025-03-14T03:52:24.3758647Z ##[group]Run set -eux
2025-03-14T03:52:24.3758954Z set -eux
2025-03-14T03:52:24.3759414Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2025-03-14T03:52:24.3765496Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:24.3765906Z env:
2025-03-14T03:52:24.3766305Z   GITHUB_TOKEN: ***
2025-03-14T03:52:24.3766563Z ##[endgroup]
2025-03-14T03:52:24.3789051Z + python3 .github/scripts/get_workflow_job_id.py 13849515261 i-0fff31ea0babea20d
2025-03-14T03:52:24.5806030Z setting job-id=38754270206
2025-03-14T03:52:24.5806409Z setting job-name=before-test / target-determination
2025-03-14T03:52:24.5948919Z Prepare all required actions
2025-03-14T03:52:24.5949324Z Getting action download info
2025-03-14T03:52:24.7237762Z ##[group]Run ./.github/actions/pytest-cache-download
2025-03-14T03:52:24.7238155Z with:
2025-03-14T03:52:24.7238400Z   cache_dir: .pytest_cache
2025-03-14T03:52:24.7238703Z   job_identifier: rocm-mi300
2025-03-14T03:52:24.7238992Z   s3_bucket: gha-artifacts
2025-03-14T03:52:24.7239277Z ##[endgroup]
2025-03-14T03:52:24.7283085Z ##[group]Run nick-fields/retry@v3.0.0
2025-03-14T03:52:24.7283407Z with:
2025-03-14T03:52:24.7283629Z   shell: bash
2025-03-14T03:52:24.7283871Z   timeout_minutes: 5
2025-03-14T03:52:24.7284133Z   max_attempts: 5
2025-03-14T03:52:24.7284376Z   retry_wait_seconds: 30
2025-03-14T03:52:24.7284733Z   command: set -eu
python3 -m pip install boto3==1.35.42

2025-03-14T03:52:24.7285142Z   polling_interval_seconds: 1
2025-03-14T03:52:24.7285455Z   warning_on_retry: true
2025-03-14T03:52:24.7285733Z   continue_on_error: false
2025-03-14T03:52:24.7286049Z ##[endgroup]
2025-03-14T03:52:25.0552295Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T03:52:25.0714409Z Requirement already satisfied: boto3==1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.42)
2025-03-14T03:52:25.0765250Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0)
2025-03-14T03:52:25.0769482Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.99)
2025-03-14T03:52:25.0775099Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4)
2025-03-14T03:52:25.0831397Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10)
2025-03-14T03:52:25.0835774Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (2.8.2)
2025-03-14T03:52:25.0875583Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.15.0)
2025-03-14T03:52:25.8045923Z Command completed after 1 attempt(s).
2025-03-14T03:52:25.8108349Z ##[group]Run python3 .github/scripts/pytest_cache.py \
2025-03-14T03:52:25.8108833Z python3 .github/scripts/pytest_cache.py \
2025-03-14T03:52:25.8109218Z   --download \
2025-03-14T03:52:25.8109537Z   --cache_dir $GITHUB_WORKSPACE/$CACHE_DIR \
2025-03-14T03:52:25.8109938Z   --pr_identifier $GITHUB_REF \
2025-03-14T03:52:25.8110334Z   --job_identifier $JOB_IDENTIFIER \
2025-03-14T03:52:25.8110697Z   --temp_dir $RUNNER_TEMP \
2025-03-14T03:52:25.8111046Z   --repo $REPO \
2025-03-14T03:52:25.8111325Z   --bucket $BUCKET \
2025-03-14T03:52:25.8117174Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:25.8117580Z env:
2025-03-14T03:52:25.8117812Z   CACHE_DIR: .pytest_cache
2025-03-14T03:52:25.8118108Z   JOB_IDENTIFIER: rocm-mi300
2025-03-14T03:52:25.8118398Z   REPO: pytorch/pytorch
2025-03-14T03:52:25.8118676Z   BUCKET: gha-artifacts
2025-03-14T03:52:25.8118941Z ##[endgroup]
2025-03-14T03:52:26.1352430Z PR identifier for `refs/heads/main` is `96e092540d6b3c4076e3d2bc6f1f9013`
2025-03-14T03:52:26.1354206Z Downloading cache with args Namespace(upload=False, download=True, cache_dir='/home/ec2-user/actions-runner/_work/pytorch/pytorch/.pytest_cache', pr_identifier='refs/heads/main', job_identifier='rocm-mi300', sha=None, test_config=None, shard=None, repo='pytorch/pytorch', temp_dir='/home/ec2-user/actions-runner/_work/_temp', bucket='gha-artifacts')
2025-03-14T03:52:26.1356271Z There were no files matching the prefix `pytest_cache/pytorch/pytorch/96e092540d6b3c4076e3d2bc6f1f9013/rocm-mi300` in bucket `gha-artifacts`
2025-03-14T03:52:26.1994404Z ##[group]Run seemethere/download-artifact-s3@v4
2025-03-14T03:52:26.1994798Z with:
2025-03-14T03:52:26.1995030Z   name: llm_results
2025-03-14T03:52:26.1995293Z   path: .additional_ci_files/llm_results
2025-03-14T03:52:26.1995637Z   s3-bucket: gha-artifacts
2025-03-14T03:52:26.1995924Z   region: us-east-1
2025-03-14T03:52:26.1996170Z ##[endgroup]
2025-03-14T03:52:26.7030035Z (node:189349) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2025-03-14T03:52:26.7030552Z 
2025-03-14T03:52:26.7030766Z Please migrate your code to use AWS SDK for JavaScript (v3).
2025-03-14T03:52:26.7031331Z For more information, check the migration guide at https://a.co/7PzMCcy
2025-03-14T03:52:26.7031920Z (Use `node --trace-warnings ...` to show where the warning was created)
2025-03-14T03:52:26.7976867Z Found 0 objects with prefix pytorch/pytorch/13849515261/llm_results/
2025-03-14T03:52:26.7989185Z Artifact download has finished successfully
2025-03-14T03:52:26.8263270Z ##[group]Run unzip -o .additional_ci_files/llm_results/mappings.zip -d .additional_ci_files/llm_results || true
2025-03-14T03:52:26.8264228Z unzip -o .additional_ci_files/llm_results/mappings.zip -d .additional_ci_files/llm_results || true
2025-03-14T03:52:26.8264862Z python3 -m pip install boto3==1.35.42
2025-03-14T03:52:26.8265325Z python3 tools/testing/do_target_determination_for_s3.py
2025-03-14T03:52:26.8272232Z shell: /usr/bin/bash -e {0}
2025-03-14T03:52:26.8272536Z env:
2025-03-14T03:52:26.8272966Z   GITHUB_TOKEN: ***
2025-03-14T03:52:26.8273247Z   GITHUB_REPOSITORY: pytorch/pytorch
2025-03-14T03:52:26.8273570Z   GITHUB_WORKFLOW: rocm-mi300
2025-03-14T03:52:26.8273886Z   GITHUB_JOB: target-determination
2025-03-14T03:52:26.8274202Z   GITHUB_RUN_ID: 13849515261
2025-03-14T03:52:26.8274489Z   GITHUB_RUN_NUMBER: 1918
2025-03-14T03:52:26.8274782Z   GITHUB_RUN_ATTEMPT: 1
2025-03-14T03:52:26.8275048Z   GITHUB_REF: refs/heads/main
2025-03-14T03:52:26.8275379Z   JOB_ID: 38754270206
2025-03-14T03:52:26.8275677Z   JOB_NAME: before-test / target-determination
2025-03-14T03:52:26.8276015Z   PR_NUMBER: 
2025-03-14T03:52:26.8276249Z ##[endgroup]
2025-03-14T03:52:26.8331805Z unzip:  cannot find or open .additional_ci_files/llm_results/mappings.zip, .additional_ci_files/llm_results/mappings.zip.zip or .additional_ci_files/llm_results/mappings.zip.ZIP.
2025-03-14T03:52:27.0755514Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T03:52:27.0966960Z Requirement already satisfied: boto3==1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (1.35.42)
2025-03-14T03:52:27.1019005Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0)
2025-03-14T03:52:27.1023576Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4)
2025-03-14T03:52:27.1029436Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.99)
2025-03-14T03:52:27.1080243Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (2.8.2)
2025-03-14T03:52:27.1091056Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10)
2025-03-14T03:52:27.1131150Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.15.0)
2025-03-14T03:52:28.9358130Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/test-times.json
2025-03-14T03:52:28.9361847Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/test-class-times.json
2025-03-14T03:52:28.9364018Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/file_test_rating.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/test-file-ratings.json
2025-03-14T03:52:28.9365930Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/file_test_class_rating.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/test-class-ratings.json
2025-03-14T03:52:28.9368009Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/td_heuristic_historical_edited_files.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/td_heuristic_historical_edited_files.json
2025-03-14T03:52:28.9370425Z Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/td_heuristic_profiling.json to /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/td_heuristic_profiling.json
2025-03-14T03:52:28.9371606Z Received 689 tests to prioritize
2025-03-14T03:52:28.9371927Z   backends/xeon/test_launch
2025-03-14T03:52:28.9372231Z   benchmark_utils/test_benchmark_utils
2025-03-14T03:52:28.9372703Z   cpp_extensions/libtorch_agnostic_extension/test/test_libtorch_agnostic
2025-03-14T03:52:28.9373271Z   cpp_extensions/open_registration_extension/test/test_openreg
2025-03-14T03:52:28.9373765Z   distributed/_composable/fsdp/test_fully_shard_autograd
2025-03-14T03:52:28.9374255Z   distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_
2025-03-14T03:52:28.9374758Z   distributed/_composable/fsdp/test_fully_shard_comm
2025-03-14T03:52:28.9375192Z   distributed/_composable/fsdp/test_fully_shard_compile
2025-03-14T03:52:28.9375667Z   distributed/_composable/fsdp/test_fully_shard_extensions
2025-03-14T03:52:28.9376140Z   distributed/_composable/fsdp/test_fully_shard_frozen
2025-03-14T03:52:28.9376614Z   distributed/_composable/fsdp/test_fully_shard_grad_scaler
2025-03-14T03:52:28.9377118Z   distributed/_composable/fsdp/test_fully_shard_ignore_params
2025-03-14T03:52:28.9377597Z   distributed/_composable/fsdp/test_fully_shard_init
2025-03-14T03:52:28.9378028Z   distributed/_composable/fsdp/test_fully_shard_logging
2025-03-14T03:52:28.9378489Z   distributed/_composable/fsdp/test_fully_shard_memory
2025-03-14T03:52:28.9379156Z   distributed/_composable/fsdp/test_fully_shard_mixed_precision
2025-03-14T03:52:28.9379655Z   distributed/_composable/fsdp/test_fully_shard_overlap
2025-03-14T03:52:28.9380107Z   distributed/_composable/fsdp/test_fully_shard_state
2025-03-14T03:52:28.9380553Z   distributed/_composable/fsdp/test_fully_shard_state_dict
2025-03-14T03:52:28.9381030Z   distributed/_composable/fsdp/test_fully_shard_training
2025-03-14T03:52:28.9381452Z   distributed/_composable/test_checkpoint
2025-03-14T03:52:28.9381916Z   distributed/_composable/test_composability/test_2d_composability
2025-03-14T03:52:28.9382484Z   distributed/_composable/test_composability/test_pp_composability
2025-03-14T03:52:28.9382936Z   distributed/_composable/test_contract
2025-03-14T03:52:28.9383296Z   distributed/_composable/test_replicate
2025-03-14T03:52:28.9383699Z   distributed/_composable/test_replicate_with_compiler
2025-03-14T03:52:28.9384143Z   distributed/_shard/sharded_optim/test_sharded_optim
2025-03-14T03:52:28.9384587Z   distributed/_shard/sharded_tensor/ops/test_binary_cmp
2025-03-14T03:52:28.9385033Z   distributed/_shard/sharded_tensor/ops/test_embedding
2025-03-14T03:52:28.9385475Z   distributed/_shard/sharded_tensor/ops/test_embedding_bag
2025-03-14T03:52:28.9385921Z   distributed/_shard/sharded_tensor/ops/test_init
2025-03-14T03:52:28.9386351Z   distributed/_shard/sharded_tensor/ops/test_tensor_ops
2025-03-14T03:52:28.9386775Z   distributed/_shard/sharded_tensor/test_logger
2025-03-14T03:52:28.9387197Z   distributed/_shard/sharded_tensor/test_sharded_tensor
2025-03-14T03:52:28.9387798Z   distributed/_shard/sharded_tensor/test_sharded_tensor_reshard
2025-03-14T03:52:28.9388279Z   distributed/_shard/sharding_plan/test_sharding_plan
2025-03-14T03:52:28.9388714Z   distributed/_shard/sharding_spec/test_sharding_spec
2025-03-14T03:52:28.9389106Z   distributed/_shard/test_sharder
2025-03-14T03:52:28.9389449Z   distributed/_tools/test_fake_collectives
2025-03-14T03:52:28.9389802Z   distributed/_tools/test_fsdp2_mem_tracker
2025-03-14T03:52:28.9390159Z   distributed/_tools/test_mem_tracker
2025-03-14T03:52:28.9390503Z   distributed/_tools/test_memory_tracker
2025-03-14T03:52:28.9390853Z   distributed/_tools/test_mod_tracker
2025-03-14T03:52:28.9391204Z   distributed/_tools/test_runtime_estimator
2025-03-14T03:52:28.9391549Z   distributed/_tools/test_sac_estimator
2025-03-14T03:52:28.9391888Z   distributed/_tools/test_sac_ilp
2025-03-14T03:52:28.9392266Z   distributed/algorithms/ddp_comm_hooks/test_ddp_hooks
2025-03-14T03:52:28.9392732Z   distributed/algorithms/quantization/test_quantization
2025-03-14T03:52:28.9393244Z   distributed/algorithms/test_join
2025-03-14T03:52:28.9393603Z   distributed/checkpoint/e2e/test_e2e_save_and_load
2025-03-14T03:52:28.9394013Z   distributed/checkpoint/e2e/test_fine_tuning
2025-03-14T03:52:28.9394392Z   distributed/checkpoint/e2e/test_fsdp_ep
2025-03-14T03:52:28.9394761Z   distributed/checkpoint/e2e/test_pipeline
2025-03-14T03:52:28.9395131Z   distributed/checkpoint/fsdp/test_fsdp_dsd
2025-03-14T03:52:28.9395492Z   distributed/checkpoint/test_checkpoint
2025-03-14T03:52:28.9395867Z   distributed/checkpoint/test_compatibility
2025-03-14T03:52:28.9396238Z   distributed/checkpoint/test_dedup_tensors
2025-03-14T03:52:28.9396624Z   distributed/checkpoint/test_dtensor_checkpoint
2025-03-14T03:52:28.9397055Z   distributed/checkpoint/test_dtensor_resharding
2025-03-14T03:52:28.9397569Z   distributed/checkpoint/test_file_system_checkpoint
2025-03-14T03:52:28.9398028Z   distributed/checkpoint/test_file_system_checkpoint_cpu
2025-03-14T03:52:28.9398446Z   distributed/checkpoint/test_format_utils
2025-03-14T03:52:28.9398834Z   distributed/checkpoint/test_fsdp_model_state
2025-03-14T03:52:28.9399234Z   distributed/checkpoint/test_fsdp_optim_state
2025-03-14T03:52:28.9399682Z   distributed/checkpoint/test_fsdp_tp_checkpoint_conversion
2025-03-14T03:52:28.9400120Z   distributed/checkpoint/test_fsspec
2025-03-14T03:52:28.9400452Z   distributed/checkpoint/test_hf_storage
2025-03-14T03:52:28.9400821Z   distributed/checkpoint/test_hsdp_checkpoint
2025-03-14T03:52:28.9401194Z   distributed/checkpoint/test_nested_dict
2025-03-14T03:52:28.9401549Z   distributed/checkpoint/test_planner
2025-03-14T03:52:28.9401903Z   distributed/checkpoint/test_save_load_api
2025-03-14T03:52:28.9402366Z   distributed/checkpoint/test_state_dict
2025-03-14T03:52:28.9402740Z   distributed/checkpoint/test_state_dict_utils
2025-03-14T03:52:28.9403211Z   distributed/checkpoint/test_tp_checkpoint
2025-03-14T03:52:28.9403576Z   distributed/checkpoint/test_traverse
2025-03-14T03:52:28.9403928Z   distributed/checkpoint/test_utils
2025-03-14T03:52:28.9404256Z   distributed/elastic/events/lib_test
2025-03-14T03:52:28.9404602Z   distributed/elastic/metrics/api_test
2025-03-14T03:52:28.9404973Z   distributed/elastic/multiprocessing/api_test
2025-03-14T03:52:28.9405354Z   distributed/elastic/test_control_plane
2025-03-14T03:52:28.9405703Z   distributed/elastic/timer/api_test
2025-03-14T03:52:28.9406055Z   distributed/elastic/timer/local_timer_example
2025-03-14T03:52:28.9406443Z   distributed/elastic/timer/local_timer_test
2025-03-14T03:52:28.9406818Z   distributed/elastic/utils/distributed_test
2025-03-14T03:52:28.9407183Z   distributed/elastic/utils/logging_test
2025-03-14T03:52:28.9407535Z   distributed/elastic/utils/util_test
2025-03-14T03:52:28.9407888Z   distributed/flight_recorder/test_fr_analysis
2025-03-14T03:52:28.9408274Z   distributed/fsdp/test_checkpoint_wrapper
2025-03-14T03:52:28.9408655Z   distributed/fsdp/test_distributed_checkpoint
2025-03-14T03:52:28.9409124Z   distributed/fsdp/test_fsdp_apply
2025-03-14T03:52:28.9409479Z   distributed/fsdp/test_fsdp_backward_prefetch
2025-03-14T03:52:28.9409842Z   distributed/fsdp/test_fsdp_checkpoint
2025-03-14T03:52:28.9410204Z   distributed/fsdp/test_fsdp_clip_grad_norm
2025-03-14T03:52:28.9410558Z   distributed/fsdp/test_fsdp_comm
2025-03-14T03:52:28.9410893Z   distributed/fsdp/test_fsdp_comm_hooks
2025-03-14T03:52:28.9411239Z   distributed/fsdp/test_fsdp_core
2025-03-14T03:52:28.9411576Z   distributed/fsdp/test_fsdp_dtensor_state_dict
2025-03-14T03:52:28.9411954Z   distributed/fsdp/test_fsdp_exec_order
2025-03-14T03:52:28.9412302Z   distributed/fsdp/test_fsdp_fine_tune
2025-03-14T03:52:28.9412665Z   distributed/fsdp/test_fsdp_flatten_params
2025-03-14T03:52:28.9413045Z   distributed/fsdp/test_fsdp_freezing_weights
2025-03-14T03:52:28.9413415Z   distributed/fsdp/test_fsdp_fx
2025-03-14T03:52:28.9413724Z   distributed/fsdp/test_fsdp_grad_acc
2025-03-14T03:52:28.9414078Z   distributed/fsdp/test_fsdp_hybrid_shard
2025-03-14T03:52:28.9414455Z   distributed/fsdp/test_fsdp_ignored_modules
2025-03-14T03:52:28.9414885Z   distributed/fsdp/test_fsdp_input
2025-03-14T03:52:28.9415219Z   distributed/fsdp/test_fsdp_memory
2025-03-14T03:52:28.9415542Z   distributed/fsdp/test_fsdp_meta
2025-03-14T03:52:28.9415871Z   distributed/fsdp/test_fsdp_misc
2025-03-14T03:52:28.9416217Z   distributed/fsdp/test_fsdp_mixed_precision
2025-03-14T03:52:28.9416602Z   distributed/fsdp/test_fsdp_multiple_forward
2025-03-14T03:52:28.9416990Z   distributed/fsdp/test_fsdp_multiple_wrapping
2025-03-14T03:52:28.9417357Z   distributed/fsdp/test_fsdp_optim_state
2025-03-14T03:52:28.9417708Z   distributed/fsdp/test_fsdp_overlap
2025-03-14T03:52:28.9418051Z   distributed/fsdp/test_fsdp_pure_fp16
2025-03-14T03:52:28.9418427Z   distributed/fsdp/test_fsdp_sharded_grad_scaler
2025-03-14T03:52:28.9418808Z   distributed/fsdp/test_fsdp_state_dict
2025-03-14T03:52:28.9419150Z   distributed/fsdp/test_fsdp_tp_integration
2025-03-14T03:52:28.9419511Z   distributed/fsdp/test_fsdp_traversal
2025-03-14T03:52:28.9419857Z   distributed/fsdp/test_fsdp_uneven
2025-03-14T03:52:28.9420207Z   distributed/fsdp/test_fsdp_unshard_params
2025-03-14T03:52:28.9420579Z   distributed/fsdp/test_fsdp_use_orig_params
2025-03-14T03:52:28.9420951Z   distributed/fsdp/test_hsdp_dtensor_state_dict
2025-03-14T03:52:28.9421321Z   distributed/fsdp/test_shard_utils
2025-03-14T03:52:28.9421653Z   distributed/fsdp/test_utils
2025-03-14T03:52:28.9421963Z   distributed/fsdp/test_wrap
2025-03-14T03:52:28.9422270Z   distributed/launcher/test_run
2025-03-14T03:52:28.9422580Z   distributed/nn/jit/test_instantiator
2025-03-14T03:52:28.9422966Z   distributed/optim/test_apply_optimizer_in_backward
2025-03-14T03:52:28.9423371Z   distributed/optim/test_named_optimizer
2025-03-14T03:52:28.9423760Z   distributed/optim/test_zero_redundancy_optimizer
2025-03-14T03:52:28.9424155Z   distributed/pipelining/test_backward
2025-03-14T03:52:28.9424499Z   distributed/pipelining/test_microbatch
2025-03-14T03:52:28.9424858Z   distributed/pipelining/test_pipe
2025-03-14T03:52:28.9425200Z   distributed/pipelining/test_schedule
2025-03-14T03:52:28.9425572Z   distributed/pipelining/test_schedule_multiproc
2025-03-14T03:52:28.9425955Z   distributed/pipelining/test_stage
2025-03-14T03:52:28.9426284Z   distributed/pipelining/test_transformer
2025-03-14T03:52:28.9426647Z   distributed/pipelining/test_unflatten
2025-03-14T03:52:28.9427009Z   distributed/rpc/cuda/test_tensorpipe_agent
2025-03-14T03:52:28.9427372Z   distributed/rpc/test_faulty_agent
2025-03-14T03:52:28.9427705Z   distributed/rpc/test_share_memory
2025-03-14T03:52:28.9428031Z   distributed/rpc/test_tensorpipe_agent
2025-03-14T03:52:28.9428383Z   distributed/tensor/debug/test_comm_mode
2025-03-14T03:52:28.9428770Z   distributed/tensor/debug/test_comm_mode_features
2025-03-14T03:52:28.9429171Z   distributed/tensor/debug/test_op_coverage
2025-03-14T03:52:28.9429558Z   distributed/tensor/experimental/test_local_map
2025-03-14T03:52:28.9429987Z   distributed/tensor/experimental/test_register_sharding
2025-03-14T03:52:28.9430560Z   distributed/tensor/experimental/test_tp_transform
2025-03-14T03:52:28.9431008Z   distributed/tensor/parallel/test_micro_pipeline_tp
2025-03-14T03:52:28.9431448Z   distributed/tensor/parallel/test_parallelize_api
2025-03-14T03:52:28.9431867Z   distributed/tensor/parallel/test_tp_examples
2025-03-14T03:52:28.9432263Z   distributed/tensor/parallel/test_tp_random_state
2025-03-14T03:52:28.9432664Z   distributed/tensor/parallel/test_tp_style
2025-03-14T03:52:28.9433017Z   distributed/tensor/test_api
2025-03-14T03:52:28.9433328Z   distributed/tensor/test_attention
2025-03-14T03:52:28.9433665Z   distributed/tensor/test_common_rules
2025-03-14T03:52:28.9434001Z   distributed/tensor/test_convolution_ops
2025-03-14T03:52:28.9434348Z   distributed/tensor/test_dtensor
2025-03-14T03:52:28.9434681Z   distributed/tensor/test_dtensor_compile
2025-03-14T03:52:28.9435036Z   distributed/tensor/test_dtensor_ops
2025-03-14T03:52:28.9435382Z   distributed/tensor/test_embedding_ops
2025-03-14T03:52:28.9435733Z   distributed/tensor/test_experimental_ops
2025-03-14T03:52:28.9436146Z   distributed/tensor/test_init
2025-03-14T03:52:28.9436460Z   distributed/tensor/test_math_ops
2025-03-14T03:52:28.9436788Z   distributed/tensor/test_matrix_ops
2025-03-14T03:52:28.9437123Z   distributed/tensor/test_op_strategy
2025-03-14T03:52:28.9437450Z   distributed/tensor/test_optimizers
2025-03-14T03:52:28.9437794Z   distributed/tensor/test_pointwise_ops
2025-03-14T03:52:28.9438139Z   distributed/tensor/test_random_ops
2025-03-14T03:52:28.9438480Z   distributed/tensor/test_redistribute
2025-03-14T03:52:28.9438823Z   distributed/tensor/test_tensor_ops
2025-03-14T03:52:28.9439140Z   distributed/tensor/test_utils
2025-03-14T03:52:28.9439455Z   distributed/tensor/test_view_ops
2025-03-14T03:52:28.9439792Z   distributed/tensor/test_xla_integration
2025-03-14T03:52:28.9440137Z   distributed/test_backends
2025-03-14T03:52:28.9440437Z   distributed/test_c10d_common
2025-03-14T03:52:28.9440747Z   distributed/test_c10d_functional_native
2025-03-14T03:52:28.9441102Z   distributed/test_c10d_gloo
2025-03-14T03:52:28.9441413Z   distributed/test_c10d_logger
2025-03-14T03:52:28.9441718Z   distributed/test_c10d_nccl
2025-03-14T03:52:28.9442133Z   distributed/test_c10d_object_collectives
2025-03-14T03:52:28.9442475Z   distributed/test_c10d_ops_nccl
2025-03-14T03:52:28.9442785Z   distributed/test_c10d_pypg
2025-03-14T03:52:28.9443092Z   distributed/test_c10d_spawn_gloo
2025-03-14T03:52:28.9443418Z   distributed/test_c10d_spawn_nccl
2025-03-14T03:52:28.9443756Z   distributed/test_c10d_spawn_ucc
2025-03-14T03:52:28.9444086Z   distributed/test_c10d_ucc
2025-03-14T03:52:28.9444394Z   distributed/test_collective_utils
2025-03-14T03:52:28.9444732Z   distributed/test_composability
2025-03-14T03:52:28.9445057Z   distributed/test_compute_comm_reordering
2025-03-14T03:52:28.9445421Z   distributed/test_control_collectives
2025-03-14T03:52:28.9445765Z   distributed/test_data_parallel
2025-03-14T03:52:28.9446085Z   distributed/test_device_mesh
2025-03-14T03:52:28.9446395Z   distributed/test_distributed_spawn
2025-03-14T03:52:28.9446742Z   distributed/test_dynamo_distributed
2025-03-14T03:52:28.9447083Z   distributed/test_fake_pg
2025-03-14T03:52:28.9447389Z   distributed/test_functional_api
2025-03-14T03:52:28.9447728Z   distributed/test_inductor_collectives
2025-03-14T03:52:28.9448056Z   distributed/test_launcher
2025-03-14T03:52:28.9448364Z   distributed/test_multi_threaded_pg
2025-03-14T03:52:28.9448693Z   distributed/test_nccl
2025-03-14T03:52:28.9448980Z   distributed/test_pg_wrapper
2025-03-14T03:52:28.9449290Z   distributed/test_serialization
2025-03-14T03:52:28.9449589Z   distributed/test_store
2025-03-14T03:52:28.9449881Z   distributed/test_symmetric_memory
2025-03-14T03:52:28.9450219Z   distributions/test_constraints
2025-03-14T03:52:28.9450543Z   distributions/test_distributions
2025-03-14T03:52:28.9450846Z   doctests
2025-03-14T03:52:28.9451085Z   dynamo/test_activation_checkpointing
2025-03-14T03:52:28.9451410Z   dynamo/test_after_aot
2025-03-14T03:52:28.9451877Z   dynamo/test_aot_autograd
2025-03-14T03:52:28.9452176Z   dynamo/test_aot_autograd_cache
2025-03-14T03:52:28.9452490Z   dynamo/test_autograd_function
2025-03-14T03:52:28.9452770Z   dynamo/test_backends
2025-03-14T03:52:28.9453056Z   dynamo/test_backward_higher_order_ops
2025-03-14T03:52:28.9453390Z   dynamo/test_base_hop
2025-03-14T03:52:28.9453662Z   dynamo/test_base_output
2025-03-14T03:52:28.9453951Z   dynamo/test_bytecode_utils
2025-03-14T03:52:28.9454225Z   dynamo/test_callback
2025-03-14T03:52:28.9454489Z   dynamo/test_compile
2025-03-14T03:52:28.9454767Z   dynamo/test_compiler_bisector
2025-03-14T03:52:28.9455068Z   dynamo/test_comptime
2025-03-14T03:52:28.9455338Z   dynamo/test_config
2025-03-14T03:52:28.9455590Z   dynamo/test_ctx_manager
2025-03-14T03:52:28.9455871Z   dynamo/test_cudagraphs
2025-03-14T03:52:28.9456180Z   dynamo/test_cudagraphs_expandable_segments
2025-03-14T03:52:28.9456530Z   dynamo/test_debug_utils
2025-03-14T03:52:28.9456797Z   dynamo/test_decorators
2025-03-14T03:52:28.9457084Z   dynamo/test_deque_reconstruct
2025-03-14T03:52:28.9457445Z   dynamo/test_deviceguard
2025-03-14T03:52:28.9457723Z   dynamo/test_dicts
2025-03-14T03:52:28.9457987Z   dynamo/test_dynamic_shapes
2025-03-14T03:52:28.9458275Z   dynamo/test_error_messages
2025-03-14T03:52:28.9458564Z   dynamo/test_exc
2025-03-14T03:52:28.9458823Z   dynamo/test_exceptions
2025-03-14T03:52:28.9459103Z   dynamo/test_export
2025-03-14T03:52:28.9459380Z   dynamo/test_export_mutations
2025-03-14T03:52:28.9459667Z   dynamo/test_flat_apply
2025-03-14T03:52:28.9459942Z   dynamo/test_frame_init
2025-03-14T03:52:28.9460218Z   dynamo/test_functions
2025-03-14T03:52:28.9460498Z   dynamo/test_fx_passes_pre_grad
2025-03-14T03:52:28.9460800Z   dynamo/test_generator
2025-03-14T03:52:28.9461052Z   dynamo/test_global
2025-03-14T03:52:28.9461325Z   dynamo/test_graph_deduplication
2025-03-14T03:52:28.9461649Z   dynamo/test_graph_region_tracker
2025-03-14T03:52:28.9461963Z   dynamo/test_guard_manager
2025-03-14T03:52:28.9462261Z   dynamo/test_higher_order_ops
2025-03-14T03:52:28.9462538Z   dynamo/test_hooks
2025-03-14T03:52:28.9463127Z   dynamo/test_input_attr_tracking
2025-03-14T03:52:28.9463435Z   dynamo/test_interop
2025-03-14T03:52:28.9463699Z   dynamo/test_logging
2025-03-14T03:52:28.9463954Z   dynamo/test_metrics_context
2025-03-14T03:52:28.9464249Z   dynamo/test_minifier
2025-03-14T03:52:28.9464512Z   dynamo/test_misc
2025-03-14T03:52:28.9464770Z   dynamo/test_model_output
2025-03-14T03:52:28.9465045Z   dynamo/test_modes
2025-03-14T03:52:28.9465282Z   dynamo/test_modules
2025-03-14T03:52:28.9465538Z   dynamo/test_nops
2025-03-14T03:52:28.9465797Z   dynamo/test_optimizers
2025-03-14T03:52:28.9466065Z   dynamo/test_pgo
2025-03-14T03:52:28.9466320Z   dynamo/test_pre_dispatch
2025-03-14T03:52:28.9466588Z   dynamo/test_profiler
2025-03-14T03:52:28.9466861Z   dynamo/test_python_autograd
2025-03-14T03:52:28.9467165Z   dynamo/test_python_dispatcher
2025-03-14T03:52:28.9467470Z   dynamo/test_recompile_ux
2025-03-14T03:52:28.9467764Z   dynamo/test_recompiles
2025-03-14T03:52:28.9468034Z   dynamo/test_reconstruct
2025-03-14T03:52:28.9468322Z   dynamo/test_reorder_logs
2025-03-14T03:52:28.9468604Z   dynamo/test_repros
2025-03-14T03:52:28.9468868Z   dynamo/test_resume
2025-03-14T03:52:28.9469111Z   dynamo/test_sdpa
2025-03-14T03:52:28.9469377Z   dynamo/test_skip_guard_eval_unsafe
2025-03-14T03:52:28.9469705Z   dynamo/test_skip_non_tensor
2025-03-14T03:52:28.9469999Z   dynamo/test_sources
2025-03-14T03:52:28.9470272Z   dynamo/test_structured_trace
2025-03-14T03:52:28.9470561Z   dynamo/test_subclasses
2025-03-14T03:52:28.9470838Z   dynamo/test_subgraphs
2025-03-14T03:52:28.9471103Z   dynamo/test_sys
2025-03-14T03:52:28.9471355Z   dynamo/test_torchrec
2025-03-14T03:52:28.9471626Z   dynamo/test_trace_rules
2025-03-14T03:52:28.9471893Z   dynamo/test_unspec
2025-03-14T03:52:28.9472154Z   dynamo/test_utils
2025-03-14T03:52:28.9472421Z   dynamo/test_verify_correctness
2025-03-14T03:52:28.9472724Z   dynamo/test_view
2025-03-14T03:52:28.9473105Z   export/test_converter
2025-03-14T03:52:28.9473372Z   export/test_cpp_serdes
2025-03-14T03:52:28.9473655Z   export/test_db
2025-03-14T03:52:28.9473914Z   export/test_draft_export
2025-03-14T03:52:28.9474209Z   export/test_experimental
2025-03-14T03:52:28.9474484Z   export/test_export
2025-03-14T03:52:28.9474757Z   export/test_export_legacy
2025-03-14T03:52:28.9475057Z   export/test_export_strict
2025-03-14T03:52:28.9475392Z   export/test_export_training_ir_to_run_decomp
2025-03-14T03:52:28.9475774Z   export/test_functionalized_assertions
2025-03-14T03:52:28.9476088Z   export/test_hop
2025-03-14T03:52:28.9476344Z   export/test_lift_unlift
2025-03-14T03:52:28.9476638Z   export/test_pass_infra
2025-03-14T03:52:28.9476924Z   export/test_passes
2025-03-14T03:52:28.9477193Z   export/test_retraceability
2025-03-14T03:52:28.9477469Z   export/test_schema
2025-03-14T03:52:28.9477723Z   export/test_serdes
2025-03-14T03:52:28.9477980Z   export/test_serialize
2025-03-14T03:52:28.9478244Z   export/test_sparse
2025-03-14T03:52:28.9478501Z   export/test_swap
2025-03-14T03:52:28.9478734Z   export/test_tools
2025-03-14T03:52:28.9479296Z   export/test_torchbind
2025-03-14T03:52:28.9479576Z   export/test_tree_utils
2025-03-14T03:52:28.9479858Z   export/test_unflatten
2025-03-14T03:52:28.9480129Z   export/test_unflatten_training_ir
2025-03-14T03:52:28.9480454Z   export/test_verifier
2025-03-14T03:52:28.9480719Z   functorch/test_ac
2025-03-14T03:52:28.9480988Z   functorch/test_ac_knapsack
2025-03-14T03:52:28.9481287Z   functorch/test_ac_logging
2025-03-14T03:52:28.9481568Z   functorch/test_aotdispatch
2025-03-14T03:52:28.9481873Z   functorch/test_control_flow
2025-03-14T03:52:28.9509063Z   functorch/test_dims
2025-03-14T03:52:28.9509614Z   functorch/test_eager_transforms
2025-03-14T03:52:28.9510063Z   functorch/test_logging
2025-03-14T03:52:28.9510474Z   functorch/test_memory_efficient_fusion
2025-03-14T03:52:28.9510928Z   functorch/test_minifier
2025-03-14T03:52:28.9511333Z   functorch/test_ops
2025-03-14T03:52:28.9511767Z   functorch/test_parsing
2025-03-14T03:52:28.9512221Z   functorch/test_rearrange
2025-03-14T03:52:28.9512693Z   functorch/test_vmap
2025-03-14T03:52:28.9513124Z   functorch/test_vmap_registrations
2025-03-14T03:52:28.9513662Z   higher_order_ops/test_invoke_quant
2025-03-14T03:52:28.9514244Z   higher_order_ops/test_invoke_subgraph
2025-03-14T03:52:28.9514818Z   higher_order_ops/test_with_effects
2025-03-14T03:52:28.9515380Z   inductor/test_aot_inductor
2025-03-14T03:52:28.9515884Z   inductor/test_aot_inductor_arrayref
2025-03-14T03:52:28.9516452Z   inductor/test_aot_inductor_custom_ops
2025-03-14T03:52:28.9516955Z   inductor/test_aot_inductor_package
2025-03-14T03:52:28.9517301Z   inductor/test_aot_inductor_utils
2025-03-14T03:52:28.9517627Z   inductor/test_async_compile
2025-03-14T03:52:28.9517927Z   inductor/test_auto_functionalize
2025-03-14T03:52:28.9518238Z   inductor/test_autoheuristic
2025-03-14T03:52:28.9518534Z   inductor/test_b2b_gemm
2025-03-14T03:52:28.9518827Z   inductor/test_benchmark_fusion
2025-03-14T03:52:28.9519142Z   inductor/test_benchmarking
2025-03-14T03:52:28.9519444Z   inductor/test_binary_folding
2025-03-14T03:52:28.9519748Z   inductor/test_block_analysis
2025-03-14T03:52:28.9520046Z   inductor/test_ck_backend
2025-03-14T03:52:28.9520334Z   inductor/test_codecache
2025-03-14T03:52:28.9520609Z   inductor/test_codegen_triton
2025-03-14T03:52:28.9520911Z   inductor/test_combo_kernels
2025-03-14T03:52:28.9521219Z   inductor/test_compile_subprocess
2025-03-14T03:52:28.9521539Z   inductor/test_compile_worker
2025-03-14T03:52:28.9521845Z   inductor/test_compiled_autograd
2025-03-14T03:52:28.9522268Z   inductor/test_compiled_optimizers
2025-03-14T03:52:28.9522592Z   inductor/test_config
2025-03-14T03:52:28.9522872Z   inductor/test_control_flow
2025-03-14T03:52:28.9523189Z   inductor/test_cooperative_reductions
2025-03-14T03:52:28.9523547Z   inductor/test_coordinate_descent_tuner
2025-03-14T03:52:28.9523887Z   inductor/test_cpp_wrapper_hipify
2025-03-14T03:52:28.9524215Z   inductor/test_cpu_cpp_wrapper
2025-03-14T03:52:28.9524711Z   inductor/test_cpu_repro
2025-03-14T03:52:28.9525017Z   inductor/test_cpu_select_algorithm
2025-03-14T03:52:28.9525349Z   inductor/test_cuda_repro
2025-03-14T03:52:28.9525634Z   inductor/test_cudacodecache
2025-03-14T03:52:28.9525948Z   inductor/test_cudagraph_trees
2025-03-14T03:52:28.9526309Z   inductor/test_cudagraph_trees_expandable_segments
2025-03-14T03:52:28.9526690Z   inductor/test_custom_lowering
2025-03-14T03:52:28.9527009Z   inductor/test_custom_post_grad_passes
2025-03-14T03:52:28.9527336Z   inductor/test_cutlass_backend
2025-03-14T03:52:28.9527639Z   inductor/test_debug_trace
2025-03-14T03:52:28.9527944Z   inductor/test_decompose_mem_bound_mm
2025-03-14T03:52:28.9528284Z   inductor/test_dependencies
2025-03-14T03:52:28.9528595Z   inductor/test_distributed_patterns
2025-03-14T03:52:28.9528921Z   inductor/test_efficient_conv_bn_eval
2025-03-14T03:52:28.9529259Z   inductor/test_extension_backend
2025-03-14T03:52:28.9529583Z   inductor/test_external_callables
2025-03-14T03:52:28.9529910Z   inductor/test_flex_attention
2025-03-14T03:52:28.9530288Z   inductor/test_flex_decoding
2025-03-14T03:52:28.9530572Z   inductor/test_foreach
2025-03-14T03:52:28.9530839Z   inductor/test_fp8
2025-03-14T03:52:28.9531107Z   inductor/test_fused_attention
2025-03-14T03:52:28.9531401Z   inductor/test_fuzzer
2025-03-14T03:52:28.9531672Z   inductor/test_fx_fusion
2025-03-14T03:52:28.9531949Z   inductor/test_gpu_cpp_wrapper
2025-03-14T03:52:28.9532270Z   inductor/test_graph_transform_observer
2025-03-14T03:52:28.9532619Z   inductor/test_group_batch_fusion
2025-03-14T03:52:28.9532934Z   inductor/test_halide
2025-03-14T03:52:28.9533191Z   inductor/test_indexing
2025-03-14T03:52:28.9533482Z   inductor/test_inductor_annotations
2025-03-14T03:52:28.9533810Z   inductor/test_inductor_freezing
2025-03-14T03:52:28.9534133Z   inductor/test_inductor_utils
2025-03-14T03:52:28.9534442Z   inductor/test_inplace_padding
2025-03-14T03:52:28.9534734Z   inductor/test_inplacing_pass
2025-03-14T03:52:28.9535049Z   inductor/test_kernel_benchmark
2025-03-14T03:52:28.9535365Z   inductor/test_layout_optim
2025-03-14T03:52:28.9535672Z   inductor/test_loop_ordering
2025-03-14T03:52:28.9535983Z   inductor/test_max_autotune
2025-03-14T03:52:28.9536262Z   inductor/test_memory
2025-03-14T03:52:28.9536542Z   inductor/test_memory_planning
2025-03-14T03:52:28.9536844Z   inductor/test_metrics
2025-03-14T03:52:28.9537118Z   inductor/test_minifier
2025-03-14T03:52:28.9537410Z   inductor/test_minifier_isolate
2025-03-14T03:52:28.9537714Z   inductor/test_minifier_utils
2025-03-14T03:52:28.9538030Z   inductor/test_mkldnn_pattern_matcher
2025-03-14T03:52:28.9538364Z   inductor/test_mmdecomp
2025-03-14T03:52:28.9538674Z   inductor/test_move_constructors_to_cuda
2025-03-14T03:52:28.9539023Z   inductor/test_mps_basic
2025-03-14T03:52:28.9539301Z   inductor/test_multi_kernel
2025-03-14T03:52:28.9539592Z   inductor/test_online_softmax
2025-03-14T03:52:28.9539962Z   inductor/test_op_completeness
2025-03-14T03:52:28.9540274Z   inductor/test_op_dtype_prop
2025-03-14T03:52:28.9540585Z   inductor/test_ordered_set
2025-03-14T03:52:28.9540864Z   inductor/test_pad_mm
2025-03-14T03:52:28.9541136Z   inductor/test_padding
2025-03-14T03:52:28.9541419Z   inductor/test_pattern_matcher
2025-03-14T03:52:28.9541716Z   inductor/test_perf
2025-03-14T03:52:28.9541961Z   inductor/test_profiler
2025-03-14T03:52:28.9542256Z   inductor/test_provenance_tracing
2025-03-14T03:52:28.9542587Z   inductor/test_scatter_optimization
2025-03-14T03:52:28.9542922Z   inductor/test_select_algorithm
2025-03-14T03:52:28.9543228Z   inductor/test_smoke
2025-03-14T03:52:28.9543489Z   inductor/test_snode_runtime
2025-03-14T03:52:28.9543808Z   inductor/test_split_cat_fx_aten_passes
2025-03-14T03:52:28.9544156Z   inductor/test_split_cat_fx_passes
2025-03-14T03:52:28.9544485Z   inductor/test_standalone_compile
2025-03-14T03:52:28.9544803Z   inductor/test_torchbind
2025-03-14T03:52:29.8525220Z   inductor/test_torchinductor
2025-03-14T03:52:29.8525931Z   inductor/test_torchinductor_codegen_config_overrides
2025-03-14T03:52:29.8527140Z   inductor/test_torchinductor_codegen_dynamic_shapes
2025-03-14T03:52:29.8527770Z   inductor/test_torchinductor_dynamic_shapes
2025-03-14T03:52:29.8528275Z   inductor/test_torchinductor_opinfo
2025-03-14T03:52:29.8528781Z   inductor/test_torchinductor_strided_blocks
2025-03-14T03:52:29.8529338Z   inductor/test_triton_cpu_backend
2025-03-14T03:52:29.8529809Z   inductor/test_triton_extension_backend
2025-03-14T03:52:29.8530464Z   inductor/test_triton_heuristics
2025-03-14T03:52:29.8530843Z   inductor/test_triton_kernels
2025-03-14T03:52:29.8531148Z   inductor/test_triton_syntax
2025-03-14T03:52:29.8531454Z   inductor/test_triton_wrapper
2025-03-14T03:52:29.8531753Z   inductor/test_unbacked_symints
2025-03-14T03:52:29.8532058Z   inductor/test_utils
2025-03-14T03:52:29.8532330Z   inductor/test_xpu_basic
2025-03-14T03:52:29.8532612Z   lazy/test_bindings
2025-03-14T03:52:29.8532871Z   lazy/test_debug_util
2025-03-14T03:52:29.8533141Z   lazy/test_extract_compiled_graph
2025-03-14T03:52:29.8533480Z   lazy/test_functionalization
2025-03-14T03:52:29.8533950Z   lazy/test_generator
2025-03-14T03:52:29.8534222Z   lazy/test_meta_kernel
2025-03-14T03:52:29.8534491Z   lazy/test_reuse_ir
2025-03-14T03:52:29.8534744Z   lazy/test_step_closures
2025-03-14T03:52:29.8535026Z   lazy/test_ts_opinfo
2025-03-14T03:52:29.8535291Z   nn/test_convolution
2025-03-14T03:52:29.8535661Z   nn/test_dropout
2025-03-14T03:52:29.8535908Z   nn/test_embedding
2025-03-14T03:52:29.8536139Z   nn/test_init
2025-03-14T03:52:29.8536382Z   nn/test_lazy_modules
2025-03-14T03:52:29.8536657Z   nn/test_load_state_dict
2025-03-14T03:52:29.8536940Z   nn/test_module_hooks
2025-03-14T03:52:29.8537204Z   nn/test_multihead_attention
2025-03-14T03:52:29.8537512Z   nn/test_packed_sequence
2025-03-14T03:52:29.8537800Z   nn/test_parametrization
2025-03-14T03:52:29.8538083Z   nn/test_pooling
2025-03-14T03:52:29.8538324Z   nn/test_pruning
2025-03-14T03:52:29.8538606Z   onnx/dynamo/test_dynamo_with_onnxruntime_backend
2025-03-14T03:52:29.8538987Z   onnx/exporter/test_api
2025-03-14T03:52:29.8539270Z   onnx/exporter/test_building
2025-03-14T03:52:29.8539595Z   onnx/exporter/test_capture_strategies
2025-03-14T03:52:29.8539930Z   onnx/exporter/test_core
2025-03-14T03:52:29.8540211Z   onnx/exporter/test_dynamic_shapes
2025-03-14T03:52:29.8540541Z   onnx/exporter/test_hf_models_e2e
2025-03-14T03:52:29.8540866Z   onnx/exporter/test_ir_passes
2025-03-14T03:52:29.8541179Z   onnx/exporter/test_small_models_e2e
2025-03-14T03:52:29.8541510Z   onnx/exporter/test_tensors
2025-03-14T03:52:29.8541804Z   onnx/exporter/test_verification
2025-03-14T03:52:29.8542132Z   onnx/internal/test_diagnostics
2025-03-14T03:52:29.8542449Z   onnx/internal/test_registraion
2025-03-14T03:52:29.8542800Z   onnx/test_autograd_funs
2025-03-14T03:52:29.8543079Z   onnx/test_custom_ops
2025-03-14T03:52:29.8543331Z   onnx/test_fx_passes
2025-03-14T03:52:29.8543600Z   onnx/test_fx_type_promotion
2025-03-14T03:52:29.8543898Z   onnx/test_lazy_import
2025-03-14T03:52:29.8544182Z   onnx/test_models_onnxruntime
2025-03-14T03:52:29.8544498Z   onnx/test_models_quantized_onnxruntime
2025-03-14T03:52:29.8544828Z   onnx/test_onnx_opset
2025-03-14T03:52:29.8545106Z   onnx/test_onnxscript_no_runtime
2025-03-14T03:52:29.8545427Z   onnx/test_onnxscript_runtime
2025-03-14T03:52:29.8545730Z   onnx/test_op_consistency
2025-03-14T03:52:29.8546007Z   onnx/test_pytorch_jit_onnx
2025-03-14T03:52:29.8546313Z   onnx/test_pytorch_onnx_no_runtime
2025-03-14T03:52:29.8546641Z   onnx/test_pytorch_onnx_onnxruntime
2025-03-14T03:52:29.8546982Z   onnx/test_pytorch_onnx_shape_inference
2025-03-14T03:52:29.8547320Z   onnx/test_symbolic_helper
2025-03-14T03:52:29.8547595Z   onnx/test_utility_funs
2025-03-14T03:52:29.8547872Z   onnx/test_verification
2025-03-14T03:52:29.8548149Z   onnx/torchlib/test_ops
2025-03-14T03:52:29.8548427Z   optim/test_lrscheduler
2025-03-14T03:52:29.8548696Z   optim/test_optim
2025-03-14T03:52:29.8548935Z   optim/test_swa_utils
2025-03-14T03:52:29.8549213Z   profiler/test_cpp_thread
2025-03-14T03:52:29.8549608Z   profiler/test_execution_trace
2025-03-14T03:52:29.8549919Z   profiler/test_kineto
2025-03-14T03:52:29.8550198Z   profiler/test_memory_profiler
2025-03-14T03:52:29.8550489Z   profiler/test_profiler
2025-03-14T03:52:29.8550785Z   profiler/test_profiler_tree
2025-03-14T03:52:29.8551094Z   profiler/test_record_function
2025-03-14T03:52:29.8551396Z   profiler/test_torch_tidy
2025-03-14T03:52:29.8551674Z   test_accelerator
2025-03-14T03:52:29.8551905Z   test_ao_sparsity
2025-03-14T03:52:29.8552164Z   test_appending_byte_serializer
2025-03-14T03:52:29.8552458Z   test_autocast
2025-03-14T03:52:29.8552692Z   test_autograd
2025-03-14T03:52:29.8552924Z   test_autograd_fallback
2025-03-14T03:52:29.8553186Z   test_autoload
2025-03-14T03:52:29.8553427Z   test_autoload_disable
2025-03-14T03:52:29.8553695Z   test_autoload_enable
2025-03-14T03:52:29.8553956Z   test_binary_ufuncs
2025-03-14T03:52:29.8554204Z   test_bundled_inputs
2025-03-14T03:52:29.8554474Z   test_ci_sanity_check_fail
2025-03-14T03:52:29.8554764Z   test_comparison_utils
2025-03-14T03:52:29.8555044Z   test_compile_benchmark_util
2025-03-14T03:52:29.8555408Z   test_complex
2025-03-14T03:52:29.8555635Z   test_content_store
2025-03-14T03:52:29.8555895Z   test_cpp_api_parity
2025-03-14T03:52:29.8556170Z   test_cpp_extensions_aot_ninja
2025-03-14T03:52:29.8556481Z   test_cpp_extensions_aot_no_ninja
2025-03-14T03:52:29.8556801Z   test_cpp_extensions_jit
2025-03-14T03:52:29.8557083Z   test_cpp_extensions_mtia_backend
2025-03-14T03:52:29.8557436Z   test_cpp_extensions_open_device_registration
2025-03-14T03:52:29.8557808Z   test_cpp_extensions_stream_and_event
2025-03-14T03:52:29.8558121Z   test_cuda
2025-03-14T03:52:29.8558363Z   test_cuda_expandable_segments
2025-03-14T03:52:29.8558646Z   test_cuda_multigpu
2025-03-14T03:52:29.8558914Z   test_cuda_nvml_based_avail
2025-03-14T03:52:29.8559205Z   test_cuda_primary_ctx
2025-03-14T03:52:29.8559470Z   test_cuda_sanitizer
2025-03-14T03:52:29.8559714Z   test_cuda_trace
2025-03-14T03:52:29.8559961Z   test_custom_ops
2025-03-14T03:52:29.8560203Z   test_dataloader
2025-03-14T03:52:29.8560447Z   test_datapipe
2025-03-14T03:52:29.8560683Z   test_decomp
2025-03-14T03:52:29.8560902Z   test_deploy
2025-03-14T03:52:29.8561130Z   test_dispatch
2025-03-14T03:52:29.8561364Z   test_dlpack
2025-03-14T03:52:29.8561601Z   test_dynamic_shapes
2025-03-14T03:52:29.8561864Z   test_expanded_weights
2025-03-14T03:52:29.8562240Z   test_extension_utils
2025-03-14T03:52:29.8562511Z   test_fake_tensor
2025-03-14T03:52:29.8562760Z   test_file_check
2025-03-14T03:52:29.8563278Z   test_flop_counter
2025-03-14T03:52:29.8563527Z   test_foreach
2025-03-14T03:52:29.8563757Z   test_function_schema
2025-03-14T03:52:29.8564045Z   test_functional_autograd_benchmark
2025-03-14T03:52:29.8564371Z   test_functional_optim
2025-03-14T03:52:29.8564648Z   test_functionalization
2025-03-14T03:52:29.8564943Z   test_functionalization_of_rng_ops
2025-03-14T03:52:29.8565244Z   test_futures
2025-03-14T03:52:29.8565472Z   test_fx
2025-03-14T03:52:29.8565706Z   test_fx_experimental
2025-03-14T03:52:29.8565964Z   test_fx_passes
2025-03-14T03:52:29.8566227Z   test_fx_reinplace_pass
2025-03-14T03:52:29.8566487Z   test_hop_infra
2025-03-14T03:52:29.8566725Z   test_hub
2025-03-14T03:52:29.8566950Z   test_import_stats
2025-03-14T03:52:29.8567196Z   test_indexing
2025-03-14T03:52:29.8567414Z   test_itt
2025-03-14T03:52:29.8567631Z   test_jit
2025-03-14T03:52:29.8567851Z   test_jit_autocast
2025-03-14T03:52:29.8568096Z   test_jit_disabled
2025-03-14T03:52:29.8568343Z   test_jit_fuser_legacy
2025-03-14T03:52:29.8568591Z   test_jit_fuser_te
2025-03-14T03:52:29.8568836Z   test_jit_legacy
2025-03-14T03:52:29.8569080Z   test_jit_llga_fuser
2025-03-14T03:52:29.8569341Z   test_jit_profiling
2025-03-14T03:52:29.8569592Z   test_jiterator
2025-03-14T03:52:29.8569820Z   test_legacy_vmap
2025-03-14T03:52:29.8570061Z   test_license
2025-03-14T03:52:29.8570293Z   test_linalg
2025-03-14T03:52:29.8570521Z   test_logging
2025-03-14T03:52:29.8570739Z   test_masked
2025-03-14T03:52:29.8571081Z   test_maskedtensor
2025-03-14T03:52:29.8571333Z   test_matmul_cuda
2025-03-14T03:52:29.8571579Z   test_meta
2025-03-14T03:52:29.8571803Z   test_metal
2025-03-14T03:52:29.8572022Z   test_mkl_verbose
2025-03-14T03:52:29.8572266Z   test_mkldnn
2025-03-14T03:52:29.8572503Z   test_mkldnn_fusion
2025-03-14T03:52:29.8572760Z   test_mkldnn_verbose
2025-03-14T03:52:29.8573011Z   test_mobile_optimizer
2025-03-14T03:52:29.8573289Z   test_model_exports_to_core_aten
2025-03-14T03:52:29.8573598Z   test_module_tracker
2025-03-14T03:52:29.8573849Z   test_modules
2025-03-14T03:52:29.8574079Z   test_monitor
2025-03-14T03:52:29.8574294Z   test_mps
2025-03-14T03:52:29.8574525Z   test_multiprocessing
2025-03-14T03:52:29.8574809Z   test_multiprocessing_spawn
2025-03-14T03:52:29.8575097Z   test_namedtensor
2025-03-14T03:52:29.8575360Z   test_namedtuple_return_api
2025-03-14T03:52:29.8575638Z   test_native_functions
2025-03-14T03:52:29.8575896Z   test_native_mha
2025-03-14T03:52:29.8576138Z   test_nestedtensor
2025-03-14T03:52:29.8576379Z   test_nn
2025-03-14T03:52:29.8576606Z   test_numba_integration
2025-03-14T03:52:29.8576938Z   test_numpy_interop
2025-03-14T03:52:29.8577193Z   test_openmp
2025-03-14T03:52:29.8577420Z   test_ops
2025-03-14T03:52:29.8577650Z   test_ops_fwd_gradients
2025-03-14T03:52:29.8577910Z   test_ops_gradients
2025-03-14T03:52:29.8578164Z   test_ops_jit
2025-03-14T03:52:29.8578395Z   test_optim
2025-03-14T03:52:29.8578632Z   test_out_dtype_op
2025-03-14T03:52:29.8578882Z   test_overrides
2025-03-14T03:52:29.8579364Z   test_package
2025-03-14T03:52:29.8579608Z   test_per_overload_api
2025-03-14T03:52:29.8579870Z   test_prims
2025-03-14T03:52:29.8580106Z   test_proxy_tensor
2025-03-14T03:52:29.8580339Z   test_pruning_op
2025-03-14T03:52:29.8580585Z   test_public_bindings
2025-03-14T03:52:29.8580849Z   test_python_dispatch
2025-03-14T03:52:29.8581104Z   test_pytree
2025-03-14T03:52:29.8581340Z   test_quantization
2025-03-14T03:52:29.8581573Z   test_reductions
2025-03-14T03:52:29.8581828Z   test_scatter_gather_ops
2025-03-14T03:52:29.8582109Z   test_schema_check
2025-03-14T03:52:29.8582375Z   test_segment_reductions
2025-03-14T03:52:29.8582652Z   test_serialization
2025-03-14T03:52:29.8582940Z   test_set_default_mobile_cpu_allocator
2025-03-14T03:52:29.8583273Z   test_shape_ops
2025-03-14T03:52:29.8583510Z   test_show_pickle
2025-03-14T03:52:29.8583762Z   test_sort_and_select
2025-03-14T03:52:29.8584021Z   test_sparse
2025-03-14T03:52:29.8584258Z   test_sparse_csr
2025-03-14T03:52:29.8584519Z   test_sparse_semi_structured
2025-03-14T03:52:29.8584801Z   test_spectral_ops
2025-03-14T03:52:29.8585055Z   test_stateless
2025-03-14T03:52:29.8585299Z   test_subclass
2025-03-14T03:52:29.8585544Z   test_sympy_utils
2025-03-14T03:52:29.8585806Z   test_tensor_creation_ops
2025-03-14T03:52:29.8586075Z   test_tensorboard
2025-03-14T03:52:29.8586324Z   test_tensorexpr
2025-03-14T03:52:29.8586584Z   test_tensorexpr_pybind
2025-03-14T03:52:29.8586857Z   test_testing
2025-03-14T03:52:29.8587081Z   test_torch
2025-03-14T03:52:29.8587317Z   test_transformers
2025-03-14T03:52:29.8587584Z   test_transformers_privateuse1
2025-03-14T03:52:29.8587879Z   test_type_hints
2025-03-14T03:52:29.8588121Z   test_type_info
2025-03-14T03:52:29.8588350Z   test_type_promotion
2025-03-14T03:52:29.8588603Z   test_typing
2025-03-14T03:52:29.8588833Z   test_unary_ufuncs
2025-03-14T03:52:29.8589074Z   test_utils
2025-03-14T03:52:29.8589313Z   test_utils_config_module
2025-03-14T03:52:29.8589577Z   test_utils_filelock
2025-03-14T03:52:29.8589829Z   test_view_ops
2025-03-14T03:52:29.8590061Z   test_vulkan
2025-03-14T03:52:29.8590287Z   test_weak
2025-03-14T03:52:29.8590509Z   test_xnnpack_integration
2025-03-14T03:52:29.8590783Z   test_xpu
2025-03-14T03:52:29.8591033Z   torch_np/numpy_tests/core/test_dlpack
2025-03-14T03:52:29.8591383Z   torch_np/numpy_tests/core/test_dtype
2025-03-14T03:52:29.8591729Z   torch_np/numpy_tests/core/test_einsum
2025-03-14T03:52:29.8592072Z   torch_np/numpy_tests/core/test_getlimits
2025-03-14T03:52:29.8592429Z   torch_np/numpy_tests/core/test_indexing
2025-03-14T03:52:29.8592942Z   torch_np/numpy_tests/core/test_multiarray
2025-03-14T03:52:29.8593307Z   torch_np/numpy_tests/core/test_numeric
2025-03-14T03:52:29.8593668Z   torch_np/numpy_tests/core/test_numerictypes
2025-03-14T03:52:29.8594034Z   torch_np/numpy_tests/core/test_scalar_ctors
2025-03-14T03:52:29.8594419Z   torch_np/numpy_tests/core/test_scalar_methods
2025-03-14T03:52:29.8594807Z   torch_np/numpy_tests/core/test_scalarinherit
2025-03-14T03:52:29.8595183Z   torch_np/numpy_tests/core/test_scalarmath
2025-03-14T03:52:29.8595548Z   torch_np/numpy_tests/core/test_shape_base
2025-03-14T03:52:29.8595904Z   torch_np/numpy_tests/fft/test_helper
2025-03-14T03:52:29.8596238Z   torch_np/numpy_tests/fft/test_pocketfft
2025-03-14T03:52:29.8596592Z   torch_np/numpy_tests/lib/test_arraypad
2025-03-14T03:52:29.8596947Z   torch_np/numpy_tests/lib/test_arraysetops
2025-03-14T03:52:29.8597316Z   torch_np/numpy_tests/lib/test_function_base
2025-03-14T03:52:29.8597683Z   torch_np/numpy_tests/lib/test_histograms
2025-03-14T03:52:29.8598037Z   torch_np/numpy_tests/lib/test_index_tricks
2025-03-14T03:52:29.8598512Z   torch_np/numpy_tests/lib/test_shape_base_
2025-03-14T03:52:29.8598881Z   torch_np/numpy_tests/lib/test_twodim_base
2025-03-14T03:52:29.8599246Z   torch_np/numpy_tests/lib/test_type_check
2025-03-14T03:52:29.8599607Z   torch_np/numpy_tests/linalg/test_linalg
2025-03-14T03:52:29.8599925Z   torch_np/test_basic
2025-03-14T03:52:29.8600199Z   torch_np/test_binary_ufuncs
2025-03-14T03:52:29.8600493Z   torch_np/test_dtype
2025-03-14T03:52:29.8600803Z   torch_np/test_function_base
2025-03-14T03:52:29.8601107Z   torch_np/test_ndarray_methods
2025-03-14T03:52:29.8601399Z   torch_np/test_nep50_examples
2025-03-14T03:52:29.8601692Z   torch_np/test_random
2025-03-14T03:52:29.8602063Z   torch_np/test_reductions
2025-03-14T03:52:29.8602361Z   torch_np/test_scalars_0D_arrays
2025-03-14T03:52:29.8602675Z   torch_np/test_ufuncs_basic
2025-03-14T03:52:29.8602964Z   torch_np/test_unary_ufuncs
2025-03-14T03:52:29.8603252Z   xpu/test_conv
2025-03-14T03:52:29.8603488Z   xpu/test_gemm
2025-03-14T03:52:29.8604075Z could not find path /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/previous_failures.json
2025-03-14T03:52:29.8605109Z could not find path /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/previous_failures_additional.json
2025-03-14T03:52:29.8605818Z Results from PreviouslyFailedInPR
2025-03-14T03:52:29.8606051Z 
2025-03-14T03:52:29.8606148Z base_commit: HEAD^
2025-03-14T03:52:29.8606788Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:29.8607497Z Results from EditedByPR
2025-03-14T03:52:29.8607664Z 
2025-03-14T03:52:29.8607783Z Results from MentionedInPR
2025-03-14T03:52:29.8607962Z 
2025-03-14T03:52:29.8608071Z base_commit: HEAD^
2025-03-14T03:52:29.8608695Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:29.8609454Z Results from HistoricalClassFailurCorrelation
2025-03-14T03:52:29.8609953Z   inductor/test_torchinductor_opinfo, TestInductorOpInfoCPU (0.25)
2025-03-14T03:52:29.8610581Z   inductor/test_torchinductor_opinfo, TestInductorOpInfoCUDA (0.07907786754219832)
2025-03-14T03:52:29.8611243Z   distributed/test_c10d_nccl, ProcessGroupNCCLGroupTest (0.07040229736971561)
2025-03-14T03:52:29.8611747Z   test_fx, TestVisionTracing (0.06931247397244791)
2025-03-14T03:52:29.8612290Z   distributed/test_distributed_spawn, TestDistBackendWithSpawn (0.04817449289067656)
2025-03-14T03:52:29.8612940Z   distributed/test_c10d_nccl, NcclErrorHandlingTest (0.046216763055872224)
2025-03-14T03:52:29.8613556Z   distributed/test_device_mesh, DeviceMeshCollectiveTest (0.045574362476489494)
2025-03-14T03:52:29.8614202Z   distributed/test_c10d_gloo, DistributedDataParallelTest (0.03752456967293895)
2025-03-14T03:52:29.8614738Z   test_utils, TestDeviceUtilsCPU (0.03615032077794899)
2025-03-14T03:52:29.8615257Z   test_ops, TestCompositeComplianceCUDA (0.035692381613027534)
2025-03-14T03:52:29.8615830Z   test_python_dispatch, TestWrapperSubclassAliasingCPU (0.035314350459419185)
2025-03-14T03:52:29.8616528Z   inductor/test_torchinductor_dynamic_shapes, TestInductorDynamicCUDA (0.03298915462999838)
2025-03-14T03:52:29.8617125Z   test_decomp, TestDecompCUDA (0.031109826497970033)
2025-03-14T03:52:29.8617530Z   test_linalg, TestLinalgCUDA (0.02962418746696073)
2025-03-14T03:52:29.8618006Z   test_python_dispatch, TestPythonRegistration (0.028622403349720507)
2025-03-14T03:52:29.8618456Z   test_jit, TestScript (0.027435243386533404)
2025-03-14T03:52:29.8618956Z   distributed/test_c10d_nccl, DistributedDataParallelTest (0.027429803210148818)
2025-03-14T03:52:29.8619573Z   inductor/test_triton_cpu_backend, CpuTritonTests (0.02497604049383169)
2025-03-14T03:52:29.8620088Z   test_dataloader, TestDataLoader (0.023250330648947142)
2025-03-14T03:52:29.8620619Z   inductor/test_compiled_autograd, TestCompiledAutograd (0.022296190800630333)
2025-03-14T03:52:29.8621222Z   test_cuda_multigpu, TestCudaMultiGPU (0.02186433589214761)
2025-03-14T03:52:29.8621792Z   distributed/fsdp/test_fsdp_optim_state, TestFSDPOptimState (0.02179142511672117)
2025-03-14T03:52:29.8622491Z   export/test_retraceability, RetraceExportNonStrictTestExport (0.020671735752575922)
2025-03-14T03:52:29.8623067Z   dynamo/test_misc, MiscTests (0.020262224089270267)
2025-03-14T03:52:29.8623516Z   functorch/test_ops, TestOperatorsCUDA (0.01987055309470982)
2025-03-14T03:52:29.8624064Z   distributed/launcher/test_run, ElasticLaunchTest (0.019320122261061345)
2025-03-14T03:52:29.8624537Z   test_cuda, TestCuda (0.019320122261061345)
2025-03-14T03:52:29.8625057Z   distributed/test_c10d_object_collectives, TestObjectCollectives (0.01788900209357532)
2025-03-14T03:52:29.8625731Z   dynamo/test_ctx_manager, ContextlibContextManagerTests (0.01788900209357532)
2025-03-14T03:52:29.8626555Z   inductor/test_aot_inductor_arrayref, AOTInductorTestABICompatibleCpuWithStackAllocation (0.01788900209357532)
2025-03-14T03:52:29.8627301Z   test_cuda, TestBlockStateAbsorption (0.01722378560289748)
2025-03-14T03:52:29.8627867Z   inductor/test_cpu_select_algorithm, TestSelectAlgorithmCPU (0.016769921582169795)
2025-03-14T03:52:29.8628509Z   export/test_serdes, SerDesExportNonStrictTestExport (0.016696401954003626)
2025-03-14T03:52:29.8629229Z   inductor/test_cpu_select_algorithm, TestSelectAlgorithmDynamicShapesCPU (0.01658161629697427)
2025-03-14T03:52:29.8629945Z   distributed/test_c10d_nccl, ProcessGroupNCCLInitTest (0.016100101884217784)
2025-03-14T03:52:29.8630576Z   distributed/test_c10d_ucc, DistributedDataParallelTest (0.015980841870260616)
2025-03-14T03:52:29.8631200Z   dynamo/test_dynamic_shapes, DynamicShapesMiscTests (0.01597472597210897)
2025-03-14T03:52:29.8631882Z   inductor/test_cudagraph_trees_expandable_segments, CudaGraphTreeTests (0.015503801814431941)
2025-03-14T03:52:29.8632463Z   test_autograd, TestAutograd (0.015503801814431941)
2025-03-14T03:52:29.8633021Z   inductor/test_cpu_cpp_wrapper, DynamicShapesCppWrapperCpuTests (0.014490091695796006)
2025-03-14T03:52:29.8633571Z   test_mps, TestSDPA (0.014311201674860254)
2025-03-14T03:52:29.8634195Z   distributed/_composable/test_composability/test_pp_composability, ComposabilityTest (0.013628923455477381)
2025-03-14T03:52:29.8634938Z   inductor/test_cpu_cpp_wrapper, TestCppWrapper (0.012323534775574107)
2025-03-14T03:52:29.8635453Z   profiler/test_profiler, TestProfiler (0.012164521423631216)
2025-03-14T03:52:29.8635971Z   test_dataloader, TestOutOfOrderDataLoader (0.011926001395716878)
2025-03-14T03:52:29.8636441Z   test_ops, TestCommonCUDA (0.011588325742450261)
2025-03-14T03:52:29.8636885Z   inductor/test_torchinductor, CpuTests (0.011210441311973865)
2025-03-14T03:52:29.8637427Z   test_nestedtensor, TestNestedTensorSubclassCUDA (0.011210441311973863)
2025-03-14T03:52:29.8638003Z   inductor/test_flex_decoding, TestFlexDecoding (0.010964227089610677)
2025-03-14T03:52:29.8638716Z   distributed/_tools/test_fsdp2_mem_tracker, TestTrackerFullyShard1DTrainingCompose (0.01073340125614519)
2025-03-14T03:52:29.8639600Z   inductor/test_torchinductor_dynamic_shapes, DynamicShapesCpuTests (0.010600797464402604)
2025-03-14T03:52:29.8640197Z   export/test_export, TestExport (0.010392658359124706)
2025-03-14T03:52:29.8640626Z   test_cuda, TestCudaMallocAsync (0.00977162695003899)
2025-03-14T03:52:29.8641172Z   distributed/fsdp/test_fsdp_misc, TestFSDPMiscMultiProcess (0.009540801116573502)
2025-03-14T03:52:29.8641784Z   distributed/test_c10d_gloo, LargeCommTest (0.009540801116573502)
2025-03-14T03:52:29.8642431Z   test_ops_gradients, TestBwdGradientsCUDA (0.009302281088659166)
2025-03-14T03:52:29.8642964Z   distributed/test_device_mesh, DeviceMeshTest (0.009200058219553019)
2025-03-14T03:52:29.8643494Z   inductor/test_torchinductor, GPUTests (0.008898631810650285)
2025-03-14T03:52:29.8644010Z   distributed/test_c10d_nccl, NCCLTraceTest (0.008774129598277417)
2025-03-14T03:52:29.8644574Z   distributed/test_launcher, TestDistributedLaunch (0.008348200977001815)
2025-03-14T03:52:29.8645218Z   nn/test_parametrization, TestNNParametrization (0.008348200977001813)
2025-03-14T03:52:29.8645775Z   test_ops_fwd_gradients, TestFwdGradientsCUDA (0.008203643384326458)
2025-03-14T03:52:29.8646455Z   distributed/_composable/fsdp/test_fully_shard_compile, TestFullyShardCompile (0.007912244446642163)
2025-03-14T03:52:29.8647197Z   export/test_retraceability, RetraceExportTestExport (0.0074926199484386825)
2025-03-14T03:52:29.8648031Z   export/test_export_training_ir_to_run_decomp, TrainingIRToRunDecompExportNonStrictTestExport (0.007188126295782081)
2025-03-14T03:52:29.8648996Z   export/test_export_training_ir_to_run_decomp, TrainingIRToRunDecompExportTestExport (0.007188126295782081)
2025-03-14T03:52:29.8649942Z   distributed/rpc/cuda/test_tensorpipe_agent, TensorPipeTensorPipeCudaDistAutogradTest (0.007155600837430127)
2025-03-14T03:52:29.8650670Z   inductor/test_halide, CpuHalideTests (0.007155600837430127)
2025-03-14T03:52:29.8651351Z   inductor/test_torchinductor_codegen_dynamic_shapes, DynamicShapesCodegenCpuTests (0.007155600837430127)
2025-03-14T03:52:29.8652167Z   inductor/test_torchinductor_dynamic_shapes, DynamicShapesGPUTests (0.007155600837430127)
2025-03-14T03:52:29.8652867Z   test_fake_tensor, PropagateRealTensorsFakeTensorTest (0.007155600837430127)
2025-03-14T03:52:29.8653408Z   test_foreach, TestForeachCUDA (0.007155600837430127)
2025-03-14T03:52:29.8653799Z   test_jit, TestModels (0.007155600837430127)
2025-03-14T03:52:29.8654157Z   test_meta, TestMetaCUDA (0.007155600837430127)
2025-03-14T03:52:29.8654560Z   test_mps, TestAdvancedIndexing (0.007155600837430127)
2025-03-14T03:52:29.8654943Z   test_mps, TestMPS (0.007155600837430127)
2025-03-14T03:52:29.8655395Z   test_quantization, TestFXNumericSuiteNShadows (0.007155600837430127)
2025-03-14T03:52:29.8655940Z   test_transformers, TestTransformersCUDA (0.007155600837430127)
2025-03-14T03:52:29.8656391Z   export/test_hop, TestHOPCUDA (0.007076094161458681)
2025-03-14T03:52:29.8656933Z   distributed/test_c10d_nccl, NcclUserBufferRegistrationTest (0.006978676640900261)
2025-03-14T03:52:29.8657601Z   dynamo/test_autograd_function, AutogradFunctionTests (0.006360534077715669)
2025-03-14T03:52:29.8658130Z   test_cuda, TestCudaOptimsCUDA (0.005963000697858439)
2025-03-14T03:52:29.8658612Z   test_dataloader, TestIndividualWorkerQueue (0.005963000697858439)
2025-03-14T03:52:29.8659205Z   profiler/test_kineto, SimpleKinetoInitializationTest (0.005366700628072595)
2025-03-14T03:52:29.8659910Z   inductor/test_compiled_optimizers, CompiledOptimizerParityTestsCUDA (0.005247440614115427)
2025-03-14T03:52:29.8660701Z   distributed/flight_recorder/test_fr_analysis, FlightRecorderEventTest (0.005008920586201089)
2025-03-14T03:52:29.8661449Z   distributed/pipelining/test_schedule_multiproc, ScheduleTest (0.004770400558286751)
2025-03-14T03:52:29.8662123Z   distributed/test_c10d_functional_native, TestWithNCCL (0.004770400558286751)
2025-03-14T03:52:29.8662752Z   inductor/test_group_batch_fusion, TestGroupBatchFusion (0.004770400558286751)
2025-03-14T03:52:29.8663673Z   test_jit, TestSymbolicShapeAnalysis (0.004770400558286751)
2025-03-14T03:52:29.8664189Z   test_quantization, TestFloat8DtypeCPUOnlyCPU (0.004770400558286751)
2025-03-14T03:52:29.8664832Z   distributed/_composable/fsdp/test_fully_shard_training, pytest (0.004429657661266269)
2025-03-14T03:52:29.8665634Z   inductor/test_torchinductor_codegen_dynamic_shapes, DynamicShapesCodegenGPUTests (0.004163639083767823)
2025-03-14T03:52:29.8666386Z   distributed/fsdp/test_fsdp_core, TestParityWithDDP (0.004126645211851877)
2025-03-14T03:52:29.8666995Z   inductor/test_cudagraph_trees, CudaGraphTreeTests (0.004054840474543738)
2025-03-14T03:52:29.8667557Z   test_autograd, TestAutogradDeviceTypeCUDA (0.003975333798572293)
2025-03-14T03:52:29.8668028Z   test_ops, TestMathBitsCUDA (0.003975333798572293)
2025-03-14T03:52:29.8668483Z   test_cuda_expandable_segments, TestCuda (0.0037523272684084814)
2025-03-14T03:52:29.8669211Z   distributed/_shard/sharded_tensor/test_sharded_tensor, TestShardedTensorFromLocalShards (0.0035778004187150634)
2025-03-14T03:52:29.8670073Z   distributed/_tools/test_mem_tracker, TestMemTracker (0.0035778004187150634)
2025-03-14T03:52:29.8670810Z   distributed/fsdp/test_distributed_checkpoint, TestDistributedCheckpoint (0.0035778004187150634)
2025-03-14T03:52:29.8671556Z   distributed/fsdp/test_fsdp_misc, TestFSDPMiscMultiThread (0.0035778004187150634)
2025-03-14T03:52:29.8672333Z   distributed/rpc/test_tensorpipe_agent, TensorPipeDdpUnderDistAutogradTest (0.0035778004187150634)
2025-03-14T03:52:29.8673114Z   distributed/rpc/test_tensorpipe_agent, TensorPipeRpcTest (0.0035778004187150634)
2025-03-14T03:52:29.8673908Z   distributed/test_c10d_gloo, GlooProcessGroupWithDispatchedCollectivesTests (0.0035778004187150634)
2025-03-14T03:52:29.8674613Z   distributed/test_c10d_nccl, CommTest (0.0035778004187150634)
2025-03-14T03:52:29.8675130Z   distributed/test_c10d_nccl, LargeCommTest (0.0035778004187150634)
2025-03-14T03:52:29.8675664Z   distributed/test_functional_api, TestPgTag (0.0035778004187150634)
2025-03-14T03:52:29.8676211Z   dynamo/test_ctx_manager, CtxManagerTests (0.0035778004187150634)
2025-03-14T03:52:29.8676809Z   dynamo/test_dynamic_shapes, DynamicShapesCtxManagerTests (0.0035778004187150634)
2025-03-14T03:52:29.8677357Z   dynamo/test_exc, ExcTests (0.0035778004187150634)
2025-03-14T03:52:29.8677795Z   dynamo/test_logging, LoggingTests (0.0035778004187150634)
2025-03-14T03:52:29.8678305Z   export/test_serdes, SerDesExportTestExport (0.0035778004187150634)
2025-03-14T03:52:29.8678886Z   functorch/test_aotdispatch, TestAOTModuleSimplified (0.0035778004187150634)
2025-03-14T03:52:29.8679609Z   functorch/test_dims, TestMin (0.0035778004187150634)
2025-03-14T03:52:29.8680111Z   inductor/test_compile_worker, TestCompileWorker (0.0035778004187150634)
2025-03-14T03:52:29.8680794Z   inductor/test_compiled_autograd, TestAutogradWithCompiledAutograd (0.0035778004187150634)
2025-03-14T03:52:29.8681571Z   inductor/test_compiled_autograd, TestCustomOpWithCompiledAutograd (0.0035778004187150634)
2025-03-14T03:52:29.8682380Z   inductor/test_extension_backend, ExtensionBackendTests (0.0035778004187150634)
2025-03-14T03:52:29.8683005Z   inductor/test_kernel_benchmark, TestKernelBenchmark (0.0035778004187150634)
2025-03-14T03:52:29.8683592Z   inductor/test_max_autotune, TestMaxAutotune (0.0035778004187150634)
2025-03-14T03:52:29.8684169Z   inductor/test_pattern_matcher, TestPatternMatcher (0.0035778004187150634)
2025-03-14T03:52:29.8684709Z   inductor/test_perf, InplacingTests (0.0035778004187150634)
2025-03-14T03:52:29.8685323Z   inductor/test_triton_extension_backend, TritonExtensionBackendTests (0.0035778004187150634)
2025-03-14T03:52:29.8686034Z   nn/test_convolution, TestConvolutionNNDeviceTypeCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8686660Z   profiler/test_memory_profiler, TestIdentifyGradients (0.0035778004187150634)
2025-03-14T03:52:29.8687242Z   profiler/test_profiler, TestProfilerCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8687832Z   test_cuda_expandable_segments, TestBlockStateAbsorption (0.0035778004187150634)
2025-03-14T03:52:29.8688595Z   test_cuda_expandable_segments, TestCudaMallocAsync (0.0035778004187150634)
2025-03-14T03:52:29.8689128Z   test_jit_fuser_te, TestNNCOpInfoCPU (0.0035778004187150634)
2025-03-14T03:52:29.8689558Z   test_modules, TestModuleCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8689944Z   test_nn, TestNN (0.0035778004187150634)
2025-03-14T03:52:29.8690302Z   test_ops_jit, TestJitCPU (0.0035778004187150634)
2025-03-14T03:52:29.8690695Z   test_ops_jit, TestJitCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8691156Z   test_overrides, TestTorchFunctionWarning (0.0035778004187150634)
2025-03-14T03:52:29.8691717Z   test_schema_check, TestSchemaCheckModeOpInfoCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8692227Z   test_testing, TestTestingCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8692627Z   test_torch, TestTorch (0.0035778004187150634)
2025-03-14T03:52:29.8693054Z   test_torch, TestTorchDeviceTypeCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8693561Z   test_transformers, TestSDPACudaOnlyCUDA (0.0035778004187150634)
2025-03-14T03:52:29.8694148Z   test_type_hints, TestTypeHints (0.0035778004187150634)
2025-03-14T03:52:29.8694570Z   test_utils, TestDataLoaderUtils (0.0035778004187150634)
2025-03-14T03:52:29.8695112Z   torch_np/numpy_tests/lib/test_function_base, TestGradient (0.0035778004187150634)
2025-03-14T03:52:29.8696024Z   distributed/_composable/fsdp/test_fully_shard_extensions, TestFullyShardAllGatherExtensionsMultiThread (0.0023852002791433756)
2025-03-14T03:52:29.8696994Z   distributed/_composable/fsdp/test_fully_shard_mixed_precision, pytest (0.0023852002791433756)
2025-03-14T03:52:29.8697713Z   distributed/checkpoint/test_state_dict, TestStateDict (0.0023852002791433756)
2025-03-14T03:52:29.8698283Z   distributed/test_c10d_ucc, CommTest (0.0023852002791433756)
2025-03-14T03:52:29.8698852Z   distributed/test_pg_wrapper, ProcessGroupNCCLWrapperTest (0.0023852002791433756)
2025-03-14T03:52:29.8699465Z   inductor/test_codecache, TestFxGraphCache (0.0023852002791433756)
2025-03-14T03:52:29.8699995Z   inductor/test_torchinductor, TestFull (0.0023852002791433756)
2025-03-14T03:52:29.8700555Z   test_dataloader, TestDataLoaderPersistentWorkers (0.0023852002791433756)
2025-03-14T03:52:29.8701250Z   test_functional_autograd_benchmark, TestFunctionalAutogradBenchmark (0.0023852002791433756)
2025-03-14T03:52:29.8701911Z   test_multiprocessing, TestMultiprocessing (0.0023852002791433756)
2025-03-14T03:52:29.8702369Z   test_testing, TestImports (0.0023852002791433756)
2025-03-14T03:52:29.8702931Z   distributed/test_inductor_collectives, TestCollectivesMultiProc (0.001959601625548989)
2025-03-14T03:52:29.8703579Z   inductor/test_multi_kernel, MultiKernelTest (0.0017889002093575317)
2025-03-14T03:52:29.8704293Z   distributed/test_compute_comm_reordering, TestComputeCommReorderingMultiProc (0.0016677269331443656)
2025-03-14T03:52:29.8705058Z   functorch/test_aotdispatch, TestAOTAutogradWithCache (0.001623415383789057)
2025-03-14T03:52:29.8705671Z   test_nestedtensor, TestNestedTensorOpInfoCUDA (0.001590133519428917)
2025-03-14T03:52:29.8706451Z   distributed/_composable/test_composability/test_2d_composability, TestFullyShard2DStateDict (0.0014311201674860254)
2025-03-14T03:52:29.8707362Z   distributed/checkpoint/test_fsdp_optim_state, FsdpOptimStateCheckpoint (0.0014311201674860254)
2025-03-14T03:52:29.8708088Z   profiler/test_execution_trace, TestExecutionTraceCPU (0.0014311201674860254)
2025-03-14T03:52:29.8708701Z   test_nestedtensor, TestNestedTensorAutogradCUDA (0.001171088593042617)
2025-03-14T03:52:29.8709358Z   inductor/test_aot_inductor, AOTInductorTestABICompatibleCuda (0.0011008616672969426)
2025-03-14T03:52:29.8709925Z   test_utils, TestBottleneck (0.0009540801116573502)
2025-03-14T03:52:29.8710397Z   test_dynamic_shapes, TestSymNumberMagicMethods (0.0007224404691636186)
2025-03-14T03:52:29.8710923Z   inductor/test_pad_mm, PadMMTest (0.0007155600837430127)
2025-03-14T03:52:29.8711440Z   test_quantization, TestQuantizeEagerPTQDynamic (0.0007155600837430127)
2025-03-14T03:52:29.8712140Z   inductor/test_compiled_optimizers, CompiledOptimizerTests (0.0006505091670391025)
2025-03-14T03:52:29.8712759Z   distributed/test_c10d_common, TimeoutTest (0.0005504308336484713)
2025-03-14T03:52:29.8713272Z   distributed/test_functional_api, pytest (0.0004770400558286751)
2025-03-14T03:52:29.8713714Z   test_jit, TestJit (0.0004770400558286751)
2025-03-14T03:52:29.8714088Z   test_jit_legacy, TestSparse (0.0004770400558286751)
2025-03-14T03:52:29.8714741Z   distributed/_composable/fsdp/test_fully_shard_training, TestFullyShardHSDPTraining (0.0004209176963194192)
2025-03-14T03:52:29.8715392Z   test_cuda, TestMemPool (0.00039753337985722927)
2025-03-14T03:52:29.8715805Z   test_jit_legacy, TestTypeSharing (0.0003407428970204822)
2025-03-14T03:52:29.8716216Z   test_ops, TestCommonCPU (0.00030449365265660115)
2025-03-14T03:52:29.8716801Z   distributed/test_dynamo_distributed, TestFakeDistributedSingleProc (0.00018830528519552965)
2025-03-14T03:52:29.8717518Z   inductor/test_scatter_optimization, TestScatterOpt (7.301633507581762e-05)
2025-03-14T03:52:29.8718129Z   test_accelerator, TestAccelerator (5.166498799588539e-05)
2025-03-14T03:52:29.8718628Z   test_quantization, TestNumericDebugger (5.166498799588539e-05)
2025-03-14T03:52:29.8719193Z   distributed/test_c10d_logger, C10dErrorLoggerTest (3.3281864360140126e-05)
2025-03-14T03:52:29.8719789Z   functorch/test_control_flow, AssociativeScanTests (3.3281864360140126e-05)
2025-03-14T03:52:29.8720447Z   inductor/test_aot_inductor, AOTInductorTestABICompatibleCpu (3.252545835195512e-05)
2025-03-14T03:52:29.8721059Z   inductor/test_cpu_repro, CPUReproTests (3.252545835195512e-05)
2025-03-14T03:52:30.5726051Z   inductor/test_minifier, MinifierTests (3.252545835195512e-05)
2025-03-14T03:52:30.5726740Z base_commit: HEAD^
2025-03-14T03:52:30.5727426Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:30.5728237Z Results from CorrelatedWithHistoricalFailures
2025-03-14T03:52:30.5728835Z   distributed/test_c10d_nccl (0.25)
2025-03-14T03:52:30.5729246Z   distributed/test_distributed_spawn (0.10155489444554128)
2025-03-14T03:52:30.5729896Z   inductor/test_compiled_autograd (0.05746820771864853)
2025-03-14T03:52:30.5730810Z   distributed/_composable/test_composability/test_pp_composability (0.036202439223642024)
2025-03-14T03:52:30.5731384Z   distributed/test_c10d_ucc (0.03422776072053428)
2025-03-14T03:52:30.5731744Z   test_nestedtensor (0.03291130838512911)
2025-03-14T03:52:30.5732106Z   test_ci_sanity_check_fail (0.029620177546616205)
2025-03-14T03:52:30.5732467Z   test_torch (0.029620177546616205)
2025-03-14T03:52:30.5732782Z   test_autograd (0.02632904670810329)
2025-03-14T03:52:30.5733158Z   distributed/fsdp/test_fsdp_core (0.01974678503107747)
2025-03-14T03:52:30.5733639Z   distributed/fsdp/test_fsdp_dtensor_state_dict (0.01974678503107747)
2025-03-14T03:52:30.5734164Z   distributed/fsdp/test_fsdp_pure_fp16 (0.01974678503107747)
2025-03-14T03:52:30.5734591Z   dynamo/test_interop (0.01974678503107747)
2025-03-14T03:52:30.5734965Z   inductor/test_debug_trace (0.01974678503107747)
2025-03-14T03:52:30.5735344Z   inductor/test_indexing (0.01974678503107747)
2025-03-14T03:52:30.5735695Z   test_autoload_disable (0.01974678503107747)
2025-03-14T03:52:30.5736085Z   test_model_exports_to_core_aten (0.01974678503107747)
2025-03-14T03:52:30.5736462Z   test_modules (0.01974678503107747)
2025-03-14T03:52:30.5736783Z   test_reductions (0.013164523354051645)
2025-03-14T03:52:30.5737145Z   distributed/test_c10d_gloo (0.01139237597946777)
2025-03-14T03:52:30.5737546Z   inductor/test_cudacodecache (0.01114737864657599)
2025-03-14T03:52:30.5737951Z   distributed/launcher/test_run (0.009873392515538735)
2025-03-14T03:52:30.5738360Z   distributed/test_launcher (0.009873392515538735)
2025-03-14T03:52:30.5738736Z   functorch/test_dims (0.009873392515538735)
2025-03-14T03:52:30.5739143Z   inductor/test_aot_inductor_arrayref (0.009873392515538735)
2025-03-14T03:52:30.5739810Z   test_foreach (0.007898714012430988)
2025-03-14T03:52:30.5740242Z   distributed/flight_recorder/test_fr_analysis (0.006582261677025822)
2025-03-14T03:52:30.5740724Z   lazy/test_step_closures (0.006582261677025822)
2025-03-14T03:52:30.5741083Z   test_dataloader (0.006582261677025822)
2025-03-14T03:52:30.5741425Z   test_transformers (0.006582261677025822)
2025-03-14T03:52:30.5741907Z   distributed/_composable/fsdp/test_fully_shard_compile (0.006178524047258349)
2025-03-14T03:52:30.5742483Z   functorch/test_rearrange (0.005641938580307848)
2025-03-14T03:52:30.5742906Z   inductor/test_cpp_wrapper_hipify (0.005641938580307848)
2025-03-14T03:52:30.5743393Z   distributed/test_compute_comm_reordering (0.004602303284872333)
2025-03-14T03:52:30.5744006Z   distributed/_composable/test_composability/test_2d_composability (0.003949357006215494)
2025-03-14T03:52:30.5744664Z   distributed/checkpoint/test_fsdp_optim_state (0.003949357006215494)
2025-03-14T03:52:30.5745132Z   test_mkl_verbose (0.0017951622755524972)
2025-03-14T03:52:30.5745513Z   distributed/test_c10d_common (0.0015189834639290363)
2025-03-14T03:52:30.5746066Z   inductor/test_torchinductor (0.0013164523354051647)
2025-03-14T03:52:30.5746438Z   test_ops (0.0008402887247267008)
2025-03-14T03:52:30.5746732Z   test_cuda (0.0004701615483589873)
2025-03-14T03:52:30.5747054Z   test_accelerator (0.00014257606520633553)
2025-03-14T03:52:30.5747440Z   distributed/test_c10d_logger (9.184551177245334e-05)
2025-03-14T03:52:30.5747862Z   functorch/test_control_flow (9.184551177245334e-05)
2025-03-14T03:52:30.5748276Z   inductor/test_aot_inductor (8.975811377762486e-05)
2025-03-14T03:52:30.5748662Z   inductor/test_cpu_repro (8.975811377762486e-05)
2025-03-14T03:52:30.5749049Z   inductor/test_minifier (8.975811377762486e-05)
2025-03-14T03:52:30.5749397Z base_commit: HEAD^
2025-03-14T03:52:30.5750042Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:30.5750764Z Results from HistorialEditedFiles
2025-03-14T03:52:30.5751087Z   distributed/test_c10d_nccl (0.25)
2025-03-14T03:52:30.5751499Z   distributed/elastic/test_control_plane (0.00519781325951484)
2025-03-14T03:52:30.5751984Z   distributed/test_symmetric_memory (0.004519837616969425)
2025-03-14T03:52:30.5752479Z   distributed/test_c10d_functional_native (0.0023989907351606946)
2025-03-14T03:52:30.5752989Z   distributed/test_inductor_collectives (0.0023989907351606946)
2025-03-14T03:52:30.5753603Z   distributed/_composable/test_composability/test_pp_composability (0.0022599188084847124)
2025-03-14T03:52:30.5754196Z   distributed/test_c10d_common (0.0022599188084847124)
2025-03-14T03:52:30.5754596Z   test_multiprocessing (0.0005215197250349337)
2025-03-14T03:52:30.5754940Z base_commit: HEAD^
2025-03-14T03:52:30.5755575Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:30.5756283Z Results from Profiling
2025-03-14T03:52:30.5756453Z 
2025-03-14T03:52:30.5757041Z could not find path /home/ec2-user/actions-runner/_work/pytorch/pytorch/.additional_ci_files/llm_results/mappings/indexer-files-gitdiff-output.json
2025-03-14T03:52:30.5757847Z Results from LLM
2025-03-14T03:52:30.5758004Z 
2025-03-14T03:52:30.5758100Z base_commit: HEAD^
2025-03-14T03:52:30.5758734Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:30.5759442Z Results from Filepath
2025-03-14T03:52:30.5759727Z   distributed/test_c10d_common (0.25)
2025-03-14T03:52:30.5760083Z   distributed/test_c10d_functional_native (0.25)
2025-03-14T03:52:30.5760456Z   distributed/test_c10d_gloo (0.25)
2025-03-14T03:52:30.5760783Z   distributed/test_c10d_logger (0.25)
2025-03-14T03:52:30.5761112Z   distributed/test_c10d_nccl (0.25)
2025-03-14T03:52:30.5761468Z   distributed/test_c10d_object_collectives (0.25)
2025-03-14T03:52:30.5761835Z   distributed/test_c10d_ops_nccl (0.25)
2025-03-14T03:52:30.5762276Z   distributed/test_c10d_pypg (0.25)
2025-03-14T03:52:30.5762698Z   distributed/test_c10d_spawn_gloo (0.25)
2025-03-14T03:52:30.5763063Z   distributed/test_c10d_spawn_nccl (0.25)
2025-03-14T03:52:30.5763414Z   distributed/test_c10d_spawn_ucc (0.25)
2025-03-14T03:52:30.5763745Z   distributed/test_c10d_ucc (0.25)
2025-03-14T03:52:30.5764179Z   distributed/_composable/fsdp/test_fully_shard_autograd (0.1875)
2025-03-14T03:52:30.5764751Z   distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ (0.1875)
2025-03-14T03:52:30.5765309Z   distributed/_composable/fsdp/test_fully_shard_comm (0.1875)
2025-03-14T03:52:30.5765832Z   distributed/_composable/fsdp/test_fully_shard_compile (0.1875)
2025-03-14T03:52:30.5766380Z   distributed/_composable/fsdp/test_fully_shard_extensions (0.1875)
2025-03-14T03:52:30.5766912Z   distributed/_composable/fsdp/test_fully_shard_frozen (0.1875)
2025-03-14T03:52:30.5767455Z   distributed/_composable/fsdp/test_fully_shard_grad_scaler (0.1875)
2025-03-14T03:52:30.5768032Z   distributed/_composable/fsdp/test_fully_shard_ignore_params (0.1875)
2025-03-14T03:52:30.5768648Z   distributed/_composable/fsdp/test_fully_shard_init (0.1875)
2025-03-14T03:52:30.5769169Z   distributed/_composable/fsdp/test_fully_shard_logging (0.1875)
2025-03-14T03:52:30.5769698Z   distributed/_composable/fsdp/test_fully_shard_memory (0.1875)
2025-03-14T03:52:30.5770249Z   distributed/_composable/fsdp/test_fully_shard_mixed_precision (0.1875)
2025-03-14T03:52:30.5770821Z   distributed/_composable/fsdp/test_fully_shard_overlap (0.1875)
2025-03-14T03:52:30.5771347Z   distributed/_composable/fsdp/test_fully_shard_state (0.1875)
2025-03-14T03:52:30.5771888Z   distributed/_composable/fsdp/test_fully_shard_state_dict (0.1875)
2025-03-14T03:52:30.5772439Z   distributed/_composable/fsdp/test_fully_shard_training (0.1875)
2025-03-14T03:52:30.5772925Z   distributed/_composable/test_checkpoint (0.1875)
2025-03-14T03:52:30.5773437Z   distributed/_composable/test_composability/test_2d_composability (0.1875)
2025-03-14T03:52:30.5774072Z   distributed/_composable/test_composability/test_pp_composability (0.1875)
2025-03-14T03:52:30.5774605Z   distributed/_composable/test_contract (0.1875)
2025-03-14T03:52:30.5775012Z   distributed/_composable/test_replicate (0.1875)
2025-03-14T03:52:30.5775477Z   distributed/_composable/test_replicate_with_compiler (0.1875)
2025-03-14T03:52:30.5775986Z   distributed/_shard/sharded_optim/test_sharded_optim (0.1875)
2025-03-14T03:52:30.5776502Z   distributed/_shard/sharded_tensor/ops/test_binary_cmp (0.1875)
2025-03-14T03:52:30.5777024Z   distributed/_shard/sharded_tensor/ops/test_embedding (0.1875)
2025-03-14T03:52:30.5777556Z   distributed/_shard/sharded_tensor/ops/test_embedding_bag (0.1875)
2025-03-14T03:52:30.5778067Z   distributed/_shard/sharded_tensor/ops/test_init (0.1875)
2025-03-14T03:52:30.5778562Z   distributed/_shard/sharded_tensor/ops/test_tensor_ops (0.1875)
2025-03-14T03:52:30.5779297Z   distributed/_shard/sharded_tensor/test_logger (0.1875)
2025-03-14T03:52:30.5779793Z   distributed/_shard/sharded_tensor/test_sharded_tensor (0.1875)
2025-03-14T03:52:30.5780355Z   distributed/_shard/sharded_tensor/test_sharded_tensor_reshard (0.1875)
2025-03-14T03:52:30.5780910Z   distributed/_shard/sharding_plan/test_sharding_plan (0.1875)
2025-03-14T03:52:30.5781424Z   distributed/_shard/sharding_spec/test_sharding_spec (0.1875)
2025-03-14T03:52:30.5781857Z   distributed/_shard/test_sharder (0.1875)
2025-03-14T03:52:30.5782247Z   distributed/_tools/test_fake_collectives (0.1875)
2025-03-14T03:52:30.5782670Z   distributed/_tools/test_fsdp2_mem_tracker (0.1875)
2025-03-14T03:52:30.5783075Z   distributed/_tools/test_mem_tracker (0.1875)
2025-03-14T03:52:30.5783467Z   distributed/_tools/test_memory_tracker (0.1875)
2025-03-14T03:52:30.5783850Z   distributed/_tools/test_mod_tracker (0.1875)
2025-03-14T03:52:30.5784254Z   distributed/_tools/test_runtime_estimator (0.1875)
2025-03-14T03:52:30.5784665Z   distributed/_tools/test_sac_estimator (0.1875)
2025-03-14T03:52:30.5785043Z   distributed/_tools/test_sac_ilp (0.1875)
2025-03-14T03:52:30.5785625Z   distributed/algorithms/ddp_comm_hooks/test_ddp_hooks (0.1875)
2025-03-14T03:52:30.5786161Z   distributed/algorithms/quantization/test_quantization (0.1875)
2025-03-14T03:52:30.5786631Z   distributed/algorithms/test_join (0.1875)
2025-03-14T03:52:30.5787067Z   distributed/checkpoint/e2e/test_e2e_save_and_load (0.1875)
2025-03-14T03:52:30.5787543Z   distributed/checkpoint/e2e/test_fine_tuning (0.1875)
2025-03-14T03:52:30.5787973Z   distributed/checkpoint/e2e/test_fsdp_ep (0.1875)
2025-03-14T03:52:30.5788394Z   distributed/checkpoint/e2e/test_pipeline (0.1875)
2025-03-14T03:52:30.5788812Z   distributed/checkpoint/fsdp/test_fsdp_dsd (0.1875)
2025-03-14T03:52:30.5789233Z   distributed/checkpoint/test_checkpoint (0.1875)
2025-03-14T03:52:30.5789661Z   distributed/checkpoint/test_compatibility (0.1875)
2025-03-14T03:52:30.5790091Z   distributed/checkpoint/test_dedup_tensors (0.1875)
2025-03-14T03:52:30.5790542Z   distributed/checkpoint/test_dtensor_checkpoint (0.1875)
2025-03-14T03:52:30.5791008Z   distributed/checkpoint/test_dtensor_resharding (0.1875)
2025-03-14T03:52:30.5791578Z   distributed/checkpoint/test_file_system_checkpoint (0.1875)
2025-03-14T03:52:30.5792113Z   distributed/checkpoint/test_file_system_checkpoint_cpu (0.1875)
2025-03-14T03:52:30.5792603Z   distributed/checkpoint/test_format_utils (0.1875)
2025-03-14T03:52:30.5793036Z   distributed/checkpoint/test_fsdp_model_state (0.1875)
2025-03-14T03:52:30.5793474Z   distributed/checkpoint/test_fsdp_optim_state (0.1875)
2025-03-14T03:52:30.5793994Z   distributed/checkpoint/test_fsdp_tp_checkpoint_conversion (0.1875)
2025-03-14T03:52:30.5794482Z   distributed/checkpoint/test_fsspec (0.1875)
2025-03-14T03:52:30.5794875Z   distributed/checkpoint/test_hf_storage (0.1875)
2025-03-14T03:52:30.5795299Z   distributed/checkpoint/test_hsdp_checkpoint (0.1875)
2025-03-14T03:52:30.5795729Z   distributed/checkpoint/test_nested_dict (0.1875)
2025-03-14T03:52:30.5796121Z   distributed/checkpoint/test_planner (0.1875)
2025-03-14T03:52:30.5796527Z   distributed/checkpoint/test_save_load_api (0.1875)
2025-03-14T03:52:30.5796949Z   distributed/checkpoint/test_state_dict (0.1875)
2025-03-14T03:52:30.5797380Z   distributed/checkpoint/test_state_dict_utils (0.1875)
2025-03-14T03:52:30.5797822Z   distributed/checkpoint/test_tp_checkpoint (0.1875)
2025-03-14T03:52:30.5798224Z   distributed/checkpoint/test_traverse (0.1875)
2025-03-14T03:52:30.5798611Z   distributed/checkpoint/test_utils (0.1875)
2025-03-14T03:52:30.5798987Z   distributed/elastic/events/lib_test (0.1875)
2025-03-14T03:52:30.5799374Z   distributed/elastic/metrics/api_test (0.1875)
2025-03-14T03:52:30.5799799Z   distributed/elastic/multiprocessing/api_test (0.1875)
2025-03-14T03:52:30.5800219Z   distributed/elastic/test_control_plane (0.1875)
2025-03-14T03:52:30.5800613Z   distributed/elastic/timer/api_test (0.1875)
2025-03-14T03:52:30.5801030Z   distributed/elastic/timer/local_timer_example (0.1875)
2025-03-14T03:52:30.5801478Z   distributed/elastic/timer/local_timer_test (0.1875)
2025-03-14T03:52:30.5802003Z   distributed/elastic/utils/distributed_test (0.1875)
2025-03-14T03:52:30.5802426Z   distributed/elastic/utils/logging_test (0.1875)
2025-03-14T03:52:30.5802827Z   distributed/elastic/utils/util_test (0.1875)
2025-03-14T03:52:30.5803247Z   distributed/flight_recorder/test_fr_analysis (0.1875)
2025-03-14T03:52:30.5803688Z   distributed/fsdp/test_checkpoint_wrapper (0.1875)
2025-03-14T03:52:30.5804127Z   distributed/fsdp/test_distributed_checkpoint (0.1875)
2025-03-14T03:52:30.5804545Z   distributed/fsdp/test_fsdp_apply (0.1875)
2025-03-14T03:52:30.5804942Z   distributed/fsdp/test_fsdp_backward_prefetch (0.1875)
2025-03-14T03:52:30.5805372Z   distributed/fsdp/test_fsdp_checkpoint (0.1875)
2025-03-14T03:52:30.5805785Z   distributed/fsdp/test_fsdp_clip_grad_norm (0.1875)
2025-03-14T03:52:30.5806180Z   distributed/fsdp/test_fsdp_comm (0.1875)
2025-03-14T03:52:30.5806556Z   distributed/fsdp/test_fsdp_comm_hooks (0.1875)
2025-03-14T03:52:30.5806926Z   distributed/fsdp/test_fsdp_core (0.1875)
2025-03-14T03:52:30.5807414Z   distributed/fsdp/test_fsdp_dtensor_state_dict (0.1875)
2025-03-14T03:52:30.5807855Z   distributed/fsdp/test_fsdp_exec_order (0.1875)
2025-03-14T03:52:30.5808256Z   distributed/fsdp/test_fsdp_fine_tune (0.1875)
2025-03-14T03:52:30.5808669Z   distributed/fsdp/test_fsdp_flatten_params (0.1875)
2025-03-14T03:52:30.5809097Z   distributed/fsdp/test_fsdp_freezing_weights (0.1875)
2025-03-14T03:52:30.5809504Z   distributed/fsdp/test_fsdp_fx (0.1875)
2025-03-14T03:52:30.5809874Z   distributed/fsdp/test_fsdp_grad_acc (0.1875)
2025-03-14T03:52:30.5810276Z   distributed/fsdp/test_fsdp_hybrid_shard (0.1875)
2025-03-14T03:52:30.5810708Z   distributed/fsdp/test_fsdp_ignored_modules (0.1875)
2025-03-14T03:52:30.5811102Z   distributed/fsdp/test_fsdp_input (0.1875)
2025-03-14T03:52:30.5811477Z   distributed/fsdp/test_fsdp_memory (0.1875)
2025-03-14T03:52:30.5811850Z   distributed/fsdp/test_fsdp_meta (0.1875)
2025-03-14T03:52:30.5812212Z   distributed/fsdp/test_fsdp_misc (0.1875)
2025-03-14T03:52:30.5812613Z   distributed/fsdp/test_fsdp_mixed_precision (0.1875)
2025-03-14T03:52:30.5813143Z   distributed/fsdp/test_fsdp_multiple_forward (0.1875)
2025-03-14T03:52:30.5813589Z   distributed/fsdp/test_fsdp_multiple_wrapping (0.1875)
2025-03-14T03:52:30.5814027Z   distributed/fsdp/test_fsdp_optim_state (0.1875)
2025-03-14T03:52:30.5814422Z   distributed/fsdp/test_fsdp_overlap (0.1875)
2025-03-14T03:52:30.5814807Z   distributed/fsdp/test_fsdp_pure_fp16 (0.1875)
2025-03-14T03:52:30.5815235Z   distributed/fsdp/test_fsdp_sharded_grad_scaler (0.1875)
2025-03-14T03:52:30.5815656Z   distributed/fsdp/test_fsdp_state_dict (0.1875)
2025-03-14T03:52:30.5816075Z   distributed/fsdp/test_fsdp_tp_integration (0.1875)
2025-03-14T03:52:30.5816485Z   distributed/fsdp/test_fsdp_traversal (0.1875)
2025-03-14T03:52:30.5816867Z   distributed/fsdp/test_fsdp_uneven (0.1875)
2025-03-14T03:52:30.5817261Z   distributed/fsdp/test_fsdp_unshard_params (0.1875)
2025-03-14T03:52:30.5817676Z   distributed/fsdp/test_fsdp_use_orig_params (0.1875)
2025-03-14T03:52:30.5818248Z   distributed/fsdp/test_hsdp_dtensor_state_dict (0.1875)
2025-03-14T03:52:30.5818856Z   distributed/fsdp/test_shard_utils (0.1875)
2025-03-14T03:52:30.5819410Z   distributed/fsdp/test_utils (0.1875)
2025-03-14T03:52:30.5819907Z   distributed/fsdp/test_wrap (0.1875)
2025-03-14T03:52:30.5820338Z   distributed/launcher/test_run (0.1875)
2025-03-14T03:52:30.5820866Z   distributed/nn/jit/test_instantiator (0.1875)
2025-03-14T03:52:30.5821624Z   distributed/optim/test_apply_optimizer_in_backward (0.1875)
2025-03-14T03:52:30.5822552Z   distributed/optim/test_named_optimizer (0.1875)
2025-03-14T03:52:30.5823482Z   distributed/optim/test_zero_redundancy_optimizer (0.1875)
2025-03-14T03:52:30.5824342Z   distributed/pipelining/test_backward (0.1875)
2025-03-14T03:52:30.5825114Z   distributed/pipelining/test_microbatch (0.1875)
2025-03-14T03:52:30.5850416Z   distributed/pipelining/test_pipe (0.1875)
2025-03-14T03:52:30.5850970Z   distributed/pipelining/test_schedule (0.1875)
2025-03-14T03:52:30.5851450Z   distributed/pipelining/test_schedule_multiproc (0.1875)
2025-03-14T03:52:30.5851888Z   distributed/pipelining/test_stage (0.1875)
2025-03-14T03:52:30.5852297Z   distributed/pipelining/test_transformer (0.1875)
2025-03-14T03:52:30.5852720Z   distributed/pipelining/test_unflatten (0.1875)
2025-03-14T03:52:30.5853147Z   distributed/rpc/cuda/test_tensorpipe_agent (0.1875)
2025-03-14T03:52:30.5853562Z   distributed/rpc/test_faulty_agent (0.1875)
2025-03-14T03:52:30.5853937Z   distributed/rpc/test_share_memory (0.1875)
2025-03-14T03:52:30.5854309Z   distributed/rpc/test_tensorpipe_agent (0.1875)
2025-03-14T03:52:30.5854722Z   distributed/tensor/debug/test_comm_mode (0.1875)
2025-03-14T03:52:30.5855176Z   distributed/tensor/debug/test_comm_mode_features (0.1875)
2025-03-14T03:52:30.5855645Z   distributed/tensor/debug/test_op_coverage (0.1875)
2025-03-14T03:52:30.5856103Z   distributed/tensor/experimental/test_local_map (0.1875)
2025-03-14T03:52:30.5856615Z   distributed/tensor/experimental/test_register_sharding (0.1875)
2025-03-14T03:52:30.5857284Z   distributed/tensor/experimental/test_tp_transform (0.1875)
2025-03-14T03:52:30.5857804Z   distributed/tensor/parallel/test_micro_pipeline_tp (0.1875)
2025-03-14T03:52:30.5858323Z   distributed/tensor/parallel/test_parallelize_api (0.1875)
2025-03-14T03:52:30.5858803Z   distributed/tensor/parallel/test_tp_examples (0.1875)
2025-03-14T03:52:30.5859264Z   distributed/tensor/parallel/test_tp_random_state (0.1875)
2025-03-14T03:52:30.5859731Z   distributed/tensor/parallel/test_tp_style (0.1875)
2025-03-14T03:52:30.5860127Z   distributed/tensor/test_api (0.1875)
2025-03-14T03:52:30.5860484Z   distributed/tensor/test_attention (0.1875)
2025-03-14T03:52:30.5860862Z   distributed/tensor/test_common_rules (0.1875)
2025-03-14T03:52:30.5861266Z   distributed/tensor/test_convolution_ops (0.1875)
2025-03-14T03:52:30.5861646Z   distributed/tensor/test_dtensor (0.1875)
2025-03-14T03:52:30.5862030Z   distributed/tensor/test_dtensor_compile (0.1875)
2025-03-14T03:52:30.5862433Z   distributed/tensor/test_dtensor_ops (0.1875)
2025-03-14T03:52:30.5862897Z   distributed/tensor/test_embedding_ops (0.1875)
2025-03-14T03:52:30.5863310Z   distributed/tensor/test_experimental_ops (0.1875)
2025-03-14T03:52:30.5863687Z   distributed/tensor/test_init (0.1875)
2025-03-14T03:52:30.5864043Z   distributed/tensor/test_math_ops (0.1875)
2025-03-14T03:52:30.5864412Z   distributed/tensor/test_matrix_ops (0.1875)
2025-03-14T03:52:30.5864793Z   distributed/tensor/test_op_strategy (0.1875)
2025-03-14T03:52:30.5865180Z   distributed/tensor/test_optimizers (0.1875)
2025-03-14T03:52:30.5865559Z   distributed/tensor/test_pointwise_ops (0.1875)
2025-03-14T03:52:30.5865950Z   distributed/tensor/test_random_ops (0.1875)
2025-03-14T03:52:30.5866337Z   distributed/tensor/test_redistribute (0.1875)
2025-03-14T03:52:30.5866725Z   distributed/tensor/test_tensor_ops (0.1875)
2025-03-14T03:52:30.5867090Z   distributed/tensor/test_utils (0.1875)
2025-03-14T03:52:30.5867437Z   distributed/tensor/test_view_ops (0.1875)
2025-03-14T03:52:30.5867830Z   distributed/tensor/test_xla_integration (0.1875)
2025-03-14T03:52:30.5868220Z   distributed/test_backends (0.1875)
2025-03-14T03:52:30.5868571Z   distributed/test_collective_utils (0.1875)
2025-03-14T03:52:30.5868937Z   distributed/test_composability (0.1875)
2025-03-14T03:52:30.5869313Z   distributed/test_compute_comm_reordering (0.1875)
2025-03-14T03:52:30.5869723Z   distributed/test_control_collectives (0.1875)
2025-03-14T03:52:30.5870102Z   distributed/test_data_parallel (0.1875)
2025-03-14T03:52:30.5870456Z   distributed/test_device_mesh (0.1875)
2025-03-14T03:52:30.5870815Z   distributed/test_distributed_spawn (0.1875)
2025-03-14T03:52:30.5871186Z   distributed/test_dynamo_distributed (0.1875)
2025-03-14T03:52:30.5871554Z   distributed/test_fake_pg (0.1875)
2025-03-14T03:52:30.5871899Z   distributed/test_functional_api (0.1875)
2025-03-14T03:52:30.5872278Z   distributed/test_inductor_collectives (0.1875)
2025-03-14T03:52:30.5872652Z   distributed/test_launcher (0.1875)
2025-03-14T03:52:30.5872994Z   distributed/test_multi_threaded_pg (0.1875)
2025-03-14T03:52:30.5873356Z   distributed/test_nccl (0.1875)
2025-03-14T03:52:30.5873684Z   distributed/test_pg_wrapper (0.1875)
2025-03-14T03:52:30.5874032Z   distributed/test_serialization (0.1875)
2025-03-14T03:52:30.5874381Z   distributed/test_store (0.1875)
2025-03-14T03:52:30.5874708Z   distributed/test_symmetric_memory (0.1875)
2025-03-14T03:52:41.3362855Z   inductor/test_distributed_patterns (0.1875)
2025-03-14T03:52:41.3363491Z base_commit: HEAD^
2025-03-14T03:52:41.3364500Z Changed files: ['torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp', 'torch/csrc/distributed/c10d/ProcessGroupNCCL.hpp']
2025-03-14T03:52:41.3365220Z Results from PublicBindings
2025-03-14T03:52:41.3365527Z   test_public_bindings (1.0)
2025-03-14T03:52:41.3365829Z Aggregated Heuristics
2025-03-14T03:52:41.3366161Z   test_public_bindings (1.0)
2025-03-14T03:52:41.3366471Z   distributed/test_c10d_nccl (0.75)
2025-03-14T03:52:41.3366866Z   distributed/test_distributed_spawn (0.2890548944455413)
2025-03-14T03:52:41.3367635Z   distributed/test_c10d_ucc (0.2842277607205343)
2025-03-14T03:52:41.3368023Z   distributed/test_c10d_gloo (0.2613923759794678)
2025-03-14T03:52:41.3368429Z   distributed/test_c10d_common (0.25377890227241373)
2025-03-14T03:52:41.3368891Z   distributed/test_c10d_functional_native (0.2523989907351607)
2025-03-14T03:52:41.3369356Z   distributed/test_c10d_logger (0.25009184551177244)
2025-03-14T03:52:41.3369765Z   distributed/test_c10d_object_collectives (0.25)
2025-03-14T03:52:41.3370134Z   distributed/test_c10d_ops_nccl (0.25)
2025-03-14T03:52:41.3370486Z   distributed/test_c10d_pypg (0.25)
2025-03-14T03:52:41.3370828Z   distributed/test_c10d_spawn_gloo (0.25)
2025-03-14T03:52:41.3371188Z   distributed/test_c10d_spawn_nccl (0.25)
2025-03-14T03:52:41.3371543Z   distributed/test_c10d_spawn_ucc (0.25)
2025-03-14T03:52:41.3372066Z   distributed/_composable/test_composability/test_pp_composability (0.22596235803212672)
2025-03-14T03:52:41.3372660Z   distributed/fsdp/test_fsdp_core (0.20724678503107746)
2025-03-14T03:52:41.3373261Z   distributed/fsdp/test_fsdp_dtensor_state_dict (0.20724678503107746)
2025-03-14T03:52:41.3373785Z   distributed/fsdp/test_fsdp_pure_fp16 (0.20724678503107746)
2025-03-14T03:52:41.3374243Z   distributed/launcher/test_run (0.19737339251553873)
2025-03-14T03:52:41.3374636Z   distributed/test_launcher (0.19737339251553873)
2025-03-14T03:52:41.3375118Z   distributed/flight_recorder/test_fr_analysis (0.19408226167702583)
2025-03-14T03:52:41.3375715Z   distributed/_composable/fsdp/test_fully_shard_compile (0.19367852404725835)
2025-03-14T03:52:41.3376291Z   distributed/elastic/test_control_plane (0.19269781325951485)
2025-03-14T03:52:41.3376805Z   distributed/test_compute_comm_reordering (0.19210230328487232)
2025-03-14T03:52:41.3377293Z   distributed/test_symmetric_memory (0.19201983761696942)
2025-03-14T03:52:41.3377864Z   distributed/_composable/test_composability/test_2d_composability (0.1914493570062155)
2025-03-14T03:52:41.3378514Z   distributed/checkpoint/test_fsdp_optim_state (0.1914493570062155)
2025-03-14T03:52:41.3379240Z   distributed/test_inductor_collectives (0.1898989907351607)
2025-03-14T03:52:41.3379763Z   distributed/_composable/fsdp/test_fully_shard_autograd (0.1875)
2025-03-14T03:52:41.3380330Z   distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ (0.1875)
2025-03-14T03:52:41.3380902Z   distributed/_composable/fsdp/test_fully_shard_comm (0.1875)
2025-03-14T03:52:41.3381435Z   distributed/_composable/fsdp/test_fully_shard_extensions (0.1875)
2025-03-14T03:52:41.3381970Z   distributed/_composable/fsdp/test_fully_shard_frozen (0.1875)
2025-03-14T03:52:41.3382509Z   distributed/_composable/fsdp/test_fully_shard_grad_scaler (0.1875)
2025-03-14T03:52:41.3383078Z   distributed/_composable/fsdp/test_fully_shard_ignore_params (0.1875)
2025-03-14T03:52:41.3383621Z   distributed/_composable/fsdp/test_fully_shard_init (0.1875)
2025-03-14T03:52:41.3384138Z   distributed/_composable/fsdp/test_fully_shard_logging (0.1875)
2025-03-14T03:52:41.3384671Z   distributed/_composable/fsdp/test_fully_shard_memory (0.1875)
2025-03-14T03:52:41.3385222Z   distributed/_composable/fsdp/test_fully_shard_mixed_precision (0.1875)
2025-03-14T03:52:41.3385793Z   distributed/_composable/fsdp/test_fully_shard_overlap (0.1875)
2025-03-14T03:52:41.3386313Z   distributed/_composable/fsdp/test_fully_shard_state (0.1875)
2025-03-14T03:52:41.3386846Z   distributed/_composable/fsdp/test_fully_shard_state_dict (0.1875)
2025-03-14T03:52:41.3387395Z   distributed/_composable/fsdp/test_fully_shard_training (0.1875)
2025-03-14T03:52:41.3387862Z   distributed/_composable/test_checkpoint (0.1875)
2025-03-14T03:52:41.3388273Z   distributed/_composable/test_contract (0.1875)
2025-03-14T03:52:41.3388680Z   distributed/_composable/test_replicate (0.1875)
2025-03-14T03:52:41.3389147Z   distributed/_composable/test_replicate_with_compiler (0.1875)
2025-03-14T03:52:41.3389665Z   distributed/_shard/sharded_optim/test_sharded_optim (0.1875)
2025-03-14T03:52:41.3390171Z   distributed/_shard/sharded_tensor/ops/test_binary_cmp (0.1875)
2025-03-14T03:52:41.3390835Z   distributed/_shard/sharded_tensor/ops/test_embedding (0.1875)
2025-03-14T03:52:41.3391375Z   distributed/_shard/sharded_tensor/ops/test_embedding_bag (0.1875)
2025-03-14T03:52:41.3391889Z   distributed/_shard/sharded_tensor/ops/test_init (0.1875)
2025-03-14T03:52:41.3392394Z   distributed/_shard/sharded_tensor/ops/test_tensor_ops (0.1875)
2025-03-14T03:52:41.3392891Z   distributed/_shard/sharded_tensor/test_logger (0.1875)
2025-03-14T03:52:41.3393371Z   distributed/_shard/sharded_tensor/test_sharded_tensor (0.1875)
2025-03-14T03:52:41.3393927Z   distributed/_shard/sharded_tensor/test_sharded_tensor_reshard (0.1875)
2025-03-14T03:52:41.3394484Z   distributed/_shard/sharding_plan/test_sharding_plan (0.1875)
2025-03-14T03:52:41.3394997Z   distributed/_shard/sharding_spec/test_sharding_spec (0.1875)
2025-03-14T03:52:41.3395438Z   distributed/_shard/test_sharder (0.1875)
2025-03-14T03:52:41.3395810Z   distributed/_tools/test_fake_collectives (0.1875)
2025-03-14T03:52:41.3396240Z   distributed/_tools/test_fsdp2_mem_tracker (0.1875)
2025-03-14T03:52:41.3396724Z   distributed/_tools/test_mem_tracker (0.1875)
2025-03-14T03:52:41.3397120Z   distributed/_tools/test_memory_tracker (0.1875)
2025-03-14T03:52:41.3397519Z   distributed/_tools/test_mod_tracker (0.1875)
2025-03-14T03:52:41.3397929Z   distributed/_tools/test_runtime_estimator (0.1875)
2025-03-14T03:52:41.3398332Z   distributed/_tools/test_sac_estimator (0.1875)
2025-03-14T03:52:41.3398723Z   distributed/_tools/test_sac_ilp (0.1875)
2025-03-14T03:52:41.3399169Z   distributed/algorithms/ddp_comm_hooks/test_ddp_hooks (0.1875)
2025-03-14T03:52:41.3399719Z   distributed/algorithms/quantization/test_quantization (0.1875)
2025-03-14T03:52:41.3400181Z   distributed/algorithms/test_join (0.1875)
2025-03-14T03:52:41.3400600Z   distributed/checkpoint/e2e/test_e2e_save_and_load (0.1875)
2025-03-14T03:52:41.3401075Z   distributed/checkpoint/e2e/test_fine_tuning (0.1875)
2025-03-14T03:52:41.3401516Z   distributed/checkpoint/e2e/test_fsdp_ep (0.1875)
2025-03-14T03:52:41.3402048Z   distributed/checkpoint/e2e/test_pipeline (0.1875)
2025-03-14T03:52:41.3402486Z   distributed/checkpoint/fsdp/test_fsdp_dsd (0.1875)
2025-03-14T03:52:41.3402896Z   distributed/checkpoint/test_checkpoint (0.1875)
2025-03-14T03:52:41.3403330Z   distributed/checkpoint/test_compatibility (0.1875)
2025-03-14T03:52:41.3403766Z   distributed/checkpoint/test_dedup_tensors (0.1875)
2025-03-14T03:52:41.3404223Z   distributed/checkpoint/test_dtensor_checkpoint (0.1875)
2025-03-14T03:52:41.3404700Z   distributed/checkpoint/test_dtensor_resharding (0.1875)
2025-03-14T03:52:41.3405185Z   distributed/checkpoint/test_file_system_checkpoint (0.1875)
2025-03-14T03:52:41.3405723Z   distributed/checkpoint/test_file_system_checkpoint_cpu (0.1875)
2025-03-14T03:52:41.3406214Z   distributed/checkpoint/test_format_utils (0.1875)
2025-03-14T03:52:41.3406658Z   distributed/checkpoint/test_fsdp_model_state (0.1875)
2025-03-14T03:52:41.3407175Z   distributed/checkpoint/test_fsdp_tp_checkpoint_conversion (0.1875)
2025-03-14T03:52:41.3407675Z   distributed/checkpoint/test_fsspec (0.1875)
2025-03-14T03:52:41.3408058Z   distributed/checkpoint/test_hf_storage (0.1875)
2025-03-14T03:52:41.3408486Z   distributed/checkpoint/test_hsdp_checkpoint (0.1875)
2025-03-14T03:52:41.3408920Z   distributed/checkpoint/test_nested_dict (0.1875)
2025-03-14T03:52:41.3409324Z   distributed/checkpoint/test_planner (0.1875)
2025-03-14T03:52:41.3409733Z   distributed/checkpoint/test_save_load_api (0.1875)
2025-03-14T03:52:41.3410136Z   distributed/checkpoint/test_state_dict (0.1875)
2025-03-14T03:52:41.3410564Z   distributed/checkpoint/test_state_dict_utils (0.1875)
2025-03-14T03:52:41.3411006Z   distributed/checkpoint/test_tp_checkpoint (0.1875)
2025-03-14T03:52:41.3411425Z   distributed/checkpoint/test_traverse (0.1875)
2025-03-14T03:52:41.3411814Z   distributed/checkpoint/test_utils (0.1875)
2025-03-14T03:52:41.3412180Z   distributed/elastic/events/lib_test (0.1875)
2025-03-14T03:52:41.3412652Z   distributed/elastic/metrics/api_test (0.1875)
2025-03-14T03:52:41.3413090Z   distributed/elastic/multiprocessing/api_test (0.1875)
2025-03-14T03:52:41.3413515Z   distributed/elastic/timer/api_test (0.1875)
2025-03-14T03:52:41.3413941Z   distributed/elastic/timer/local_timer_example (0.1875)
2025-03-14T03:52:41.3414396Z   distributed/elastic/timer/local_timer_test (0.1875)
2025-03-14T03:52:41.3414821Z   distributed/elastic/utils/distributed_test (0.1875)
2025-03-14T03:52:41.3415243Z   distributed/elastic/utils/logging_test (0.1875)
2025-03-14T03:52:41.3415640Z   distributed/elastic/utils/util_test (0.1875)
2025-03-14T03:52:41.3416047Z   distributed/fsdp/test_checkpoint_wrapper (0.1875)
2025-03-14T03:52:41.3416494Z   distributed/fsdp/test_distributed_checkpoint (0.1875)
2025-03-14T03:52:41.3416896Z   distributed/fsdp/test_fsdp_apply (0.1875)
2025-03-14T03:52:41.3417303Z   distributed/fsdp/test_fsdp_backward_prefetch (0.1875)
2025-03-14T03:52:41.3417738Z   distributed/fsdp/test_fsdp_checkpoint (0.1875)
2025-03-14T03:52:41.3418159Z   distributed/fsdp/test_fsdp_clip_grad_norm (0.1875)
2025-03-14T03:52:41.3418613Z   distributed/fsdp/test_fsdp_comm (0.1875)
2025-03-14T03:52:41.3418978Z   distributed/fsdp/test_fsdp_comm_hooks (0.1875)
2025-03-14T03:52:41.3419375Z   distributed/fsdp/test_fsdp_exec_order (0.1875)
2025-03-14T03:52:41.3419775Z   distributed/fsdp/test_fsdp_fine_tune (0.1875)
2025-03-14T03:52:41.3420185Z   distributed/fsdp/test_fsdp_flatten_params (0.1875)
2025-03-14T03:52:41.3420625Z   distributed/fsdp/test_fsdp_freezing_weights (0.1875)
2025-03-14T03:52:41.3421018Z   distributed/fsdp/test_fsdp_fx (0.1875)
2025-03-14T03:52:41.3421389Z   distributed/fsdp/test_fsdp_grad_acc (0.1875)
2025-03-14T03:52:41.3421788Z   distributed/fsdp/test_fsdp_hybrid_shard (0.1875)
2025-03-14T03:52:41.3422214Z   distributed/fsdp/test_fsdp_ignored_modules (0.1875)
2025-03-14T03:52:41.3422618Z   distributed/fsdp/test_fsdp_input (0.1875)
2025-03-14T03:52:41.3422977Z   distributed/fsdp/test_fsdp_memory (0.1875)
2025-03-14T03:52:41.3423350Z   distributed/fsdp/test_fsdp_meta (0.1875)
2025-03-14T03:52:41.3423717Z   distributed/fsdp/test_fsdp_misc (0.1875)
2025-03-14T03:52:41.3424112Z   distributed/fsdp/test_fsdp_mixed_precision (0.1875)
2025-03-14T03:52:41.3424559Z   distributed/fsdp/test_fsdp_multiple_forward (0.1875)
2025-03-14T03:52:41.3425009Z   distributed/fsdp/test_fsdp_multiple_wrapping (0.1875)
2025-03-14T03:52:41.3425429Z   distributed/fsdp/test_fsdp_optim_state (0.1875)
2025-03-14T03:52:41.3425822Z   distributed/fsdp/test_fsdp_overlap (0.1875)
2025-03-14T03:52:41.3426244Z   distributed/fsdp/test_fsdp_sharded_grad_scaler (0.1875)
2025-03-14T03:52:41.3426783Z   distributed/fsdp/test_fsdp_state_dict (0.1875)
2025-03-14T03:52:41.3427200Z   distributed/fsdp/test_fsdp_tp_integration (0.1875)
2025-03-14T03:52:41.3427600Z   distributed/fsdp/test_fsdp_traversal (0.1875)
2025-03-14T03:52:41.3427988Z   distributed/fsdp/test_fsdp_uneven (0.1875)
2025-03-14T03:52:41.3428387Z   distributed/fsdp/test_fsdp_unshard_params (0.1875)
2025-03-14T03:52:41.3428826Z   distributed/fsdp/test_fsdp_use_orig_params (0.1875)
2025-03-14T03:52:41.3429275Z   distributed/fsdp/test_hsdp_dtensor_state_dict (0.1875)
2025-03-14T03:52:41.3429680Z   distributed/fsdp/test_shard_utils (0.1875)
2025-03-14T03:52:41.3430038Z   distributed/fsdp/test_utils (0.1875)
2025-03-14T03:52:41.3430382Z   distributed/fsdp/test_wrap (0.1875)
2025-03-14T03:52:41.3430746Z   distributed/nn/jit/test_instantiator (0.1875)
2025-03-14T03:52:41.3431201Z   distributed/optim/test_apply_optimizer_in_backward (0.1875)
2025-03-14T03:52:41.3431655Z   distributed/optim/test_named_optimizer (0.1875)
2025-03-14T03:52:41.3432110Z   distributed/optim/test_zero_redundancy_optimizer (0.1875)
2025-03-14T03:52:41.3432566Z   distributed/pipelining/test_backward (0.1875)
2025-03-14T03:52:41.3432974Z   distributed/pipelining/test_microbatch (0.1875)
2025-03-14T03:52:41.3433368Z   distributed/pipelining/test_pipe (0.1875)
2025-03-14T03:52:41.3433751Z   distributed/pipelining/test_schedule (0.1875)
2025-03-14T03:52:41.3434263Z   distributed/pipelining/test_schedule_multiproc (0.1875)
2025-03-14T03:52:41.3434701Z   distributed/pipelining/test_stage (0.1875)
2025-03-14T03:52:41.3435100Z   distributed/pipelining/test_transformer (0.1875)
2025-03-14T03:52:41.3435518Z   distributed/pipelining/test_unflatten (0.1875)
2025-03-14T03:52:41.3435943Z   distributed/rpc/cuda/test_tensorpipe_agent (0.1875)
2025-03-14T03:52:41.3436339Z   distributed/rpc/test_faulty_agent (0.1875)
2025-03-14T03:52:41.3436712Z   distributed/rpc/test_share_memory (0.1875)
2025-03-14T03:52:41.3437100Z   distributed/rpc/test_tensorpipe_agent (0.1875)
2025-03-14T03:52:41.3437509Z   distributed/tensor/debug/test_comm_mode (0.1875)
2025-03-14T03:52:41.3437967Z   distributed/tensor/debug/test_comm_mode_features (0.1875)
2025-03-14T03:52:41.3438417Z   distributed/tensor/debug/test_op_coverage (0.1875)
2025-03-14T03:52:41.3438872Z   distributed/tensor/experimental/test_local_map (0.1875)
2025-03-14T03:52:41.3439390Z   distributed/tensor/experimental/test_register_sharding (0.1875)
2025-03-14T03:52:41.3440010Z   distributed/tensor/experimental/test_tp_transform (0.1875)
2025-03-14T03:52:41.3440538Z   distributed/tensor/parallel/test_micro_pipeline_tp (0.1875)
2025-03-14T03:52:41.3441056Z   distributed/tensor/parallel/test_parallelize_api (0.1875)
2025-03-14T03:52:41.3441539Z   distributed/tensor/parallel/test_tp_examples (0.1875)
2025-03-14T03:52:41.3442122Z   distributed/tensor/parallel/test_tp_random_state (0.1875)
2025-03-14T03:52:41.3442589Z   distributed/tensor/parallel/test_tp_style (0.1875)
2025-03-14T03:52:41.3442971Z   distributed/tensor/test_api (0.1875)
2025-03-14T03:52:41.3443325Z   distributed/tensor/test_attention (0.1875)
2025-03-14T03:52:41.3443707Z   distributed/tensor/test_common_rules (0.1875)
2025-03-14T03:52:41.3444112Z   distributed/tensor/test_convolution_ops (0.1875)
2025-03-14T03:52:41.3444506Z   distributed/tensor/test_dtensor (0.1875)
2025-03-14T03:52:41.3444881Z   distributed/tensor/test_dtensor_compile (0.1875)
2025-03-14T03:52:41.3445289Z   distributed/tensor/test_dtensor_ops (0.1875)
2025-03-14T03:52:41.3445687Z   distributed/tensor/test_embedding_ops (0.1875)
2025-03-14T03:52:41.3446099Z   distributed/tensor/test_experimental_ops (0.1875)
2025-03-14T03:52:41.3446488Z   distributed/tensor/test_init (0.1875)
2025-03-14T03:52:41.3446830Z   distributed/tensor/test_math_ops (0.1875)
2025-03-14T03:52:41.3447200Z   distributed/tensor/test_matrix_ops (0.1875)
2025-03-14T03:52:41.3447582Z   distributed/tensor/test_op_strategy (0.1875)
2025-03-14T03:52:41.3447971Z   distributed/tensor/test_optimizers (0.1875)
2025-03-14T03:52:41.3448364Z   distributed/tensor/test_pointwise_ops (0.1875)
2025-03-14T03:52:41.3448742Z   distributed/tensor/test_random_ops (0.1875)
2025-03-14T03:52:41.3449129Z   distributed/tensor/test_redistribute (0.1875)
2025-03-14T03:52:41.3449516Z   distributed/tensor/test_tensor_ops (0.1875)
2025-03-14T03:52:41.3449880Z   distributed/tensor/test_utils (0.1875)
2025-03-14T03:52:41.3450234Z   distributed/tensor/test_view_ops (0.1875)
2025-03-14T03:52:41.3450614Z   distributed/tensor/test_xla_integration (0.1875)
2025-03-14T03:52:41.3451000Z   distributed/test_backends (0.1875)
2025-03-14T03:52:41.3451347Z   distributed/test_collective_utils (0.1875)
2025-03-14T03:52:41.3451717Z   distributed/test_composability (0.1875)
2025-03-14T03:52:41.3452094Z   distributed/test_control_collectives (0.1875)
2025-03-14T03:52:41.3452461Z   distributed/test_data_parallel (0.1875)
2025-03-14T03:52:41.3452815Z   distributed/test_device_mesh (0.1875)
2025-03-14T03:52:41.3453178Z   distributed/test_dynamo_distributed (0.1875)
2025-03-14T03:52:41.3453540Z   distributed/test_fake_pg (0.1875)
2025-03-14T03:52:41.3453882Z   distributed/test_functional_api (0.1875)
2025-03-14T03:52:41.3454242Z   distributed/test_multi_threaded_pg (0.1875)
2025-03-14T03:52:41.3454600Z   distributed/test_nccl (0.1875)
2025-03-14T03:52:41.3454923Z   distributed/test_pg_wrapper (0.1875)
2025-03-14T03:52:41.3455271Z   distributed/test_serialization (0.1875)
2025-03-14T03:52:41.3455710Z   distributed/test_store (0.1875)
2025-03-14T03:52:41.3456042Z   inductor/test_distributed_patterns (0.1875)
2025-03-14T03:52:41.3456454Z   inductor/test_compiled_autograd (0.05746820771864853)
2025-03-14T03:52:41.3456849Z   test_nestedtensor (0.03291130838512911)
2025-03-14T03:52:41.3457211Z   test_ci_sanity_check_fail (0.029620177546616205)
2025-03-14T03:52:41.3457571Z   test_torch (0.029620177546616205)
2025-03-14T03:52:41.3457887Z   test_autograd (0.02632904670810329)
2025-03-14T03:52:41.3458211Z   dynamo/test_interop (0.01974678503107747)
2025-03-14T03:52:41.3458575Z   inductor/test_debug_trace (0.01974678503107747)
2025-03-14T03:52:41.3458952Z   inductor/test_indexing (0.01974678503107747)
2025-03-14T03:52:41.3459312Z   test_autoload_disable (0.01974678503107747)
2025-03-14T03:52:41.3459698Z   test_model_exports_to_core_aten (0.01974678503107747)
2025-03-14T03:52:41.3460059Z   test_modules (0.01974678503107747)
2025-03-14T03:52:41.3460378Z   test_reductions (0.013164523354051645)
2025-03-14T03:52:41.3460747Z   inductor/test_cudacodecache (0.01114737864657599)
2025-03-14T03:52:41.3461185Z   functorch/test_dims (0.009873392515538735)
2025-03-14T03:52:41.3461595Z   inductor/test_aot_inductor_arrayref (0.009873392515538735)
2025-03-14T03:52:41.3461988Z   test_foreach (0.007898714012430988)
2025-03-14T03:52:41.3462328Z   lazy/test_step_closures (0.006582261677025822)
2025-03-14T03:52:41.3462684Z   test_dataloader (0.006582261677025822)
2025-03-14T03:52:41.3463024Z   test_transformers (0.006582261677025822)
2025-03-14T03:52:41.3463387Z   functorch/test_rearrange (0.005641938580307848)
2025-03-14T03:52:41.3463796Z   inductor/test_cpp_wrapper_hipify (0.005641938580307848)
2025-03-14T03:52:41.3464195Z   test_mkl_verbose (0.0017951622755524972)
2025-03-14T03:52:41.3464575Z   inductor/test_torchinductor (0.0013164523354051647)
2025-03-14T03:52:41.3464944Z   test_ops (0.0008402887247267008)
2025-03-14T03:52:41.3465279Z   test_multiprocessing (0.0005215197250349337)
2025-03-14T03:52:41.3465612Z   test_cuda (0.0004701615483589873)
2025-03-14T03:52:41.3465937Z   test_accelerator (0.00014257606520633553)
2025-03-14T03:52:41.3466318Z   functorch/test_control_flow (9.184551177245334e-05)
2025-03-14T03:52:41.3466730Z   inductor/test_aot_inductor (8.975811377762486e-05)
2025-03-14T03:52:41.3467132Z   inductor/test_cpu_repro (8.975811377762486e-05)
2025-03-14T03:52:41.6783237Z   inductor/test_minifier (8.975811377762486e-05)
2025-03-14T03:52:41.6783616Z Emitting metrics
2025-03-14T03:52:41.6784355Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_results_final_test_prioritizations_1741924361_c7586a1a008711f0839c16ffd9fe7c2f
2025-03-14T03:52:41.6785660Z Done! Finish writing document to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_results_final_test_prioritizations_1741924361_c7586a1a008711f0839c16ffd9fe7c2f 
2025-03-14T03:52:41.6786933Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_results_aggregated_heuristics_1741924361_c7792c46008711f0839c16ffd9fe7c2f
2025-03-14T03:52:41.6788221Z Done! Finish writing document to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_results_aggregated_heuristics_1741924361_c7792c46008711f0839c16ffd9fe7c2f 
2025-03-14T03:52:41.7532154Z ##[group]Run seemethere/upload-artifact-s3@v5
2025-03-14T03:52:41.7532541Z with:
2025-03-14T03:52:41.7532759Z   name: td_results
2025-03-14T03:52:41.7533012Z   retention-days: 14
2025-03-14T03:52:41.7533285Z   if-no-files-found: error
2025-03-14T03:52:41.7533579Z   path: td_results.json
2025-03-14T03:52:41.7533855Z   s3-bucket: gha-artifacts
2025-03-14T03:52:41.7534125Z   region: us-east-1
2025-03-14T03:52:41.7534371Z ##[endgroup]
2025-03-14T03:52:42.1091150Z With the provided path, there will be 1 file uploaded
2025-03-14T03:52:42.1091668Z Uploading to s3 prefix: pytorch/pytorch/13849515261/td_results
2025-03-14T03:52:42.1130693Z Starting upload of td_results.json
2025-03-14T03:52:42.3027359Z Finished upload of td_results.json
2025-03-14T03:52:42.3232076Z ##[group]Run actions/upload-artifact@v4
2025-03-14T03:52:42.3232569Z with:
2025-03-14T03:52:42.3232804Z   name: td_results.json
2025-03-14T03:52:42.3233077Z   retention-days: 14
2025-03-14T03:52:42.3233353Z   if-no-files-found: error
2025-03-14T03:52:42.3233645Z   path: td_results.json
2025-03-14T03:52:42.3233914Z   compression-level: 6
2025-03-14T03:52:42.3234183Z   overwrite: false
2025-03-14T03:52:42.3234448Z   include-hidden-files: false
2025-03-14T03:52:42.3234747Z ##[endgroup]
2025-03-14T03:52:42.5641356Z With the provided path, there will be 1 file uploaded
2025-03-14T03:52:42.5645607Z Artifact name is valid!
2025-03-14T03:52:42.5646717Z Root directory input is valid!
2025-03-14T03:52:42.6422992Z Beginning upload of artifact content to blob storage
2025-03-14T03:52:42.7299927Z Uploaded bytes 7101
2025-03-14T03:52:42.7536791Z Finished uploading artifact content to blob storage!
2025-03-14T03:52:42.7539849Z SHA256 hash of uploaded artifact zip is a5c9fd17fccb7a0e01749323c9f49b7261ba448161640a50e258bc37a609218f
2025-03-14T03:52:42.7541701Z Finalizing artifact upload
2025-03-14T03:52:42.8200056Z Artifact td_results.json.zip successfully finalized. Artifact ID 2750402891
2025-03-14T03:52:42.8201492Z Artifact td_results.json has been successfully uploaded! Final size is 7101 bytes. Artifact ID is 2750402891
2025-03-14T03:52:42.8209056Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/13849515261/artifacts/2750402891
2025-03-14T03:52:42.8357542Z Post job cleanup.
2025-03-14T03:52:42.8411394Z Post job cleanup.
2025-03-14T03:52:42.9374056Z [command]/usr/bin/git version
2025-03-14T03:52:42.9411833Z git version 2.47.1
2025-03-14T03:52:42.9449313Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/b74e1a08-8065-4397-bf0d-841bdb0ba6d4/.gitconfig'
2025-03-14T03:52:42.9458526Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/b74e1a08-8065-4397-bf0d-841bdb0ba6d4' before making global git config changes
2025-03-14T03:52:42.9460384Z Adding repository directory to the temporary git global config as a safe directory
2025-03-14T03:52:42.9464068Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T03:52:42.9505918Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-03-14T03:52:42.9544884Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-03-14T03:52:42.9824310Z Entering 'android/libs/fbjni'
2025-03-14T03:52:42.9878648Z Entering 'third_party/FP16'
2025-03-14T03:52:42.9931072Z Entering 'third_party/FXdiv'
2025-03-14T03:52:42.9983205Z Entering 'third_party/NNPACK'
2025-03-14T03:52:43.0034974Z Entering 'third_party/NVTX'
2025-03-14T03:52:43.0087867Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T03:52:43.0139426Z Entering 'third_party/XNNPACK'
2025-03-14T03:52:43.0207776Z Entering 'third_party/benchmark'
2025-03-14T03:52:43.0257806Z Entering 'third_party/composable_kernel'
2025-03-14T03:52:43.0314688Z Entering 'third_party/cpp-httplib'
2025-03-14T03:52:43.0364870Z Entering 'third_party/cpuinfo'
2025-03-14T03:52:43.0415468Z Entering 'third_party/cudnn_frontend'
2025-03-14T03:52:43.0464958Z Entering 'third_party/cutlass'
2025-03-14T03:52:43.0523010Z Entering 'third_party/eigen'
2025-03-14T03:52:43.0574960Z Entering 'third_party/fbgemm'
2025-03-14T03:52:43.0626569Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T03:52:43.0677400Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T03:52:43.0728598Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T03:52:43.0786271Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T03:52:43.0837467Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T03:52:43.0891310Z Entering 'third_party/flash-attention'
2025-03-14T03:52:43.0973016Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T03:52:43.1000318Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T03:52:43.1059376Z Entering 'third_party/flatbuffers'
2025-03-14T03:52:43.1115321Z Entering 'third_party/fmt'
2025-03-14T03:52:43.1166793Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T03:52:43.1218086Z Entering 'third_party/gloo'
2025-03-14T03:52:43.1267849Z Entering 'third_party/googletest'
2025-03-14T03:52:43.1319218Z Entering 'third_party/ideep'
2025-03-14T03:52:43.1368885Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T03:52:43.1426819Z Entering 'third_party/ittapi'
2025-03-14T03:52:43.1476466Z Entering 'third_party/kineto'
2025-03-14T03:52:43.1526081Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T03:52:43.1574662Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T03:52:43.1625792Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T03:52:43.1675739Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T03:52:43.1726651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T03:52:43.1775635Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T03:52:43.1827799Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T03:52:43.1878253Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T03:52:43.1930462Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T03:52:43.1980689Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T03:52:43.2031259Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T03:52:43.2080421Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T03:52:43.2132126Z Entering 'third_party/kleidiai'
2025-03-14T03:52:43.2184688Z Entering 'third_party/mimalloc'
2025-03-14T03:52:43.2235072Z Entering 'third_party/nlohmann'
2025-03-14T03:52:43.2286945Z Entering 'third_party/onnx'
2025-03-14T03:52:43.2353824Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T03:52:43.2407353Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T03:52:43.2460529Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T03:52:43.2510843Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T03:52:43.2561348Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T03:52:43.2610789Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T03:52:43.2662288Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T03:52:43.2711350Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T03:52:43.2759601Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T03:52:43.2809599Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T03:52:43.2861528Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T03:52:43.2914112Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T03:52:43.2985857Z Entering 'third_party/pocketfft'
2025-03-14T03:52:43.3037656Z Entering 'third_party/protobuf'
2025-03-14T03:52:43.3090810Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T03:52:43.3140398Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T03:52:43.3194262Z Entering 'third_party/psimd'
2025-03-14T03:52:43.3245536Z Entering 'third_party/pthreadpool'
2025-03-14T03:52:43.3295589Z Entering 'third_party/pybind11'
2025-03-14T03:52:43.3345778Z Entering 'third_party/python-peachpy'
2025-03-14T03:52:43.3396957Z Entering 'third_party/sleef'
2025-03-14T03:52:43.3448274Z Entering 'third_party/tensorpipe'
2025-03-14T03:52:43.3498001Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T03:52:43.3547251Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T03:52:43.3596035Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T03:52:43.3645153Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T03:52:43.3693785Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T03:52:43.3763382Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-03-14T03:52:43.3784189Z http.https://github.com/.extraheader
2025-03-14T03:52:43.3794677Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2025-03-14T03:52:43.3824618Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-03-14T03:52:43.4095492Z Entering 'android/libs/fbjni'
2025-03-14T03:52:43.4147630Z Entering 'third_party/FP16'
2025-03-14T03:52:43.4198630Z Entering 'third_party/FXdiv'
2025-03-14T03:52:43.4249606Z Entering 'third_party/NNPACK'
2025-03-14T03:52:43.4300196Z Entering 'third_party/NVTX'
2025-03-14T03:52:43.4350964Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T03:52:43.4402773Z Entering 'third_party/XNNPACK'
2025-03-14T03:52:43.4468786Z Entering 'third_party/benchmark'
2025-03-14T03:52:43.4520007Z Entering 'third_party/composable_kernel'
2025-03-14T03:52:43.4577516Z Entering 'third_party/cpp-httplib'
2025-03-14T03:52:43.4629914Z Entering 'third_party/cpuinfo'
2025-03-14T03:52:43.4681040Z Entering 'third_party/cudnn_frontend'
2025-03-14T03:52:43.4731324Z Entering 'third_party/cutlass'
2025-03-14T03:52:43.4790467Z Entering 'third_party/eigen'
2025-03-14T03:52:43.4842864Z Entering 'third_party/fbgemm'
2025-03-14T03:52:43.4894755Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T03:52:43.4944282Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T03:52:43.4992738Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T03:52:43.5048160Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T03:52:43.5097411Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T03:52:43.5147875Z Entering 'third_party/flash-attention'
2025-03-14T03:52:43.5200322Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T03:52:43.5255490Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T03:52:43.5313565Z Entering 'third_party/flatbuffers'
2025-03-14T03:52:43.5367917Z Entering 'third_party/fmt'
2025-03-14T03:52:43.5419067Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T03:52:43.5470159Z Entering 'third_party/gloo'
2025-03-14T03:52:43.5521822Z Entering 'third_party/googletest'
2025-03-14T03:52:43.5572130Z Entering 'third_party/ideep'
2025-03-14T03:52:43.5622398Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T03:52:43.5681262Z Entering 'third_party/ittapi'
2025-03-14T03:52:43.5732256Z Entering 'third_party/kineto'
2025-03-14T03:52:43.5783500Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T03:52:43.5832733Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T03:52:43.5883932Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T03:52:43.5932871Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T03:52:43.5981685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T03:52:43.6029324Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T03:52:43.6082183Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T03:52:43.6131632Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T03:52:43.6181450Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T03:52:43.6232863Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T03:52:43.6284105Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T03:52:43.6333401Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T03:52:43.6384906Z Entering 'third_party/kleidiai'
2025-03-14T03:52:43.6436932Z Entering 'third_party/mimalloc'
2025-03-14T03:52:43.6489135Z Entering 'third_party/nlohmann'
2025-03-14T03:52:43.6541069Z Entering 'third_party/onnx'
2025-03-14T03:52:43.6607307Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T03:52:43.6660039Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T03:52:43.6714182Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T03:52:43.6763040Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T03:52:43.6811804Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T03:52:43.6859923Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T03:52:43.6910240Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T03:52:43.6958218Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T03:52:43.7007880Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T03:52:43.7056281Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T03:52:43.7108074Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T03:52:43.7159317Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T03:52:43.7230789Z Entering 'third_party/pocketfft'
2025-03-14T03:52:43.7282286Z Entering 'third_party/protobuf'
2025-03-14T03:52:43.7335654Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T03:52:43.7386335Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T03:52:43.7437976Z Entering 'third_party/psimd'
2025-03-14T03:52:43.7489360Z Entering 'third_party/pthreadpool'
2025-03-14T03:52:43.7539379Z Entering 'third_party/pybind11'
2025-03-14T03:52:43.7591165Z Entering 'third_party/python-peachpy'
2025-03-14T03:52:43.7641409Z Entering 'third_party/sleef'
2025-03-14T03:52:43.7691830Z Entering 'third_party/tensorpipe'
2025-03-14T03:52:43.7741146Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T03:52:43.7791060Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T03:52:43.7840115Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T03:52:43.7890550Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T03:52:43.7938488Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T03:52:43.8070899Z A job completed hook has been configured by the self-hosted runner administrator
2025-03-14T03:52:43.8096430Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2025-03-14T03:52:43.8101646Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T03:52:43.8102046Z ##[endgroup]
2025-03-14T03:52:43.8179792Z [!ALERT!] Swap in detected! [!ALERT!]
2025-03-14T03:52:54.8485964Z [!ALERT!] Swap out detected [!ALERT!]
2025-03-14T03:53:12.2723945Z Cleaning up orphan processes