2025-03-14T04:12:09.4874188Z Current runner version: '2.322.0'
2025-03-14T04:12:09.4880109Z Runner name: 'i-049962b53c600fa33'
2025-03-14T04:12:09.4880744Z Runner group name: 'Default'
2025-03-14T04:12:09.4881582Z Machine name: 'ip-10-0-59-39'
2025-03-14T04:12:09.4884837Z ##[group]GITHUB_TOKEN Permissions
2025-03-14T04:12:09.4887044Z Actions: read
2025-03-14T04:12:09.4887634Z Attestations: read
2025-03-14T04:12:09.4888106Z Checks: read
2025-03-14T04:12:09.4888564Z Contents: read
2025-03-14T04:12:09.4889038Z Deployments: read
2025-03-14T04:12:09.4889507Z Discussions: read
2025-03-14T04:12:09.4889954Z Issues: read
2025-03-14T04:12:09.4890427Z Metadata: read
2025-03-14T04:12:09.4890884Z Packages: read
2025-03-14T04:12:09.4891336Z Pages: read
2025-03-14T04:12:09.4891803Z PullRequests: read
2025-03-14T04:12:09.4892369Z RepositoryProjects: read
2025-03-14T04:12:09.4892899Z SecurityEvents: read
2025-03-14T04:12:09.4893382Z Statuses: read
2025-03-14T04:12:09.4893810Z ##[endgroup]
2025-03-14T04:12:09.4896678Z Secret source: Actions
2025-03-14T04:12:09.4897396Z Prepare workflow directory
2025-03-14T04:12:09.8568950Z Prepare all required actions
2025-03-14T04:12:09.8604148Z Getting action download info
2025-03-14T04:12:10.0486951Z Download action repository 'pytorch/test-infra@main' (SHA:de00dac6adc071cb2f9861380a0ed3947b93e5cc)
2025-03-14T04:12:11.6625511Z Download action repository 'pytorch/pytorch@main' (SHA:e5679009988279a3059f398ed2077a0477099ba6)
2025-03-14T04:12:26.3719662Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0)
2025-03-14T04:12:26.6378430Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a)
2025-03-14T04:12:26.9046656Z Getting action download info
2025-03-14T04:12:27.0082468Z Download action repository 'actions/checkout@v4' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683)
2025-03-14T04:12:27.2259307Z Getting action download info
2025-03-14T04:12:27.3170200Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e)
2025-03-14T04:12:27.5079435Z Getting action download info
2025-03-14T04:12:27.6279735Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482)
2025-03-14T04:12:27.8523109Z Getting action download info
2025-03-14T04:12:27.9560987Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/main (aed0b7a742a2d7b7901790622829cbd2135049a4)
2025-03-14T04:12:27.9562713Z ##[group] Inputs
2025-03-14T04:12:27.9562982Z   build-environment: linux-jammy-py3.9-gcc11-build
2025-03-14T04:12:27.9564611Z   test-matrix: {"include": [{"config": "cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "inductor_torchbench_cpu_smoketest_perf", "shard": 1, "num_shards": 1, "runner": "linux.24xl.spr-metal"}]}
2025-03-14T04:12:27.9566415Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:27.9566924Z   sync-tag: 
2025-03-14T04:12:27.9567780Z   timeout-minutes: 240
2025-03-14T04:12:27.9567979Z   use-gha: 
2025-03-14T04:12:27.9568156Z   dashboard-tag: 
2025-03-14T04:12:27.9568342Z   s3-bucket: gha-artifacts
2025-03-14T04:12:27.9568547Z   aws-role-to-assume: 
2025-03-14T04:12:27.9569168Z   disable-monitor: false
2025-03-14T04:12:27.9569451Z ##[endgroup]
2025-03-14T04:12:27.9569813Z Complete job name: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:12:27.9955697Z A job started hook has been configured by the self-hosted runner administrator
2025-03-14T04:12:28.0025792Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh'
2025-03-14T04:12:28.0032223Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:28.0032678Z ##[endgroup]
2025-03-14T04:12:29.1532742Z Runner Type: linux.8xlarge.amx
2025-03-14T04:12:29.1533190Z Instance Type: m7i-flex.8xlarge
2025-03-14T04:12:29.1533408Z AMI Name: unknown
2025-03-14T04:12:29.1557410Z AMI ID: ami-08b5b3a93ed654d19
2025-03-14T04:12:33.1580780Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main
2025-03-14T04:12:33.1581099Z with:
2025-03-14T04:12:33.1581711Z   github-secret: ***
2025-03-14T04:12:33.1582162Z   instructions: All testing is done inside the container, to start an interactive session run:
  docker exec -it $(docker container ps --format '{{.ID}}') bash

2025-03-14T04:12:33.1582643Z   activate-with-label: false
2025-03-14T04:12:33.1582848Z   label: with-ssh
2025-03-14T04:12:33.1583034Z   remove-existing-keys: true
2025-03-14T04:12:33.1583232Z   fail-silently: true
2025-03-14T04:12:33.1583438Z env:
2025-03-14T04:12:33.1583604Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:33.1583805Z ##[endgroup]
2025-03-14T04:12:33.2531120Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info.
2025-03-14T04:12:33.2532372Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys
2025-03-14T04:12:33.2673153Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main
2025-03-14T04:12:33.2673497Z with:
2025-03-14T04:12:33.2673694Z   no-sudo: true
2025-03-14T04:12:33.2673893Z   submodules: recursive
2025-03-14T04:12:33.2674112Z   fetch-depth: 0
2025-03-14T04:12:33.2674303Z env:
2025-03-14T04:12:33.2674485Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:33.2674699Z ##[endgroup]
2025-03-14T04:12:33.2745793Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:12:33.2746376Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:12:33.2753447Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:33.2753712Z env:
2025-03-14T04:12:33.2753914Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:33.2754157Z ##[endgroup]
2025-03-14T04:12:33.2836574Z ##[group]Run # Use all available CPUs for fetching
2025-03-14T04:12:33.2836893Z # Use all available CPUs for fetching
2025-03-14T04:12:33.2837134Z cd "${GITHUB_WORKSPACE}"
2025-03-14T04:12:33.2837375Z git config --global fetch.parallel 0
2025-03-14T04:12:33.2837638Z git config --global submodule.fetchJobs 0
2025-03-14T04:12:33.2837879Z 
2025-03-14T04:12:33.2838204Z # Clean workspace. The default checkout action should also do this, but
2025-03-14T04:12:33.2838526Z # do it here as well just in case
2025-03-14T04:12:33.2838745Z if [[ -d .git ]]; then
2025-03-14T04:12:33.2838954Z   if [ -z "${NO_SUDO}" ]; then
2025-03-14T04:12:33.2839167Z     sudo git clean -ffdx
2025-03-14T04:12:33.2839362Z   else
2025-03-14T04:12:33.2839539Z     git clean -ffdx
2025-03-14T04:12:33.2839729Z   fi
2025-03-14T04:12:33.2839895Z fi
2025-03-14T04:12:33.2843692Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:33.2843947Z env:
2025-03-14T04:12:33.2844123Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:33.2844315Z   NO_SUDO: true
2025-03-14T04:12:33.2844486Z ##[endgroup]
2025-03-14T04:12:33.3519451Z Removing .additional_ci_files/
2025-03-14T04:12:33.3521852Z Removing benchmarks/dynamo/__pycache__/
2025-03-14T04:12:33.3522166Z Removing build/
2025-03-14T04:12:33.3522863Z Removing dist/
2025-03-14T04:12:33.3523261Z Removing logs-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38753239279.zip
2025-03-14T04:12:33.3523906Z Removing test-jsons-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38753239279.zip
2025-03-14T04:12:33.3524374Z Removing test-reports-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38753239279.zip
2025-03-14T04:12:33.3524717Z Removing test/test-reports/
2025-03-14T04:12:33.3524930Z Removing tools/__pycache__/
2025-03-14T04:12:33.3525136Z Removing tools/stats/__pycache__/
2025-03-14T04:12:33.3525410Z Removing tools/stats/upload_utilization_stats/__pycache__/
2025-03-14T04:12:33.3525709Z Removing usage_log.txt
2025-03-14T04:12:33.3590393Z ##[group]Run actions/checkout@v4
2025-03-14T04:12:33.3590629Z with:
2025-03-14T04:12:33.3590826Z   ref: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:12:33.3591058Z   fetch-depth: 0
2025-03-14T04:12:33.3591256Z   submodules: recursive
2025-03-14T04:12:33.3591661Z   show-progress: false
2025-03-14T04:12:33.3591876Z   repository: pytorch/pytorch
2025-03-14T04:12:33.3592208Z   token: ***
2025-03-14T04:12:33.3592403Z   ssh-strict: true
2025-03-14T04:12:33.3592575Z   ssh-user: git
2025-03-14T04:12:33.3592756Z   persist-credentials: true
2025-03-14T04:12:33.3592951Z   clean: true
2025-03-14T04:12:33.3593135Z   sparse-checkout-cone-mode: true
2025-03-14T04:12:33.3593342Z   fetch-tags: false
2025-03-14T04:12:33.3593515Z   lfs: false
2025-03-14T04:12:33.3593680Z   set-safe-directory: true
2025-03-14T04:12:33.3593869Z env:
2025-03-14T04:12:33.3594033Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:33.3594404Z ##[endgroup]
2025-03-14T04:12:33.4483558Z Syncing repository: pytorch/pytorch
2025-03-14T04:12:33.4484581Z ##[group]Getting Git version info
2025-03-14T04:12:33.4484903Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2025-03-14T04:12:33.4485336Z [command]/usr/bin/git version
2025-03-14T04:12:33.4485540Z git version 2.47.1
2025-03-14T04:12:33.4500204Z ##[endgroup]
2025-03-14T04:12:33.4508021Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/1d9fbf1f-78a6-43c5-9c0c-43325ddd8697/.gitconfig'
2025-03-14T04:12:33.4527429Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/1d9fbf1f-78a6-43c5-9c0c-43325ddd8697' before making global git config changes
2025-03-14T04:12:33.4531965Z Adding repository directory to the temporary git global config as a safe directory
2025-03-14T04:12:33.4536789Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T04:12:33.4567587Z [command]/usr/bin/git config --local --get remote.origin.url
2025-03-14T04:12:33.4588174Z https://github.com/pytorch/pytorch
2025-03-14T04:12:33.4613574Z ##[group]Removing previously created refs, to avoid conflicts
2025-03-14T04:12:33.4617680Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD
2025-03-14T04:12:33.4637380Z HEAD
2025-03-14T04:12:33.4667085Z ##[endgroup]
2025-03-14T04:12:33.4667409Z [command]/usr/bin/git submodule status
2025-03-14T04:12:33.4980725Z  7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe)
2025-03-14T04:12:33.5045615Z  4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081)
2025-03-14T04:12:33.5109285Z  b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327)
2025-03-14T04:12:33.5188644Z  c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0)
2025-03-14T04:12:33.5210474Z  e170594ac7cf1dac584da473d4ca9301087090c1 third_party/NVTX (v3.1.0)
2025-03-14T04:12:33.5271848Z  a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 third_party/VulkanMemoryAllocator (v2.1.0-705-ga6bfc23)
2025-03-14T04:12:33.5726810Z  51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a010365)
2025-03-14T04:12:33.5740682Z  0d98dba29d66e93259db7daa53a9327df767a415 third_party/benchmark (v1.6.1)
2025-03-14T04:12:33.5759845Z  8086bbe3a78d931eb96fe12fdc014082e18d18d3 third_party/composable_kernel (mock-tag-test-6-g8086bbe3a)
2025-03-14T04:12:33.5881253Z  3b6597bba913d51161383657829b7e644e59c006 third_party/cpp-httplib (v0.15.3-20-g3b6597b)
2025-03-14T04:12:33.5969608Z  1e83a2fdd3102f65c6f1fb602c1b320486218a99 third_party/cpuinfo (1e83a2f)
2025-03-14T04:12:33.6016833Z  91b7532f3386768bba4f444ee7672b497f34da8a third_party/cudnn_frontend (v0.5-44-g91b7532)
2025-03-14T04:12:33.6082380Z  afa1772203677c5118fcd82537a9c8fefbcc7008 third_party/cutlass (v3.8.0)
2025-03-14T04:12:33.6641308Z  3147391d946bb4b6c68edd901f2add6ac1f31f8c third_party/eigen (3.4.0)
2025-03-14T04:12:33.6946181Z  dbc3157bf256f1339b3fa1fef2be89ac4078be0e third_party/fbgemm (v0.4.1-446-gdbc3157b)
2025-03-14T04:12:33.7023719Z  979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4)
2025-03-14T04:12:33.7042983Z  01834de25e4bf3975a9a00e816292b1ad0fe184b third_party/flatbuffers (v23.3.3)
2025-03-14T04:12:33.7396830Z  123913715afeb8a437e6388b4473fcc4753e1c9a third_party/fmt (11.1.4)
2025-03-14T04:12:33.7488620Z  3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17)
2025-03-14T04:12:33.7590472Z  5354032ea08eadd7fc4456477f7f7c6308818509 third_party/gloo (5354032)
2025-03-14T04:12:33.7796946Z  b514bdc898e2951020cbdca1304b75f5950d1f59 third_party/googletest (release-1.8.0-3484-gb514bdc8)
2025-03-14T04:12:33.7867245Z  719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1)
2025-03-14T04:12:33.7919091Z  5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 third_party/ittapi (v3.23.0-14-g5b8a7d7)
2025-03-14T04:12:33.8142446Z  2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 third_party/kineto (remotes/origin/sraikund/test-53-g2859721)
2025-03-14T04:12:33.8164576Z  ef685a13cfbe8d418aa2ed34350e21e4938358b6 third_party/kleidiai (v1.3.0)
2025-03-14T04:12:33.8181125Z  b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 third_party/mimalloc (v1.8.2)
2025-03-14T04:12:33.8598053Z  87cda1d6646592ac5866dc703c8e1839046a6806 third_party/nlohmann (v3.10.1-113-g87cda1d6)
2025-03-14T04:12:33.8855181Z  b8baa8446686496da4cc8fda09f2b6fe65c2a02c third_party/onnx (v1.17.0)
2025-03-14T04:12:33.8874881Z  a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2)
2025-03-14T04:12:33.8898381Z  9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe third_party/pocketfft (release_for_eigen-11-g9d3ab05)
2025-03-14T04:12:33.9254259Z  d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b)
2025-03-14T04:12:33.9317582Z  072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master)
2025-03-14T04:12:33.9365039Z  4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e)
2025-03-14T04:12:33.9409150Z  a2e59f0e7065404b44dfe92a28aca47ba1378dc4 third_party/pybind11 (v2.11.0-182-ga2e59f0e)
2025-03-14T04:12:33.9467124Z  f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated)
2025-03-14T04:12:33.9564169Z  56e1f79cb140fb9326d612d0be06b5250565cade third_party/sleef (3.7-33-g56e1f79)
2025-03-14T04:12:33.9622586Z  52791a2fd214b2a9dc5759d36725909c1daa7f2e third_party/tensorpipe (remotes/origin/master)
2025-03-14T04:12:33.9632454Z ##[group]Cleaning the repository
2025-03-14T04:12:33.9642934Z [command]/usr/bin/git clean -ffdx
2025-03-14T04:12:33.9796106Z [command]/usr/bin/git reset --hard HEAD
2025-03-14T04:12:34.9103662Z HEAD is now at b4745db9048 [MPS] Add support for `i0e` in eager. (#149174)
2025-03-14T04:12:34.9141969Z ##[endgroup]
2025-03-14T04:12:34.9143154Z ##[group]Disabling automatic garbage collection
2025-03-14T04:12:34.9148383Z [command]/usr/bin/git config --local gc.auto 0
2025-03-14T04:12:34.9186389Z ##[endgroup]
2025-03-14T04:12:34.9187020Z ##[group]Setting up auth
2025-03-14T04:12:34.9188013Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-03-14T04:12:34.9220715Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-03-14T04:12:34.9500273Z Entering 'android/libs/fbjni'
2025-03-14T04:12:34.9549492Z Entering 'third_party/FP16'
2025-03-14T04:12:34.9600486Z Entering 'third_party/FXdiv'
2025-03-14T04:12:34.9646309Z Entering 'third_party/NNPACK'
2025-03-14T04:12:34.9696585Z Entering 'third_party/NVTX'
2025-03-14T04:12:34.9746346Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:34.9795077Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:34.9859572Z Entering 'third_party/benchmark'
2025-03-14T04:12:34.9907925Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:34.9957287Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:35.0008515Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:35.0053217Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:35.0104033Z Entering 'third_party/cutlass'
2025-03-14T04:12:35.0171071Z Entering 'third_party/eigen'
2025-03-14T04:12:35.0220812Z Entering 'third_party/fbgemm'
2025-03-14T04:12:35.0266662Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:35.0311986Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:35.0357054Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:35.0409094Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:35.0452484Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:35.0506921Z Entering 'third_party/flash-attention'
2025-03-14T04:12:35.0553552Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:35.0606726Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:35.0657840Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:35.0708392Z Entering 'third_party/fmt'
2025-03-14T04:12:35.0755145Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:35.0805860Z Entering 'third_party/gloo'
2025-03-14T04:12:35.0855690Z Entering 'third_party/googletest'
2025-03-14T04:12:35.0903424Z Entering 'third_party/ideep'
2025-03-14T04:12:35.0951142Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:35.1007346Z Entering 'third_party/ittapi'
2025-03-14T04:12:35.1053932Z Entering 'third_party/kineto'
2025-03-14T04:12:35.1101618Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:35.1147184Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:35.1199493Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:35.1245600Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:35.1295021Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:35.1341381Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:35.1387188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:35.1434842Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:35.1482667Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:35.1531810Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:35.1584467Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:35.1631753Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:35.1697350Z Entering 'third_party/kleidiai'
2025-03-14T04:12:35.1734070Z Entering 'third_party/mimalloc'
2025-03-14T04:12:35.1784472Z Entering 'third_party/nlohmann'
2025-03-14T04:12:35.1831604Z Entering 'third_party/onnx'
2025-03-14T04:12:35.1892629Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:35.1944395Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:35.1993850Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:35.2040187Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:35.2084548Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:35.2126898Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:35.2172029Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:35.2213483Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:35.2259709Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:35.2304155Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:35.2352293Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:35.2404611Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:35.2474732Z Entering 'third_party/pocketfft'
2025-03-14T04:12:35.2520557Z Entering 'third_party/protobuf'
2025-03-14T04:12:35.2572627Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:35.2619004Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:35.2673602Z Entering 'third_party/psimd'
2025-03-14T04:12:35.2722057Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:35.2780348Z Entering 'third_party/pybind11'
2025-03-14T04:12:35.2834209Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:35.2880455Z Entering 'third_party/sleef'
2025-03-14T04:12:35.2927868Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:35.2992189Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:35.3023519Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:35.3065967Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:35.3112906Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:35.3158041Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:35.3234740Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-03-14T04:12:35.3265832Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-03-14T04:12:35.3553511Z Entering 'android/libs/fbjni'
2025-03-14T04:12:35.3607425Z Entering 'third_party/FP16'
2025-03-14T04:12:35.3655994Z Entering 'third_party/FXdiv'
2025-03-14T04:12:35.3703487Z Entering 'third_party/NNPACK'
2025-03-14T04:12:35.3747633Z Entering 'third_party/NVTX'
2025-03-14T04:12:35.3796336Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:35.3843801Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:35.3907445Z Entering 'third_party/benchmark'
2025-03-14T04:12:35.3952239Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:35.4006778Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:35.4057516Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:35.4105636Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:35.4151754Z Entering 'third_party/cutlass'
2025-03-14T04:12:35.4211057Z Entering 'third_party/eigen'
2025-03-14T04:12:35.4264535Z Entering 'third_party/fbgemm'
2025-03-14T04:12:35.4312483Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:35.4352955Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:35.4406352Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:35.4457118Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:35.4506154Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:35.4552885Z Entering 'third_party/flash-attention'
2025-03-14T04:12:35.4604078Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:35.4651841Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:35.4715727Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:35.4769877Z Entering 'third_party/fmt'
2025-03-14T04:12:35.4818772Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:35.4866779Z Entering 'third_party/gloo'
2025-03-14T04:12:35.4918333Z Entering 'third_party/googletest'
2025-03-14T04:12:35.4971068Z Entering 'third_party/ideep'
2025-03-14T04:12:35.5009849Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:35.5063749Z Entering 'third_party/ittapi'
2025-03-14T04:12:35.5111306Z Entering 'third_party/kineto'
2025-03-14T04:12:35.5161739Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:35.5204925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:35.5252194Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:35.5302666Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:35.5350147Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:35.5393444Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:35.5442035Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:35.5486444Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:35.5533275Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:35.5580551Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:35.5628547Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:35.5680030Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:35.5730302Z Entering 'third_party/kleidiai'
2025-03-14T04:12:35.5779723Z Entering 'third_party/mimalloc'
2025-03-14T04:12:35.5828846Z Entering 'third_party/nlohmann'
2025-03-14T04:12:35.5877110Z Entering 'third_party/onnx'
2025-03-14T04:12:35.5936639Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:35.5988197Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:35.6035693Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:35.6089030Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:35.6138300Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:35.6185838Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:35.6246500Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:35.6296291Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:35.6347873Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:35.6390961Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:35.6441322Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:35.6493442Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:35.6560176Z Entering 'third_party/pocketfft'
2025-03-14T04:12:35.6607119Z Entering 'third_party/protobuf'
2025-03-14T04:12:35.6652680Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:35.6704002Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:35.6752361Z Entering 'third_party/psimd'
2025-03-14T04:12:35.6803947Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:35.6853227Z Entering 'third_party/pybind11'
2025-03-14T04:12:35.6898146Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:35.6950489Z Entering 'third_party/sleef'
2025-03-14T04:12:35.7001367Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:35.7048544Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:35.7095101Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:35.7143221Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:35.7190771Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:35.7233451Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:35.7305197Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2025-03-14T04:12:35.7360866Z ##[endgroup]
2025-03-14T04:12:35.7364969Z ##[group]Fetching the repository
2025-03-14T04:12:35.7370250Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/*
2025-03-14T04:12:35.9354608Z From https://github.com/pytorch/pytorch
2025-03-14T04:12:35.9359567Z  - [deleted]                 (none)                  -> ciflow/inductor/149162
2025-03-14T04:12:35.9584355Z  - [deleted]                 (none)                  -> ciflow/trunk/149166
2025-03-14T04:12:37.0923129Z    b4745db9048..e5679009988  main                    -> origin/main
2025-03-14T04:12:37.0931710Z  + e2f3d057bea...c4b8be3d09f update_submodule_FBGEMM -> origin/update_submodule_FBGEMM  (forced update)
2025-03-14T04:12:37.0932751Z    4098a229a04..49570cb4024  viable/strict           -> origin/viable/strict
2025-03-14T04:12:37.0933121Z    1579a02c823..3ffd7552df1  wdvr/iss145259_alt      -> origin/wdvr/iss145259_alt
2025-03-14T04:12:37.0941913Z  * [new tag]                 ciflow/trunk/146289     -> ciflow/trunk/146289
2025-03-14T04:12:37.0943890Z  * [new tag]                 ciflow/trunk/149064     -> ciflow/trunk/149064
2025-03-14T04:12:37.1296190Z [command]/usr/bin/git rev-parse --verify --quiet aed0b7a742a2d7b7901790622829cbd2135049a4^{object}
2025-03-14T04:12:37.1320888Z aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:12:37.1324055Z ##[endgroup]
2025-03-14T04:12:37.1324417Z ##[group]Determining the checkout info
2025-03-14T04:12:37.1324792Z ##[endgroup]
2025-03-14T04:12:37.1331133Z [command]/usr/bin/git sparse-checkout disable
2025-03-14T04:12:37.5310272Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig
2025-03-14T04:12:37.5341315Z ##[group]Checking out the ref
2025-03-14T04:12:37.5347010Z [command]/usr/bin/git checkout --progress --force aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:12:37.6293221Z Previous HEAD position was b4745db9048 [MPS] Add support for `i0e` in eager. (#149174)
2025-03-14T04:12:37.6301992Z HEAD is now at aed0b7a742a [c10d] Add param recording for uniqueID broadcasting and allgather (#149166)
2025-03-14T04:12:37.6329468Z ##[endgroup]
2025-03-14T04:12:37.6331147Z ##[group]Setting up auth for fetching submodules
2025-03-14T04:12:37.6331765Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic ***
2025-03-14T04:12:37.6397060Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf
2025-03-14T04:12:37.6424658Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com:
2025-03-14T04:12:37.6445526Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com:
2025-03-14T04:12:37.6483385Z ##[endgroup]
2025-03-14T04:12:37.6488116Z ##[group]Fetching submodules
2025-03-14T04:12:37.6489577Z [command]/usr/bin/git submodule sync --recursive
2025-03-14T04:12:37.6766686Z Synchronizing submodule url for 'android/libs/fbjni'
2025-03-14T04:12:37.6784348Z Synchronizing submodule url for 'third_party/FP16'
2025-03-14T04:12:37.6804716Z Synchronizing submodule url for 'third_party/FXdiv'
2025-03-14T04:12:37.6821182Z Synchronizing submodule url for 'third_party/NNPACK'
2025-03-14T04:12:37.6838114Z Synchronizing submodule url for 'third_party/NVTX'
2025-03-14T04:12:37.6856720Z Synchronizing submodule url for 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:37.6875251Z Synchronizing submodule url for 'third_party/XNNPACK'
2025-03-14T04:12:37.6907848Z Synchronizing submodule url for 'third_party/benchmark'
2025-03-14T04:12:37.6926008Z Synchronizing submodule url for 'third_party/composable_kernel'
2025-03-14T04:12:37.6946478Z Synchronizing submodule url for 'third_party/cpp-httplib'
2025-03-14T04:12:37.6964894Z Synchronizing submodule url for 'third_party/cpuinfo'
2025-03-14T04:12:37.6981314Z Synchronizing submodule url for 'third_party/cudnn_frontend'
2025-03-14T04:12:37.6998370Z Synchronizing submodule url for 'third_party/cutlass'
2025-03-14T04:12:37.7023277Z Synchronizing submodule url for 'third_party/eigen'
2025-03-14T04:12:37.7040699Z Synchronizing submodule url for 'third_party/fbgemm'
2025-03-14T04:12:37.7057521Z Synchronizing submodule url for 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:37.7077854Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:37.7094267Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:37.7115139Z Synchronizing submodule url for 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:37.7130085Z Synchronizing submodule url for 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:37.7158244Z Synchronizing submodule url for 'third_party/flash-attention'
2025-03-14T04:12:37.7175055Z Synchronizing submodule url for 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:37.7197383Z Synchronizing submodule url for 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:37.7224762Z Synchronizing submodule url for 'third_party/flatbuffers'
2025-03-14T04:12:37.7244187Z Synchronizing submodule url for 'third_party/fmt'
2025-03-14T04:12:37.7264013Z Synchronizing submodule url for 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:37.7292573Z Synchronizing submodule url for 'third_party/gloo'
2025-03-14T04:12:37.7309304Z Synchronizing submodule url for 'third_party/googletest'
2025-03-14T04:12:37.7327195Z Synchronizing submodule url for 'third_party/ideep'
2025-03-14T04:12:37.7340856Z Synchronizing submodule url for 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:37.7365291Z Synchronizing submodule url for 'third_party/ittapi'
2025-03-14T04:12:37.7393820Z Synchronizing submodule url for 'third_party/kineto'
2025-03-14T04:12:37.7411729Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:37.7427153Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:37.7442044Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:37.7474609Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:37.7476645Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:37.7494475Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:37.7514881Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:37.7531813Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:37.7546103Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:37.7579892Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:37.7587983Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:37.7602803Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:37.7622161Z Synchronizing submodule url for 'third_party/kleidiai'
2025-03-14T04:12:37.7643783Z Synchronizing submodule url for 'third_party/mimalloc'
2025-03-14T04:12:37.7668761Z Synchronizing submodule url for 'third_party/nlohmann'
2025-03-14T04:12:37.7693374Z Synchronizing submodule url for 'third_party/onnx'
2025-03-14T04:12:37.7718767Z Synchronizing submodule url for 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:37.7740090Z Synchronizing submodule url for 'third_party/opentelemetry-cpp'
2025-03-14T04:12:37.7756646Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:37.7776349Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:37.7826608Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:37.7837643Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:37.7854827Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:37.7875490Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:37.7893040Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:37.7907933Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:37.7928656Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:37.7948533Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:37.7980726Z Synchronizing submodule url for 'third_party/pocketfft'
2025-03-14T04:12:37.7995899Z Synchronizing submodule url for 'third_party/protobuf'
2025-03-14T04:12:37.8015167Z Synchronizing submodule url for 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:37.8032825Z Synchronizing submodule url for 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:37.8053192Z Synchronizing submodule url for 'third_party/psimd'
2025-03-14T04:12:37.8071648Z Synchronizing submodule url for 'third_party/pthreadpool'
2025-03-14T04:12:37.8087866Z Synchronizing submodule url for 'third_party/pybind11'
2025-03-14T04:12:37.8104624Z Synchronizing submodule url for 'third_party/python-peachpy'
2025-03-14T04:12:37.8130103Z Synchronizing submodule url for 'third_party/sleef'
2025-03-14T04:12:37.8147166Z Synchronizing submodule url for 'third_party/tensorpipe'
2025-03-14T04:12:37.8162944Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:37.8181514Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:37.8198095Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:37.8217793Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:37.8230803Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:37.8267506Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive
2025-03-14T04:12:37.8699071Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f'
2025-03-14T04:12:37.8795340Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3'
2025-03-14T04:12:37.8871595Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1'
2025-03-14T04:12:37.9074516Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73'
2025-03-14T04:12:37.9358428Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1'
2025-03-14T04:12:37.9676083Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191'
2025-03-14T04:12:38.5500611Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883'
2025-03-14T04:12:38.5692523Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415'
2025-03-14T04:12:38.7718544Z Submodule path 'third_party/composable_kernel': checked out '8086bbe3a78d931eb96fe12fdc014082e18d18d3'
2025-03-14T04:12:38.8065448Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006'
2025-03-14T04:12:38.8911584Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99'
2025-03-14T04:12:38.9210197Z Submodule path 'third_party/cudnn_frontend': checked out '91b7532f3386768bba4f444ee7672b497f34da8a'
2025-03-14T04:12:39.4300246Z Submodule path 'third_party/cutlass': checked out 'afa1772203677c5118fcd82537a9c8fefbcc7008'
2025-03-14T04:12:39.6480951Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c'
2025-03-14T04:12:39.7029755Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e'
2025-03-14T04:12:39.7438344Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81'
2025-03-14T04:12:39.8239676Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3'
2025-03-14T04:12:40.1781036Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6'
2025-03-14T04:12:40.2149044Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796'
2025-03-14T04:12:40.2252427Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1'
2025-03-14T04:12:40.2843730Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5'
2025-03-14T04:12:40.4799319Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33'
2025-03-14T04:12:40.9730606Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420'
2025-03-14T04:12:41.0831696Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b'
2025-03-14T04:12:41.1107561Z Submodule path 'third_party/fmt': checked out '123913715afeb8a437e6388b4473fcc4753e1c9a'
2025-03-14T04:12:41.1424469Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350'
2025-03-14T04:12:41.1634420Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509'
2025-03-14T04:12:41.2055074Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59'
2025-03-14T04:12:41.2165218Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3'
2025-03-14T04:12:41.6805520Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d'
2025-03-14T04:12:41.6947504Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42'
2025-03-14T04:12:41.7746321Z Submodule path 'third_party/kineto': checked out '2859721fd9e73d3ca1c56f827dbc64e6d68f78a2'
2025-03-14T04:12:41.8452118Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e'
2025-03-14T04:12:42.0040855Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9'
2025-03-14T04:12:42.0198564Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400'
2025-03-14T04:12:42.0500699Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05'
2025-03-14T04:12:42.0612920Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067'
2025-03-14T04:12:42.0690661Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4'
2025-03-14T04:12:42.0841485Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446'
2025-03-14T04:12:42.1190571Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850'
2025-03-14T04:12:42.2045006Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5'
2025-03-14T04:12:42.2187253Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150'
2025-03-14T04:12:42.2513189Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164'
2025-03-14T04:12:42.2895022Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347'
2025-03-14T04:12:42.3210486Z Submodule path 'third_party/kleidiai': checked out 'ef685a13cfbe8d418aa2ed34350e21e4938358b6'
2025-03-14T04:12:42.3525310Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78'
2025-03-14T04:12:42.4445213Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806'
2025-03-14T04:12:42.7242880Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c'
2025-03-14T04:12:42.7555950Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b'
2025-03-14T04:12:42.8158647Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878'
2025-03-14T04:12:42.8333737Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2'
2025-03-14T04:12:42.8682283Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1'
2025-03-14T04:12:42.8792416Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa'
2025-03-14T04:12:42.9715884Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d'
2025-03-14T04:12:42.9828218Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce'
2025-03-14T04:12:42.9956044Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5'
2025-03-14T04:12:43.0097707Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d'
2025-03-14T04:12:43.2266351Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4'
2025-03-14T04:12:43.2652917Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
2025-03-14T04:12:43.6373926Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50'
2025-03-14T04:12:43.6476763Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe'
2025-03-14T04:12:43.8698596Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a'
2025-03-14T04:12:43.8829031Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
2025-03-14T04:12:43.9254585Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081'
2025-03-14T04:12:43.9343142Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900'
2025-03-14T04:12:43.9445156Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8'
2025-03-14T04:12:43.9763886Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4'
2025-03-14T04:12:43.9995781Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67'
2025-03-14T04:12:44.0356529Z Submodule path 'third_party/sleef': checked out '56e1f79cb140fb9326d612d0be06b5250565cade'
2025-03-14T04:12:44.0596391Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e'
2025-03-14T04:12:44.0983604Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e'
2025-03-14T04:12:44.1126928Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281'
2025-03-14T04:12:44.1656844Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242'
2025-03-14T04:12:44.1900246Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef'
2025-03-14T04:12:44.1976746Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
2025-03-14T04:12:44.2018500Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0
2025-03-14T04:12:44.2311612Z Entering 'android/libs/fbjni'
2025-03-14T04:12:44.2349375Z Entering 'third_party/FP16'
2025-03-14T04:12:44.2384355Z Entering 'third_party/FXdiv'
2025-03-14T04:12:44.2418707Z Entering 'third_party/NNPACK'
2025-03-14T04:12:44.2452738Z Entering 'third_party/NVTX'
2025-03-14T04:12:44.2491978Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:44.2529610Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:44.2575968Z Entering 'third_party/benchmark'
2025-03-14T04:12:44.2613283Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:44.2651016Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:44.2685733Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:44.2724289Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:44.2754338Z Entering 'third_party/cutlass'
2025-03-14T04:12:44.2802452Z Entering 'third_party/eigen'
2025-03-14T04:12:44.2839522Z Entering 'third_party/fbgemm'
2025-03-14T04:12:44.2870610Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:44.2907500Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:44.2943566Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:44.2978723Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:44.3016872Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:44.3054519Z Entering 'third_party/flash-attention'
2025-03-14T04:12:44.3089702Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:44.3131835Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:44.3177573Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:44.3212490Z Entering 'third_party/fmt'
2025-03-14T04:12:44.3250680Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:44.3287053Z Entering 'third_party/gloo'
2025-03-14T04:12:44.3322166Z Entering 'third_party/googletest'
2025-03-14T04:12:44.3353380Z Entering 'third_party/ideep'
2025-03-14T04:12:44.3390287Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:44.3432367Z Entering 'third_party/ittapi'
2025-03-14T04:12:44.3468035Z Entering 'third_party/kineto'
2025-03-14T04:12:44.3504145Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:44.3540059Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:44.3572595Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:44.3608687Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:44.3646472Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:44.3680470Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:44.3719606Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:44.3751823Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:44.3794212Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:44.3832010Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:44.3868598Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:44.3906355Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:44.3945665Z Entering 'third_party/kleidiai'
2025-03-14T04:12:44.3981961Z Entering 'third_party/mimalloc'
2025-03-14T04:12:44.4016341Z Entering 'third_party/nlohmann'
2025-03-14T04:12:44.4054524Z Entering 'third_party/onnx'
2025-03-14T04:12:44.4100142Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:44.4137075Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:44.4171880Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:44.4206366Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:44.4256738Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:44.4273709Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:44.4309678Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:44.4345159Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:44.4381347Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:44.4428773Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:44.4446673Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:44.4486124Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:44.4537285Z Entering 'third_party/pocketfft'
2025-03-14T04:12:44.4574103Z Entering 'third_party/protobuf'
2025-03-14T04:12:44.4611236Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:44.4645002Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:44.4685461Z Entering 'third_party/psimd'
2025-03-14T04:12:44.4721486Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:44.4755122Z Entering 'third_party/pybind11'
2025-03-14T04:12:44.4793417Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:44.4828602Z Entering 'third_party/sleef'
2025-03-14T04:12:44.4861405Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:44.4896381Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:44.4931896Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:44.4968622Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:44.5004777Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:44.5039036Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:44.5097345Z ##[endgroup]
2025-03-14T04:12:44.5102531Z ##[group]Persisting credentials for submodules
2025-03-14T04:12:44.5104644Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :"
2025-03-14T04:12:44.5407063Z Entering 'android/libs/fbjni'
2025-03-14T04:12:44.5435881Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5437852Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5468885Z Entering 'third_party/FP16'
2025-03-14T04:12:44.5499938Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5502730Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5532367Z Entering 'third_party/FXdiv'
2025-03-14T04:12:44.5557546Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5558034Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5596810Z Entering 'third_party/NNPACK'
2025-03-14T04:12:44.5618783Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5620968Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5646436Z Entering 'third_party/NVTX'
2025-03-14T04:12:44.5678999Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5683889Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5710623Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:44.5741231Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5741887Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5771980Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:44.5803683Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5806492Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5844837Z Entering 'third_party/benchmark'
2025-03-14T04:12:44.5876957Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5881261Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5911861Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:44.5940777Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5941126Z url.https://github.com/.insteadof
2025-03-14T04:12:44.5974589Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:44.6003358Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6003698Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6037040Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:44.6067850Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6071025Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6102960Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:44.6131616Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6133758Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6160283Z Entering 'third_party/cutlass'
2025-03-14T04:12:44.6193529Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6198698Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6235038Z Entering 'third_party/eigen'
2025-03-14T04:12:44.6263548Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6265894Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6294105Z Entering 'third_party/fbgemm'
2025-03-14T04:12:44.6324653Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6328865Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6353112Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:44.6392555Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6394220Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6417986Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:44.6445281Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6448019Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6476955Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:44.6507397Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6509488Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6544929Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:44.6575645Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6576096Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6610896Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:44.6638076Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6638504Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6674021Z Entering 'third_party/flash-attention'
2025-03-14T04:12:44.6703705Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6704275Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6737221Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:44.6768617Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6772770Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6807919Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:44.6836450Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6838621Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6879079Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:44.6906136Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6906512Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6942946Z Entering 'third_party/fmt'
2025-03-14T04:12:44.6974608Z url.https://github.com/.insteadof
2025-03-14T04:12:44.6975044Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7008766Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:44.7037057Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7039223Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7070742Z Entering 'third_party/gloo'
2025-03-14T04:12:44.7098933Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7103427Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7128228Z Entering 'third_party/googletest'
2025-03-14T04:12:44.7156913Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7160118Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7190113Z Entering 'third_party/ideep'
2025-03-14T04:12:44.7219667Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7224322Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7249118Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:44.7283010Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7287746Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7324843Z Entering 'third_party/ittapi'
2025-03-14T04:12:44.7352943Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7356764Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7385391Z Entering 'third_party/kineto'
2025-03-14T04:12:44.7414778Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7419311Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7448530Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:44.7478956Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7483885Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7510327Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:44.7540950Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7543163Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7573684Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:44.7600030Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7604727Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7632156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:44.7661582Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7663688Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7691147Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:44.7718621Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7720693Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7753142Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:44.7784498Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7786776Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7821217Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:44.7849601Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7851603Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7880425Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:44.7909755Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7910128Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7942026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:44.7971213Z url.https://github.com/.insteadof
2025-03-14T04:12:44.7974090Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8005669Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:44.8033233Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8036249Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8065330Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:44.8094857Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8100344Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8123965Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:44.8153564Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8156640Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8187073Z Entering 'third_party/kleidiai'
2025-03-14T04:12:44.8219104Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8220988Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8249191Z Entering 'third_party/mimalloc'
2025-03-14T04:12:44.8279598Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8283642Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8308262Z Entering 'third_party/nlohmann'
2025-03-14T04:12:44.8337911Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8340062Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8372937Z Entering 'third_party/onnx'
2025-03-14T04:12:44.8403758Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8413513Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8447370Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:44.8477713Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8482270Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8512654Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:44.8543716Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8545467Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8574432Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:44.8605372Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8607634Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8638092Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:44.8670378Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8675704Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8704763Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:44.8733308Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8737991Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8762503Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:44.8790427Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8792778Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8824373Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:44.8851982Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8852453Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8887179Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:44.8915763Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8920990Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8941423Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:44.8975776Z url.https://github.com/.insteadof
2025-03-14T04:12:44.8980553Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9005472Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:44.9032178Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9032863Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9069125Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:44.9098215Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9103227Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9133539Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:44.9161542Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9166761Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9213206Z Entering 'third_party/pocketfft'
2025-03-14T04:12:44.9242624Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9243116Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9278233Z Entering 'third_party/protobuf'
2025-03-14T04:12:44.9306406Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9306893Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9340215Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:44.9370635Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9375397Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9408262Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:44.9437675Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9438307Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9473673Z Entering 'third_party/psimd'
2025-03-14T04:12:44.9503838Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9506254Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9532694Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:44.9567808Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9571740Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9602877Z Entering 'third_party/pybind11'
2025-03-14T04:12:44.9632144Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9632666Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9666574Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:44.9695994Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9697950Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9732379Z Entering 'third_party/sleef'
2025-03-14T04:12:44.9765983Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9771096Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9801331Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:44.9829120Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9829706Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9866583Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:44.9895258Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9897561Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9928740Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:44.9954962Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9955615Z url.https://github.com/.insteadof
2025-03-14T04:12:44.9986327Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:45.0015543Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0016061Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0047913Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:45.0080469Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0084989Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0109674Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:45.0138836Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0140655Z url.https://github.com/.insteadof
2025-03-14T04:12:45.0196559Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url"
2025-03-14T04:12:45.0478876Z Entering 'android/libs/fbjni'
2025-03-14T04:12:45.0521122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config	remote.origin.url
2025-03-14T04:12:45.0537618Z Entering 'third_party/FP16'
2025-03-14T04:12:45.0578846Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config	remote.origin.url
2025-03-14T04:12:45.0590936Z Entering 'third_party/FXdiv'
2025-03-14T04:12:45.0637245Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config	remote.origin.url
2025-03-14T04:12:45.0653531Z Entering 'third_party/NNPACK'
2025-03-14T04:12:45.0697954Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config	remote.origin.url
2025-03-14T04:12:45.0712108Z Entering 'third_party/NVTX'
2025-03-14T04:12:45.0753414Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config	remote.origin.url
2025-03-14T04:12:45.0785548Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:45.0812428Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config	remote.origin.url
2025-03-14T04:12:45.0831137Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:45.0872971Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config	remote.origin.url
2025-03-14T04:12:45.0899128Z Entering 'third_party/benchmark'
2025-03-14T04:12:45.0942982Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config	remote.origin.url
2025-03-14T04:12:45.0955209Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:45.0999581Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config	remote.origin.url
2025-03-14T04:12:45.1019284Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:45.1062957Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config	remote.origin.url
2025-03-14T04:12:45.1079678Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:45.1121761Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config	remote.origin.url
2025-03-14T04:12:45.1139700Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:45.1179966Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config	remote.origin.url
2025-03-14T04:12:45.1196445Z Entering 'third_party/cutlass'
2025-03-14T04:12:45.1235629Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config	remote.origin.url
2025-03-14T04:12:45.1254904Z Entering 'third_party/eigen'
2025-03-14T04:12:45.1302771Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config	remote.origin.url
2025-03-14T04:12:45.1321079Z Entering 'third_party/fbgemm'
2025-03-14T04:12:45.1365422Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config	remote.origin.url
2025-03-14T04:12:45.1378341Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:45.1421140Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config	remote.origin.url
2025-03-14T04:12:45.1434157Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:45.1474790Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config	remote.origin.url
2025-03-14T04:12:45.1493613Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:45.1533758Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config	remote.origin.url
2025-03-14T04:12:45.1550749Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:45.1599246Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.1614253Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:45.1656713Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config	remote.origin.url
2025-03-14T04:12:45.1674508Z Entering 'third_party/flash-attention'
2025-03-14T04:12:45.1715512Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config	remote.origin.url
2025-03-14T04:12:45.1731501Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:45.1771940Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config	remote.origin.url
2025-03-14T04:12:45.1792483Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:45.1834516Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config	remote.origin.url
2025-03-14T04:12:45.1857281Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:45.1901431Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config	remote.origin.url
2025-03-14T04:12:45.1919373Z Entering 'third_party/fmt'
2025-03-14T04:12:45.1965522Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config	remote.origin.url
2025-03-14T04:12:45.1981727Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:45.2024451Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config	remote.origin.url
2025-03-14T04:12:45.2038970Z Entering 'third_party/gloo'
2025-03-14T04:12:45.2081826Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config	remote.origin.url
2025-03-14T04:12:45.2099394Z Entering 'third_party/googletest'
2025-03-14T04:12:45.2138132Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.2151614Z Entering 'third_party/ideep'
2025-03-14T04:12:45.2196651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config	remote.origin.url
2025-03-14T04:12:45.2214537Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:45.2252333Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config	remote.origin.url
2025-03-14T04:12:45.2278844Z Entering 'third_party/ittapi'
2025-03-14T04:12:45.2320086Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config	remote.origin.url
2025-03-14T04:12:45.2336899Z Entering 'third_party/kineto'
2025-03-14T04:12:45.2380444Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config	remote.origin.url
2025-03-14T04:12:45.2392031Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:45.2437339Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config	remote.origin.url
2025-03-14T04:12:45.2450205Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:45.2503972Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config	remote.origin.url
2025-03-14T04:12:45.2507756Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:45.2553148Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config	remote.origin.url
2025-03-14T04:12:45.2571468Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:45.2613391Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config	remote.origin.url
2025-03-14T04:12:45.2628834Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:45.2671898Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config	remote.origin.url
2025-03-14T04:12:45.2684626Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:45.2728913Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config	remote.origin.url
2025-03-14T04:12:45.2747185Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:45.2790211Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config	remote.origin.url
2025-03-14T04:12:45.2807936Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:45.2861528Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.2868039Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:45.2910596Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config	remote.origin.url
2025-03-14T04:12:45.2928876Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:45.2970035Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config	remote.origin.url
2025-03-14T04:12:45.2989808Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:45.3029949Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config	remote.origin.url
2025-03-14T04:12:45.3044063Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:45.3086775Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.3105508Z Entering 'third_party/kleidiai'
2025-03-14T04:12:45.3146856Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config	remote.origin.url
2025-03-14T04:12:45.3177649Z Entering 'third_party/mimalloc'
2025-03-14T04:12:45.3206797Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config	remote.origin.url
2025-03-14T04:12:45.3222959Z Entering 'third_party/nlohmann'
2025-03-14T04:12:45.3264583Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config	remote.origin.url
2025-03-14T04:12:45.3283795Z Entering 'third_party/onnx'
2025-03-14T04:12:45.3323960Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config	remote.origin.url
2025-03-14T04:12:45.3349468Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:45.3394721Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config	remote.origin.url
2025-03-14T04:12:45.3415034Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:45.3455513Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config	remote.origin.url
2025-03-14T04:12:45.3471994Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:45.3523276Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config	remote.origin.url
2025-03-14T04:12:45.3527721Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:45.3570220Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.3586637Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:45.3772479Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config	remote.origin.url
2025-03-14T04:12:45.3780812Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:45.3783441Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config	remote.origin.url
2025-03-14T04:12:45.3786677Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:45.3787349Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config	remote.origin.url
2025-03-14T04:12:45.3787919Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:45.3792272Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config	remote.origin.url
2025-03-14T04:12:45.3808331Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:45.3853887Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config	remote.origin.url
2025-03-14T04:12:45.3865640Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:45.3907814Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config	remote.origin.url
2025-03-14T04:12:45.3943464Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:45.3966103Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config	remote.origin.url
2025-03-14T04:12:45.3989118Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:45.4028895Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config	remote.origin.url
2025-03-14T04:12:45.4058768Z Entering 'third_party/pocketfft'
2025-03-14T04:12:45.4100921Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config	remote.origin.url
2025-03-14T04:12:45.4117995Z Entering 'third_party/protobuf'
2025-03-14T04:12:45.4161237Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config	remote.origin.url
2025-03-14T04:12:45.4175634Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:45.4216929Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config	remote.origin.url
2025-03-14T04:12:45.4232899Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:45.4276594Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.4293407Z Entering 'third_party/psimd'
2025-03-14T04:12:45.4334571Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config	remote.origin.url
2025-03-14T04:12:45.4346572Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:45.4388521Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config	remote.origin.url
2025-03-14T04:12:45.4405414Z Entering 'third_party/pybind11'
2025-03-14T04:12:45.4447805Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config	remote.origin.url
2025-03-14T04:12:45.4462173Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:45.4501397Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config	remote.origin.url
2025-03-14T04:12:45.4515302Z Entering 'third_party/sleef'
2025-03-14T04:12:45.4554045Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config	remote.origin.url
2025-03-14T04:12:45.4575302Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:45.4616268Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config	remote.origin.url
2025-03-14T04:12:45.4631501Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:45.4676917Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config	remote.origin.url
2025-03-14T04:12:45.4689383Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:45.4731800Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config	remote.origin.url
2025-03-14T04:12:45.4746769Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:45.4789385Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config	remote.origin.url
2025-03-14T04:12:45.4807459Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:45.4847457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config	remote.origin.url
2025-03-14T04:12:45.4860985Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:45.4906725Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config	remote.origin.url
2025-03-14T04:12:45.6358960Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:'
2025-03-14T04:12:45.6649533Z Entering 'android/libs/fbjni'
2025-03-14T04:12:45.6686200Z Entering 'third_party/FP16'
2025-03-14T04:12:45.6723447Z Entering 'third_party/FXdiv'
2025-03-14T04:12:45.6758612Z Entering 'third_party/NNPACK'
2025-03-14T04:12:45.6792096Z Entering 'third_party/NVTX'
2025-03-14T04:12:45.6832289Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:45.6868284Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:45.6913078Z Entering 'third_party/benchmark'
2025-03-14T04:12:45.6945980Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:45.6988740Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:45.7027070Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:45.7063077Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:45.7097376Z Entering 'third_party/cutlass'
2025-03-14T04:12:45.7135491Z Entering 'third_party/eigen'
2025-03-14T04:12:45.7173573Z Entering 'third_party/fbgemm'
2025-03-14T04:12:45.7208182Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:45.7241573Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:45.7282933Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:45.7322706Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:45.7353470Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:45.7391128Z Entering 'third_party/flash-attention'
2025-03-14T04:12:45.7424502Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:45.7469456Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:45.7511482Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:45.7545906Z Entering 'third_party/fmt'
2025-03-14T04:12:45.7592763Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:45.7631810Z Entering 'third_party/gloo'
2025-03-14T04:12:45.7682206Z Entering 'third_party/googletest'
2025-03-14T04:12:45.7722253Z Entering 'third_party/ideep'
2025-03-14T04:12:45.7753072Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:45.7800792Z Entering 'third_party/ittapi'
2025-03-14T04:12:45.7831732Z Entering 'third_party/kineto'
2025-03-14T04:12:45.7866864Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:45.7903210Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:45.7942986Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:45.7983080Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:45.8017986Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:45.8050394Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:45.8092737Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:45.8129640Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:45.8163831Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:45.8198031Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:45.8236729Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:45.8269930Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:45.8308343Z Entering 'third_party/kleidiai'
2025-03-14T04:12:45.8340723Z Entering 'third_party/mimalloc'
2025-03-14T04:12:45.8380922Z Entering 'third_party/nlohmann'
2025-03-14T04:12:45.8419414Z Entering 'third_party/onnx'
2025-03-14T04:12:45.8466555Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:45.8505368Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:45.8540137Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:45.8576795Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:45.8613533Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:45.8644399Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:45.8681128Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:45.8716232Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:45.8747967Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:45.8784265Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:45.8818871Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:45.8856856Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:45.8909950Z Entering 'third_party/pocketfft'
2025-03-14T04:12:45.8945807Z Entering 'third_party/protobuf'
2025-03-14T04:12:45.8980922Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:45.9017088Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:45.9053203Z Entering 'third_party/psimd'
2025-03-14T04:12:45.9087948Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:45.9125027Z Entering 'third_party/pybind11'
2025-03-14T04:12:45.9168141Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:45.9204302Z Entering 'third_party/sleef'
2025-03-14T04:12:45.9234864Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:45.9267937Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:45.9307508Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:45.9338865Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:45.9372476Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:45.9403861Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:45.9456103Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:'
2025-03-14T04:12:45.9742711Z Entering 'android/libs/fbjni'
2025-03-14T04:12:45.9763738Z Entering 'third_party/FP16'
2025-03-14T04:12:45.9801473Z Entering 'third_party/FXdiv'
2025-03-14T04:12:45.9835011Z Entering 'third_party/NNPACK'
2025-03-14T04:12:45.9872930Z Entering 'third_party/NVTX'
2025-03-14T04:12:45.9908280Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:12:45.9946325Z Entering 'third_party/XNNPACK'
2025-03-14T04:12:45.9990104Z Entering 'third_party/benchmark'
2025-03-14T04:12:46.0029032Z Entering 'third_party/composable_kernel'
2025-03-14T04:12:46.0070067Z Entering 'third_party/cpp-httplib'
2025-03-14T04:12:46.0106368Z Entering 'third_party/cpuinfo'
2025-03-14T04:12:46.0143262Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:12:46.0181937Z Entering 'third_party/cutlass'
2025-03-14T04:12:46.0223584Z Entering 'third_party/eigen'
2025-03-14T04:12:46.0257744Z Entering 'third_party/fbgemm'
2025-03-14T04:12:46.0294457Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:12:46.0328292Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:12:46.0365640Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:12:46.0404552Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:12:46.0436669Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:12:46.0471974Z Entering 'third_party/flash-attention'
2025-03-14T04:12:46.0510922Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:12:46.0553068Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:12:46.0597940Z Entering 'third_party/flatbuffers'
2025-03-14T04:12:46.0633258Z Entering 'third_party/fmt'
2025-03-14T04:12:46.0670359Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:12:46.0706953Z Entering 'third_party/gloo'
2025-03-14T04:12:46.0744630Z Entering 'third_party/googletest'
2025-03-14T04:12:46.0783084Z Entering 'third_party/ideep'
2025-03-14T04:12:46.0818208Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:12:46.0857798Z Entering 'third_party/ittapi'
2025-03-14T04:12:46.0894792Z Entering 'third_party/kineto'
2025-03-14T04:12:46.0926394Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:12:46.0954318Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:12:46.0992826Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:12:46.1026241Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:12:46.1060687Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:12:46.1094043Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:12:46.1131554Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:12:46.1168609Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:12:46.1203363Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:12:46.1239915Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:12:46.1278211Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:12:46.1307443Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:12:46.1343996Z Entering 'third_party/kleidiai'
2025-03-14T04:12:46.1384299Z Entering 'third_party/mimalloc'
2025-03-14T04:12:46.1420365Z Entering 'third_party/nlohmann'
2025-03-14T04:12:46.1455558Z Entering 'third_party/onnx'
2025-03-14T04:12:46.1499664Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:12:46.1536445Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:12:46.1568525Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:12:46.1603651Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:12:46.1635901Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:12:46.1673625Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:12:46.1710062Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:12:46.1745244Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:12:46.1779533Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:12:46.1814589Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:12:46.1851505Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:12:46.1888956Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:12:46.1957562Z Entering 'third_party/pocketfft'
2025-03-14T04:12:46.1980001Z Entering 'third_party/protobuf'
2025-03-14T04:12:46.2016899Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:12:46.2051725Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:12:46.2105000Z Entering 'third_party/psimd'
2025-03-14T04:12:46.2126055Z Entering 'third_party/pthreadpool'
2025-03-14T04:12:46.2161715Z Entering 'third_party/pybind11'
2025-03-14T04:12:46.2195359Z Entering 'third_party/python-peachpy'
2025-03-14T04:12:46.2230973Z Entering 'third_party/sleef'
2025-03-14T04:12:46.2270204Z Entering 'third_party/tensorpipe'
2025-03-14T04:12:46.2304884Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:12:46.2339513Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:12:46.2377904Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:12:46.2414712Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:12:46.2449575Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:12:46.2506604Z ##[endgroup]
2025-03-14T04:12:46.2540013Z [command]/usr/bin/git log -1 --format=%H
2025-03-14T04:12:46.2563137Z aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:12:46.2714669Z Prepare all required actions
2025-03-14T04:12:46.2715118Z Getting action download info
2025-03-14T04:12:46.3654029Z ##[group]Run ./.github/actions/setup-linux
2025-03-14T04:12:46.3654273Z env:
2025-03-14T04:12:46.3654450Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:46.3654646Z ##[endgroup]
2025-03-14T04:12:46.3698841Z ##[group]Run set -euo pipefail
2025-03-14T04:12:46.3699100Z set -euo pipefail
2025-03-14T04:12:46.3699309Z function get_ec2_metadata() {
2025-03-14T04:12:46.3699717Z   # Pulled from instance metadata endpoint for EC2
2025-03-14T04:12:46.3700116Z   # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html
2025-03-14T04:12:46.3700466Z   category=$1
2025-03-14T04:12:46.3700714Z   # If it is GCP runner (runner name contains gcp), do not run this
2025-03-14T04:12:46.3700992Z   runner_name_str=i-049962b53c600fa33
2025-03-14T04:12:46.3701268Z   if [[ -f /.inarc ]]; then
2025-03-14T04:12:46.3701501Z     echo "ARC Runner, no info on ec2 metadata"
2025-03-14T04:12:46.3701753Z   elif [[ $runner_name_str == *"gcp"* ]]; then
2025-03-14T04:12:46.3702047Z     echo "Runner is from Google Cloud Platform, No info on ec2 metadata"
2025-03-14T04:12:46.3702317Z   else
2025-03-14T04:12:46.3702829Z     curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}"
2025-03-14T04:12:46.3703340Z   fi
2025-03-14T04:12:46.3703508Z }
2025-03-14T04:12:46.3703704Z echo "ami-id: $(get_ec2_metadata ami-id)"
2025-03-14T04:12:46.3703984Z echo "instance-id: $(get_ec2_metadata instance-id)"
2025-03-14T04:12:46.3704280Z echo "instance-type: $(get_ec2_metadata instance-type)"
2025-03-14T04:12:46.3704549Z echo "system info $(uname -a)"
2025-03-14T04:12:46.3710354Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:46.3710604Z env:
2025-03-14T04:12:46.3710776Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:46.3710957Z ##[endgroup]
2025-03-14T04:12:46.3837662Z ami-id: ami-08b5b3a93ed654d19
2025-03-14T04:12:46.3937894Z instance-id: i-049962b53c600fa33
2025-03-14T04:12:46.4031185Z instance-type: m7i-flex.8xlarge
2025-03-14T04:12:46.4042115Z system info Linux ip-10-0-59-39.ec2.internal 6.1.129-138.220.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Feb 25 22:18:43 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
2025-03-14T04:12:46.4073823Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:12:46.4074378Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:12:46.4078688Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:46.4078959Z env:
2025-03-14T04:12:46.4079141Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:46.4079330Z ##[endgroup]
2025-03-14T04:12:46.4136504Z ##[group]Run if systemctl is-active --quiet docker; then
2025-03-14T04:12:46.4136807Z if systemctl is-active --quiet docker; then
2025-03-14T04:12:46.4137060Z     echo "Docker daemon is running...";
2025-03-14T04:12:46.4137284Z else
2025-03-14T04:12:46.4137522Z     echo "Starting docker deamon..." && sudo systemctl start docker;
2025-03-14T04:12:46.4137796Z fi
2025-03-14T04:12:46.4141192Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:46.4141444Z env:
2025-03-14T04:12:46.4141617Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:46.4141808Z ##[endgroup]
2025-03-14T04:12:46.4215134Z Docker daemon is running...
2025-03-14T04:12:46.4254931Z ##[group]Run nick-fields/retry@v3.0.0
2025-03-14T04:12:46.4255140Z with:
2025-03-14T04:12:46.4255301Z   shell: bash
2025-03-14T04:12:46.4255583Z   timeout_minutes: 5
2025-03-14T04:12:46.4255765Z   max_attempts: 3
2025-03-14T04:12:46.4255944Z   retry_wait_seconds: 30
2025-03-14T04:12:46.4258235Z   command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\")
aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
    --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"

# For LF Runners we need to make sure we also login to Meta's ECR docker registry too.
META_AWS_ACCOUNT_ID=308535385114
if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then
    aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \
        --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com"
fi

2025-03-14T04:12:46.4259578Z   polling_interval_seconds: 1
2025-03-14T04:12:46.4259782Z   warning_on_retry: true
2025-03-14T04:12:46.4259972Z   continue_on_error: false
2025-03-14T04:12:46.4260161Z env:
2025-03-14T04:12:46.4260325Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:46.4260514Z   AWS_RETRY_MODE: standard
2025-03-14T04:12:46.4260690Z   AWS_MAX_ATTEMPTS: 5
2025-03-14T04:12:46.4260871Z   AWS_DEFAULT_REGION: us-east-1
2025-03-14T04:12:46.4261068Z ##[endgroup]
2025-03-14T04:12:47.2549298Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T04:12:47.2549732Z Configure a credential helper to remove this warning. See
2025-03-14T04:12:47.2550133Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T04:12:47.2550419Z 
2025-03-14T04:12:47.2550496Z Login Succeeded
2025-03-14T04:12:47.4926166Z Command completed after 1 attempt(s).
2025-03-14T04:12:47.4991978Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T04:12:47.4992367Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T04:12:47.4992660Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T04:12:47.4997274Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:47.4997519Z env:
2025-03-14T04:12:47.4997718Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.4997912Z ##[endgroup]
2025-03-14T04:12:47.5076883Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T04:12:47.5077253Z # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T04:12:47.5077531Z # shellcheck disable=SC2046
2025-03-14T04:12:47.5077760Z docker stop $(docker ps -q) || true
2025-03-14T04:12:47.5078006Z # Prune all of the docker images
2025-03-14T04:12:47.5078228Z docker system prune -af
2025-03-14T04:12:47.5082102Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:47.5082352Z env:
2025-03-14T04:12:47.5082521Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.5082709Z ##[endgroup]
2025-03-14T04:12:47.5355800Z "docker stop" requires at least 1 argument.
2025-03-14T04:12:47.5356112Z See 'docker stop --help'.
2025-03-14T04:12:47.5356475Z 
2025-03-14T04:12:47.5356644Z Usage:  docker stop [OPTIONS] CONTAINER [CONTAINER...]
2025-03-14T04:12:47.5356821Z 
2025-03-14T04:12:47.5356920Z Stop one or more running containers
2025-03-14T04:12:47.5513721Z Total reclaimed space: 0B
2025-03-14T04:12:47.5550355Z ##[group]Run set +e
2025-03-14T04:12:47.5550579Z set +e
2025-03-14T04:12:47.5550757Z set -x
2025-03-14T04:12:47.5550928Z 
2025-03-14T04:12:47.5551127Z PT_DOMAIN=download.pytorch.org
2025-03-14T04:12:47.5551640Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400,
2025-03-14T04:12:47.5552104Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last
2025-03-14T04:12:47.5552449Z # one is returned at random
2025-03-14T04:12:47.5552734Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1)
2025-03-14T04:12:47.5552986Z 
2025-03-14T04:12:47.5553273Z if [ -z "${RESOLVED_IP}" ]; then
2025-03-14T04:12:47.5553561Z   echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..."
2025-03-14T04:12:47.5553888Z   RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1)
2025-03-14T04:12:47.5554144Z 
2025-03-14T04:12:47.5554325Z   if [ -z "${RESOLVED_IP}" ]; then
2025-03-14T04:12:47.5554584Z     echo "Couldn't resolve ${PT_DOMAIN}, exiting..."
2025-03-14T04:12:47.5554824Z     exit 1
2025-03-14T04:12:47.5555084Z   fi
2025-03-14T04:12:47.5555242Z fi
2025-03-14T04:12:47.5555402Z 
2025-03-14T04:12:47.5555590Z if grep -r "${PT_DOMAIN}" /etc/hosts; then
2025-03-14T04:12:47.5555838Z   # Clean up any old records first
2025-03-14T04:12:47.5556081Z   sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts
2025-03-14T04:12:47.5557473Z fi
2025-03-14T04:12:47.5557690Z 
2025-03-14T04:12:47.5557986Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts
2025-03-14T04:12:47.5558310Z cat /etc/hosts
2025-03-14T04:12:47.5563516Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:47.5563819Z env:
2025-03-14T04:12:47.5564047Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.5564286Z ##[endgroup]
2025-03-14T04:12:47.5585641Z + PT_DOMAIN=download.pytorch.org
2025-03-14T04:12:47.5596328Z ++ dig -4 +short download.pytorch.org
2025-03-14T04:12:47.5600725Z ++ tail -n1
2025-03-14T04:12:47.5837054Z + RESOLVED_IP=18.160.10.28
2025-03-14T04:12:47.5837467Z + '[' -z 18.160.10.28 ']'
2025-03-14T04:12:47.5837860Z + grep -r download.pytorch.org /etc/hosts
2025-03-14T04:12:47.5847825Z 18.160.10.36 download.pytorch.org
2025-03-14T04:12:47.5850234Z + sudo sed -i /download.pytorch.org/d /etc/hosts
2025-03-14T04:12:47.8124036Z + echo '18.160.10.28 download.pytorch.org'
2025-03-14T04:12:47.8124453Z + sudo tee -a /etc/hosts
2025-03-14T04:12:47.9039778Z 18.160.10.28 download.pytorch.org
2025-03-14T04:12:47.9056345Z + cat /etc/hosts
2025-03-14T04:12:47.9064460Z 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
2025-03-14T04:12:47.9074368Z ::1         localhost6 localhost6.localdomain6
2025-03-14T04:12:47.9074674Z 18.160.10.28 download.pytorch.org
2025-03-14T04:12:47.9174125Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main
2025-03-14T04:12:47.9174420Z with:
2025-03-14T04:12:47.9174887Z   docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9175403Z   docker-build-dir: .ci/docker
2025-03-14T04:12:47.9175609Z   working-directory: .
2025-03-14T04:12:47.9175848Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9176105Z   force-push: false
2025-03-14T04:12:47.9176271Z env:
2025-03-14T04:12:47.9176433Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.9176610Z ##[endgroup]
2025-03-14T04:12:47.9201676Z ##[group]Run set -ex
2025-03-14T04:12:47.9201901Z set -ex
2025-03-14T04:12:47.9202060Z 
2025-03-14T04:12:47.9202323Z # If the docker build directory or the build script doesn't exist, the action will
2025-03-14T04:12:47.9202765Z # gracefully return the docker image name as it is.  Pulling docker image in Linux
2025-03-14T04:12:47.9203115Z # job could then download the pre-built image as usual
2025-03-14T04:12:47.9203438Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then
2025-03-14T04:12:47.9203740Z   echo "skip=true" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9204028Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9204284Z 
2025-03-14T04:12:47.9204523Z   echo "There is no Docker build script in ${REPO_NAME} repo, skipping..."
2025-03-14T04:12:47.9204796Z   exit 0
2025-03-14T04:12:47.9204962Z else
2025-03-14T04:12:47.9205150Z   echo "skip=false" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9205365Z fi
2025-03-14T04:12:47.9205523Z 
2025-03-14T04:12:47.9205748Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then
2025-03-14T04:12:47.9206108Z   # The docker image name already includes the ECR prefix and tag, so we can just
2025-03-14T04:12:47.9206436Z   # use it as it is, but first let's extract the tag
2025-03-14T04:12:47.9206732Z   DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}')
2025-03-14T04:12:47.9207137Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9207436Z   echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9207690Z else
2025-03-14T04:12:47.9207910Z   DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}")
2025-03-14T04:12:47.9208197Z   echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9208578Z   echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9208910Z fi
2025-03-14T04:12:47.9215330Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:47.9215577Z env:
2025-03-14T04:12:47.9215748Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.9215942Z   REPO_NAME: pytorch
2025-03-14T04:12:47.9216419Z   DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9216916Z   DOCKER_BUILD_DIR: .ci/docker
2025-03-14T04:12:47.9217168Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9217418Z ##[endgroup]
2025-03-14T04:12:47.9240120Z + [[ ! -d .ci/docker ]]
2025-03-14T04:12:47.9240524Z + [[ ! -f .ci/docker/build.sh ]]
2025-03-14T04:12:47.9240845Z + echo skip=false
2025-03-14T04:12:47.9241551Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]]
2025-03-14T04:12:47.9246754Z ++ awk -F '[:,]' '{print $2}'
2025-03-14T04:12:47.9264051Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9268256Z + DOCKER_TAG=aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9268779Z + echo docker-tag=aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9269385Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9303442Z ##[group]Run set +e
2025-03-14T04:12:47.9303679Z set +e
2025-03-14T04:12:47.9303861Z set -x
2025-03-14T04:12:47.9304029Z 
2025-03-14T04:12:47.9304191Z login() {
2025-03-14T04:12:47.9304507Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2025-03-14T04:12:47.9304829Z }
2025-03-14T04:12:47.9305000Z 
2025-03-14T04:12:47.9305158Z retry () {
2025-03-14T04:12:47.9305354Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2025-03-14T04:12:47.9305567Z }
2025-03-14T04:12:47.9305723Z 
2025-03-14T04:12:47.9305894Z retry login "${DOCKER_REGISTRY}"
2025-03-14T04:12:47.9306101Z 
2025-03-14T04:12:47.9306263Z START_TIME=$(date +%s)
2025-03-14T04:12:47.9306472Z # Wait up to 120 minutes
2025-03-14T04:12:47.9306722Z while [[ $(( $(date +%s) - 7200 )) -lt $START_TIME ]]; do
2025-03-14T04:12:47.9307030Z   # Check if image already exists, if it does then skip building it
2025-03-14T04:12:47.9307344Z   if docker manifest inspect "${DOCKER_IMAGE}"; then
2025-03-14T04:12:47.9307583Z     exit 0
2025-03-14T04:12:47.9307754Z   fi
2025-03-14T04:12:47.9307913Z 
2025-03-14T04:12:47.9308165Z   # NB: This flag is used by Docker build workflow to push the image to ECR, so we can
2025-03-14T04:12:47.9308560Z   # use this to differentiate between the Docker build and regular build jobs. For the
2025-03-14T04:12:47.9308952Z   # latter, it will wait for the Docker images to become available before continuing
2025-03-14T04:12:47.9309373Z   if [ "${DOCKER_PUSH:-false}" == "true" ]; then
2025-03-14T04:12:47.9309636Z     # It's a Docker build job, let's build the image
2025-03-14T04:12:47.9309866Z     break
2025-03-14T04:12:47.9310057Z   else
2025-03-14T04:12:47.9310291Z     # It's a regular build job, wait for the image to become available
2025-03-14T04:12:47.9310550Z     sleep 300
2025-03-14T04:12:47.9310727Z   fi
2025-03-14T04:12:47.9310890Z done
2025-03-14T04:12:47.9311050Z 
2025-03-14T04:12:47.9311289Z # NB: This part requires a full checkout. Otherwise, the merge base will
2025-03-14T04:12:47.9311782Z # be empty.  The default action would be to continue rebuild the image
2025-03-14T04:12:47.9312112Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then
2025-03-14T04:12:47.9312412Z   # if we're on the base branch then use the parent commit
2025-03-14T04:12:47.9312675Z   MERGE_BASE=$(git rev-parse HEAD~)
2025-03-14T04:12:47.9312889Z else
2025-03-14T04:12:47.9313111Z   # otherwise we're on a PR, so use the most recent base commit
2025-03-14T04:12:47.9313409Z   MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION")
2025-03-14T04:12:47.9313643Z fi
2025-03-14T04:12:47.9313794Z 
2025-03-14T04:12:47.9313968Z if [[ -z "${MERGE_BASE}" ]]; then
2025-03-14T04:12:47.9314205Z   echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9314426Z 
2025-03-14T04:12:47.9314716Z   echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..."
2025-03-14T04:12:47.9315134Z   exit 0
2025-03-14T04:12:47.9315302Z fi
2025-03-14T04:12:47.9315454Z 
2025-03-14T04:12:47.9315665Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then
2025-03-14T04:12:47.9316065Z   echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit"
2025-03-14T04:12:47.9316415Z   exit 1
2025-03-14T04:12:47.9316580Z fi
2025-03-14T04:12:47.9316736Z 
2025-03-14T04:12:47.9316978Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}")
2025-03-14T04:12:47.9317371Z # If no image exists but the hash is the same as the previous hash then we should error out here
2025-03-14T04:12:47.9317722Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then
2025-03-14T04:12:47.9318118Z   echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch"
2025-03-14T04:12:47.9318557Z   echo "         Will re-build docker image to store in local cache, TTS may be longer"
2025-03-14T04:12:47.9318837Z fi
2025-03-14T04:12:47.9318993Z 
2025-03-14T04:12:47.9319178Z echo "rebuild=true" >> "${GITHUB_OUTPUT}"
2025-03-14T04:12:47.9322937Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:47.9323183Z env:
2025-03-14T04:12:47.9323354Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:47.9323554Z   DOCKER_BUILD_DIR: .ci/docker
2025-03-14T04:12:47.9323797Z   BASE_REVISION: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:12:47.9324325Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9324870Z   DOCKER_TAG: aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:47.9325157Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9325410Z   DOCKER_PUSH: 
2025-03-14T04:12:47.9325585Z ##[endgroup]
2025-03-14T04:12:47.9346314Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9346769Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9348489Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:47.9349094Z + aws ecr get-login-password --region us-east-1
2025-03-14T04:12:48.3043076Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T04:12:48.3043448Z Login Succeeded
2025-03-14T04:12:48.3043916Z Configure a credential helper to remove this warning. See
2025-03-14T04:12:48.3044318Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T04:12:48.3044556Z 
2025-03-14T04:12:48.3062125Z ++ date +%s
2025-03-14T04:12:48.3067912Z + START_TIME=1741925568
2025-03-14T04:12:48.3068299Z ++ date +%s
2025-03-14T04:12:48.3077790Z + [[ 1741918368 -lt 1741925568 ]]
2025-03-14T04:12:48.3078533Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:48.5199328Z {
2025-03-14T04:12:48.5199763Z 	"schemaVersion": 2,
2025-03-14T04:12:48.5200191Z 	"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
2025-03-14T04:12:48.5200552Z 	"config": {
2025-03-14T04:12:48.5200814Z 		"mediaType": "application/vnd.docker.container.image.v1+json",
2025-03-14T04:12:48.5201091Z 		"size": 42081,
2025-03-14T04:12:48.5201376Z 		"digest": "sha256:1bab961b3bd90ec6714167a095e5437a0239700971887d1c663377ef708f8526"
2025-03-14T04:12:48.5201677Z 	},
2025-03-14T04:12:48.5201832Z 	"layers": [
2025-03-14T04:12:48.5201991Z 		{
2025-03-14T04:12:48.5202223Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5202484Z 			"size": 30440118,
2025-03-14T04:12:48.5202769Z 			"digest": "sha256:8f84a9f2102e97a4a6bf673b150fc9894df5acc9618ad3484c6c36f768c1caa0"
2025-03-14T04:12:48.5203064Z 		},
2025-03-14T04:12:48.5203593Z 		{
2025-03-14T04:12:48.5203836Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5204104Z 			"size": 1896,
2025-03-14T04:12:48.5204379Z 			"digest": "sha256:f35880ae6ee6dd2a62a077d19ff6b5c4a69745027e986e8ed5fec074f76c859a"
2025-03-14T04:12:48.5204679Z 		},
2025-03-14T04:12:48.5204830Z 		{
2025-03-14T04:12:48.5205053Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5205318Z 			"size": 319404545,
2025-03-14T04:12:48.5205649Z 			"digest": "sha256:8eb502731466bf7440d89c4538928f5a175e8b54b788f1e8d194d0f864ff206d"
2025-03-14T04:12:48.5205951Z 		},
2025-03-14T04:12:48.5206096Z 		{
2025-03-14T04:12:48.5206316Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5206576Z 			"size": 864,
2025-03-14T04:12:48.5206845Z 			"digest": "sha256:d4ce6a1f04ff4b142de5bce2ef06e1538172f3f7245835a1393a2a3b87a616bb"
2025-03-14T04:12:48.5207128Z 		},
2025-03-14T04:12:48.5207273Z 		{
2025-03-14T04:12:48.5207501Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5207759Z 			"size": 106,
2025-03-14T04:12:48.5208018Z 			"digest": "sha256:ca18d6003a1855ff2be2115cc2154b50c52d2fef9f8628623f168c33016d3b33"
2025-03-14T04:12:48.5208304Z 		},
2025-03-14T04:12:48.5208447Z 		{
2025-03-14T04:12:48.5208667Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5208919Z 			"size": 704,
2025-03-14T04:12:48.5209188Z 			"digest": "sha256:f6b56646e2f02522c5afb19aff566ef53261a591ce3ecbeaa224ed40df1ed9a4"
2025-03-14T04:12:48.5209475Z 		},
2025-03-14T04:12:48.5209615Z 		{
2025-03-14T04:12:48.5209828Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5210085Z 			"size": 1216,
2025-03-14T04:12:48.5210357Z 			"digest": "sha256:454c9d6c7abb004ad3cf2a984a4c653d3dcb3af36d26bfe90988a24dfbe1650c"
2025-03-14T04:12:48.5210747Z 		},
2025-03-14T04:12:48.5210892Z 		{
2025-03-14T04:12:48.5211103Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5211358Z 			"size": 483,
2025-03-14T04:12:48.5211621Z 			"digest": "sha256:a66b8377f49fed837811a0ed9d612fc454b00944b0bafccbb4611b19e2fd2976"
2025-03-14T04:12:48.5211910Z 		},
2025-03-14T04:12:48.5212172Z 		{
2025-03-14T04:12:48.5212399Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5212665Z 			"size": 110341891,
2025-03-14T04:12:48.5212954Z 			"digest": "sha256:c75867b7d634b7bfdf1bb7a2cf5062bef03aa58f357db40fad0ca3db26633c1f"
2025-03-14T04:12:48.5213256Z 		},
2025-03-14T04:12:48.5213408Z 		{
2025-03-14T04:12:48.5213723Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5214065Z 			"size": 4165,
2025-03-14T04:12:48.5214337Z 			"digest": "sha256:64866485623d4cd2c086ae4dd8c332eba6200229a00c3457274adf9cf3878f44"
2025-03-14T04:12:48.5214627Z 		},
2025-03-14T04:12:48.5214776Z 		{
2025-03-14T04:12:48.5215005Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5215268Z 			"size": 1860,
2025-03-14T04:12:48.5215543Z 			"digest": "sha256:04b678046b3a28400a60c07993009616e6f2667c9052eeba35cd953db82b1af2"
2025-03-14T04:12:48.5215830Z 		},
2025-03-14T04:12:48.5215971Z 		{
2025-03-14T04:12:48.5216180Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5216438Z 			"size": 701,
2025-03-14T04:12:48.5216697Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5216978Z 		},
2025-03-14T04:12:48.5217121Z 		{
2025-03-14T04:12:48.5217338Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5217593Z 			"size": 477,
2025-03-14T04:12:48.5217853Z 			"digest": "sha256:564c8877ceb50a429fa53713805ae4726c040473188d1fb1e4dcd5ba9706304f"
2025-03-14T04:12:48.5218136Z 		},
2025-03-14T04:12:48.5218277Z 		{
2025-03-14T04:12:48.5218523Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5218829Z 			"size": 2831705826,
2025-03-14T04:12:48.5219109Z 			"digest": "sha256:8d7dafab91e2016111c6948bf0794c93e2721bf193c48886fe2240153b249e33"
2025-03-14T04:12:48.5219392Z 		},
2025-03-14T04:12:48.5219534Z 		{
2025-03-14T04:12:48.5219749Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5220011Z 			"size": 32,
2025-03-14T04:12:48.5220279Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5220568Z 		},
2025-03-14T04:12:48.5220711Z 		{
2025-03-14T04:12:48.5220930Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5221188Z 			"size": 380,
2025-03-14T04:12:48.5221448Z 			"digest": "sha256:3195860f4968f586f181dbcfe1714dbac201156cad2831d1f0b2a7e7d77cd745"
2025-03-14T04:12:48.5221733Z 		},
2025-03-14T04:12:48.5221876Z 		{
2025-03-14T04:12:48.5222090Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5222349Z 			"size": 232996,
2025-03-14T04:12:48.5222623Z 			"digest": "sha256:64889f83e2762c0beecdc83ecdcda11013915f96d9a510a4d4c71d8f5c98c0d1"
2025-03-14T04:12:48.5222902Z 		},
2025-03-14T04:12:48.5223043Z 		{
2025-03-14T04:12:48.5223258Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5223514Z 			"size": 231,
2025-03-14T04:12:48.5223773Z 			"digest": "sha256:a2f45c18f0c1c2df7c02c57024d329a2fabc91c70176271b58e5d318dd3458da"
2025-03-14T04:12:48.5224059Z 		},
2025-03-14T04:12:48.5224199Z 		{
2025-03-14T04:12:48.5224412Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5224670Z 			"size": 3780000,
2025-03-14T04:12:48.5224931Z 			"digest": "sha256:16d7101d144158769623d4f9f5a88461a9f00e204f0d8eb2de4e5df6a1550c14"
2025-03-14T04:12:48.5225216Z 		},
2025-03-14T04:12:48.5225359Z 		{
2025-03-14T04:12:48.5225575Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5225834Z 			"size": 1946,
2025-03-14T04:12:48.5226104Z 			"digest": "sha256:9f39c1b701e2a249071ced1a08ec63d1cfb1b7cb8379cab2cade1bf20b3c9de2"
2025-03-14T04:12:48.5226397Z 		},
2025-03-14T04:12:48.5226533Z 		{
2025-03-14T04:12:48.5226751Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5227008Z 			"size": 105,
2025-03-14T04:12:48.5227328Z 			"digest": "sha256:2edf8a767cf2f72a7b1de53020b860979b1bdd164a8ed7ef367bd832d23d2f8b"
2025-03-14T04:12:48.5227629Z 		},
2025-03-14T04:12:48.5227778Z 		{
2025-03-14T04:12:48.5228000Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5228263Z 			"size": 802,
2025-03-14T04:12:48.5228532Z 			"digest": "sha256:6ee1d4017bc6986ed5897ef9a654bbf0ed6a7817dc066925f236df53355fcf90"
2025-03-14T04:12:48.5228826Z 		},
2025-03-14T04:12:48.5228974Z 		{
2025-03-14T04:12:48.5229190Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5229447Z 			"size": 32,
2025-03-14T04:12:48.5229712Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5230008Z 		},
2025-03-14T04:12:48.5230151Z 		{
2025-03-14T04:12:48.5230360Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5230621Z 			"size": 104,
2025-03-14T04:12:48.5230894Z 			"digest": "sha256:aa5b1d7b7a2ced97aeb9c9ae265f99c9200cf7925c897161239a001f052f72a8"
2025-03-14T04:12:48.5231192Z 		},
2025-03-14T04:12:48.5231462Z 		{
2025-03-14T04:12:48.5231699Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5231956Z 			"size": 504,
2025-03-14T04:12:48.5232221Z 			"digest": "sha256:6100538713cbf01bbdc99f33c49d4158409d312b0d91e0da2b1b27872c295aef"
2025-03-14T04:12:48.5232504Z 		},
2025-03-14T04:12:48.5232651Z 		{
2025-03-14T04:12:48.5232866Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5233126Z 			"size": 101109876,
2025-03-14T04:12:48.5233397Z 			"digest": "sha256:f53dff608124892061f86553f7367a2bbc24bf8e87852b705ead5a9711ce0551"
2025-03-14T04:12:48.5233683Z 		},
2025-03-14T04:12:48.5233879Z 		{
2025-03-14T04:12:48.5234095Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5234343Z 			"size": 107,
2025-03-14T04:12:48.5234594Z 			"digest": "sha256:692dab4cd4df9b516d5a00637f3b139f358fac08546e782196a6b571e89db338"
2025-03-14T04:12:48.5234879Z 		},
2025-03-14T04:12:48.5235019Z 		{
2025-03-14T04:12:48.5235236Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5235489Z 			"size": 490,
2025-03-14T04:12:48.5235751Z 			"digest": "sha256:2e13cb071445f474d0c6c51ba16f9efb8107ab2b96467aee933b5f0c8724b604"
2025-03-14T04:12:48.5236038Z 		},
2025-03-14T04:12:48.5236182Z 		{
2025-03-14T04:12:48.5236397Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5236652Z 			"size": 338,
2025-03-14T04:12:48.5236899Z 			"digest": "sha256:12fc0b9855405052fa6937387f7293816b891253be753195323ce0073a151b5e"
2025-03-14T04:12:48.5237174Z 		},
2025-03-14T04:12:48.5237317Z 		{
2025-03-14T04:12:48.5237535Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5237792Z 			"size": 103,
2025-03-14T04:12:48.5238043Z 			"digest": "sha256:9c0523cdc042e8a11440408370d68e599496333bff6312078af524f2611baae4"
2025-03-14T04:12:48.5238317Z 		},
2025-03-14T04:12:48.5238461Z 		{
2025-03-14T04:12:48.5238681Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5238938Z 			"size": 1473,
2025-03-14T04:12:48.5239204Z 			"digest": "sha256:76be39b43c8ff15ab266bcad8f5744d72bc263df9d447748733c6fcf4fc1943e"
2025-03-14T04:12:48.5239490Z 		},
2025-03-14T04:12:48.5239631Z 		{
2025-03-14T04:12:48.5239844Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5240100Z 			"size": 446377208,
2025-03-14T04:12:48.5240373Z 			"digest": "sha256:a813b158a4210a11a29ed58fd3d62fa8dab8efdf6e0af85385c2885a1d1c9d55"
2025-03-14T04:12:48.5240660Z 		},
2025-03-14T04:12:48.5240802Z 		{
2025-03-14T04:12:48.5241018Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5241272Z 			"size": 164,
2025-03-14T04:12:48.5241533Z 			"digest": "sha256:bbc30b7542d1a52790dae399a0e23ec15f0ec726ef5d671b4e06e6118c912f91"
2025-03-14T04:12:48.5241818Z 		},
2025-03-14T04:12:48.5241999Z 		{
2025-03-14T04:12:48.5242213Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5242467Z 			"size": 422,
2025-03-14T04:12:48.5242729Z 			"digest": "sha256:2a30d35d5515be01fdb30110959c5f5adcd6b7e5fca723ec9c98f48f91fcb738"
2025-03-14T04:12:48.5243014Z 		},
2025-03-14T04:12:48.5243158Z 		{
2025-03-14T04:12:48.5243373Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5243624Z 			"size": 32,
2025-03-14T04:12:48.5243883Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5244168Z 		},
2025-03-14T04:12:48.5244312Z 		{
2025-03-14T04:12:48.5244529Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5244782Z 			"size": 111,
2025-03-14T04:12:48.5245044Z 			"digest": "sha256:34c633845b891bd5eee69ead4576b3fde778f2ee4d7e65cd095848edc8946683"
2025-03-14T04:12:48.5245327Z 		},
2025-03-14T04:12:48.5245466Z 		{
2025-03-14T04:12:48.5245671Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5245927Z 			"size": 473,
2025-03-14T04:12:48.5246186Z 			"digest": "sha256:f4328165c8f338158381d4a7bc37f4596966f29a09ff5b1cfd3c9e8fbb149342"
2025-03-14T04:12:48.5246466Z 		},
2025-03-14T04:12:48.5246609Z 		{
2025-03-14T04:12:48.5246823Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5247077Z 			"size": 32,
2025-03-14T04:12:48.5247336Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5247622Z 		},
2025-03-14T04:12:48.5247767Z 		{
2025-03-14T04:12:48.5247983Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5248237Z 			"size": 112,
2025-03-14T04:12:48.5248535Z 			"digest": "sha256:ced7420502578d83680bff46820c743cf2dc7d1f7bd6c4650fe189c940416b54"
2025-03-14T04:12:48.5248826Z 		},
2025-03-14T04:12:48.5248971Z 		{
2025-03-14T04:12:48.5249187Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5249446Z 			"size": 565,
2025-03-14T04:12:48.5249698Z 			"digest": "sha256:7543460794d1c69c1e1a7e1edba30a6239234fb5014d8b334f01f8addc38128e"
2025-03-14T04:12:48.5249982Z 		},
2025-03-14T04:12:48.5250126Z 		{
2025-03-14T04:12:48.5250344Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5250602Z 			"size": 43164080,
2025-03-14T04:12:48.5250879Z 			"digest": "sha256:81f896b48ff04356cc2ca3a784defda917a1bc7f9ccc1a3c0dbdf15b1d1cf156"
2025-03-14T04:12:48.5251170Z 		},
2025-03-14T04:12:48.5251316Z 		{
2025-03-14T04:12:48.5251529Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5251785Z 			"size": 106,
2025-03-14T04:12:48.5252041Z 			"digest": "sha256:f11b5769703741548b6910c4cf3891909c6fc2153c15ddf1596145939bc1f675"
2025-03-14T04:12:48.5252316Z 		},
2025-03-14T04:12:48.5252461Z 		{
2025-03-14T04:12:48.5252676Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5252933Z 			"size": 345,
2025-03-14T04:12:48.5253198Z 			"digest": "sha256:d09490ef7bbf73ff136691138f700147ae2c817b845e5ea9a86e1c3be639c159"
2025-03-14T04:12:48.5253483Z 		},
2025-03-14T04:12:48.5253624Z 		{
2025-03-14T04:12:48.5253840Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5254091Z 			"size": 32,
2025-03-14T04:12:48.5254355Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5254639Z 		},
2025-03-14T04:12:48.5254781Z 		{
2025-03-14T04:12:48.5254993Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5255249Z 			"size": 106,
2025-03-14T04:12:48.5255509Z 			"digest": "sha256:595c6ea973ce7878ed25917778eaa88783efa7e652b515158353e878cedce9fa"
2025-03-14T04:12:48.5255792Z 		},
2025-03-14T04:12:48.5255934Z 		{
2025-03-14T04:12:48.5256148Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5256592Z 			"size": 425,
2025-03-14T04:12:48.5256959Z 			"digest": "sha256:b65570655a311da76613ae5622813bfe1741f803bd187d1f83d1542c73c3ceed"
2025-03-14T04:12:48.5257250Z 		},
2025-03-14T04:12:48.5257392Z 		{
2025-03-14T04:12:48.5257612Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5257888Z 			"size": 19308697,
2025-03-14T04:12:48.5258161Z 			"digest": "sha256:f3024011b7b6bb9bbd71304103e6e4c7e7cf6cc0e616150929ffcdb4660be46b"
2025-03-14T04:12:48.5258451Z 		},
2025-03-14T04:12:48.5258597Z 		{
2025-03-14T04:12:48.5258811Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5259069Z 			"size": 105,
2025-03-14T04:12:48.5259327Z 			"digest": "sha256:0b7e81f1bc5d8e9784247bb0d869e69737e76887e24b3ef6773f42405a938f63"
2025-03-14T04:12:48.5259626Z 		},
2025-03-14T04:12:48.5259774Z 		{
2025-03-14T04:12:48.5259994Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5260251Z 			"size": 643,
2025-03-14T04:12:48.5260515Z 			"digest": "sha256:c9603583aaa028021352754f45cfaedb840742c6578e1efada89ec05c07d5082"
2025-03-14T04:12:48.5260810Z 		},
2025-03-14T04:12:48.5260956Z 		{
2025-03-14T04:12:48.5261178Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5261433Z 			"size": 701,
2025-03-14T04:12:48.5261732Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5262022Z 		},
2025-03-14T04:12:48.5262170Z 		{
2025-03-14T04:12:48.5262391Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5262652Z 			"size": 143,
2025-03-14T04:12:48.5262909Z 			"digest": "sha256:68f75179d12201922607e31597da3d213875a942f8012b1c43d43c357499b646"
2025-03-14T04:12:48.5263191Z 		},
2025-03-14T04:12:48.5263343Z 		{
2025-03-14T04:12:48.5263624Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5263894Z 			"size": 136,
2025-03-14T04:12:48.5264164Z 			"digest": "sha256:2ce6ce002394ba831fcec41621aa011ca17592a66c8020b64eb1fe58505f2ed4"
2025-03-14T04:12:48.5264462Z 		},
2025-03-14T04:12:48.5264607Z 		{
2025-03-14T04:12:48.5264834Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5265102Z 			"size": 5219780266,
2025-03-14T04:12:48.5265391Z 			"digest": "sha256:cb03b7532b5e2d7fbb9a55d16acbdc1fd4f52b9cc00e62003118e2c820bbdd07"
2025-03-14T04:12:48.5265683Z 		},
2025-03-14T04:12:48.5265830Z 		{
2025-03-14T04:12:48.5266055Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5266320Z 			"size": 196,
2025-03-14T04:12:48.5266593Z 			"digest": "sha256:046ab5a4210dd05ee2a4d9ed8f1f5c86bf8ac03438dd03bb9f586578f0b40434"
2025-03-14T04:12:48.5266891Z 		},
2025-03-14T04:12:48.5267037Z 		{
2025-03-14T04:12:48.5267260Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5267526Z 			"size": 1401,
2025-03-14T04:12:48.5267810Z 			"digest": "sha256:da2b385f2f548b4fdb79d4a5f8dcaceff0a8e1c0ef59425e041cf189dfe66f74"
2025-03-14T04:12:48.5268109Z 		},
2025-03-14T04:12:48.5268257Z 		{
2025-03-14T04:12:48.5268480Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5268743Z 			"size": 701,
2025-03-14T04:12:48.5269007Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5269298Z 		},
2025-03-14T04:12:48.5269439Z 		{
2025-03-14T04:12:48.5269659Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5269924Z 			"size": 139,
2025-03-14T04:12:48.5270189Z 			"digest": "sha256:7bc635713dd5ff2321baf7a09438d605c0145a774060722495c5682045e3eed1"
2025-03-14T04:12:48.5270479Z 		},
2025-03-14T04:12:48.5270624Z 		{
2025-03-14T04:12:48.5270843Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5271105Z 			"size": 5175240887,
2025-03-14T04:12:48.5271454Z 			"digest": "sha256:cd296e79aaba46073adfef39e70b87062399ab2648d531184bdae59da7021328"
2025-03-14T04:12:48.5271757Z 		},
2025-03-14T04:12:48.5271906Z 		{
2025-03-14T04:12:48.5272179Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5272455Z 			"size": 155,
2025-03-14T04:12:48.5272716Z 			"digest": "sha256:26ea03719a99ff44da69ffcc24e8f006472a88c1160a1b48f194d012108735b3"
2025-03-14T04:12:48.5273003Z 		},
2025-03-14T04:12:48.5273148Z 		{
2025-03-14T04:12:48.5273356Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5273614Z 			"size": 1401,
2025-03-14T04:12:48.5273892Z 			"digest": "sha256:da2b385f2f548b4fdb79d4a5f8dcaceff0a8e1c0ef59425e041cf189dfe66f74"
2025-03-14T04:12:48.5274194Z 		},
2025-03-14T04:12:48.5274337Z 		{
2025-03-14T04:12:48.5274553Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5274812Z 			"size": 701,
2025-03-14T04:12:48.5275070Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5275353Z 		},
2025-03-14T04:12:48.5275495Z 		{
2025-03-14T04:12:48.5275710Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5275969Z 			"size": 139,
2025-03-14T04:12:48.5276234Z 			"digest": "sha256:f37a0227cb699ac15b09aa6ef41075ffe443681db0af5841da6553a2090fbfe6"
2025-03-14T04:12:48.5276522Z 		},
2025-03-14T04:12:48.5276664Z 		{
2025-03-14T04:12:48.5276880Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5277132Z 			"size": 32,
2025-03-14T04:12:48.5277399Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5277689Z 		},
2025-03-14T04:12:48.5277830Z 		{
2025-03-14T04:12:48.5278046Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5278304Z 			"size": 160,
2025-03-14T04:12:48.5278616Z 			"digest": "sha256:0bd4004e84e3c2791c68438d3e95d8c82de275d45fb9a3ddf018d8d6dc8ffdc2"
2025-03-14T04:12:48.5278905Z 		},
2025-03-14T04:12:48.5279049Z 		{
2025-03-14T04:12:48.5279264Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5279521Z 			"size": 765,
2025-03-14T04:12:48.5279783Z 			"digest": "sha256:967b86e63131ae345453e13efb40580cc1c734b0eb75aa6c65aa173a45946211"
2025-03-14T04:12:48.5280067Z 		},
2025-03-14T04:12:48.5280215Z 		{
2025-03-14T04:12:48.5280432Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5280686Z 			"size": 701,
2025-03-14T04:12:48.5280945Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5281218Z 		},
2025-03-14T04:12:48.5281361Z 		{
2025-03-14T04:12:48.5281576Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5281832Z 			"size": 138,
2025-03-14T04:12:48.5282098Z 			"digest": "sha256:905d662f8eef91929aef8d9f01cfd429c3ecb16b2544892af0aeb64d98122115"
2025-03-14T04:12:48.5282385Z 		},
2025-03-14T04:12:48.5282529Z 		{
2025-03-14T04:12:48.5282742Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5282997Z 			"size": 32,
2025-03-14T04:12:48.5283265Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5283551Z 		},
2025-03-14T04:12:48.5283694Z 		{
2025-03-14T04:12:48.5283909Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5284163Z 			"size": 159,
2025-03-14T04:12:48.5284427Z 			"digest": "sha256:39fff80b800e3735de2c6daf433e9df8cf0b4b02bcc5b2f62ba6154177fde92c"
2025-03-14T04:12:48.5284717Z 		},
2025-03-14T04:12:48.5284851Z 		{
2025-03-14T04:12:48.5285064Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5285316Z 			"size": 907,
2025-03-14T04:12:48.5285573Z 			"digest": "sha256:d681503af97af958755d5133477828ceca373627a9a0354ec6ba5f355c576422"
2025-03-14T04:12:48.5285855Z 		},
2025-03-14T04:12:48.5285997Z 		{
2025-03-14T04:12:48.5286210Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5286460Z 			"size": 701,
2025-03-14T04:12:48.5286717Z 			"digest": "sha256:1e2892d1c0d6f1b67d3ba1d866912303eac78217715c2fa8631fd39c22f81996"
2025-03-14T04:12:48.5287040Z 		},
2025-03-14T04:12:48.5287183Z 		{
2025-03-14T04:12:48.5287395Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5287648Z 			"size": 134,
2025-03-14T04:12:48.5287909Z 			"digest": "sha256:acd125116d9b9aa3745376e8edce601ca8c1cbe1f1cbd14d0d116b13ed58d436"
2025-03-14T04:12:48.5288202Z 		},
2025-03-14T04:12:48.5288343Z 		{
2025-03-14T04:12:48.5288550Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5288805Z 			"size": 32,
2025-03-14T04:12:48.5289069Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5289354Z 		},
2025-03-14T04:12:48.5289499Z 		{
2025-03-14T04:12:48.5289712Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5289967Z 			"size": 159,
2025-03-14T04:12:48.5290225Z 			"digest": "sha256:78b00f805b53e274a95890d94e0cae256b17552d517d2a19c38760a1d8ff107b"
2025-03-14T04:12:48.5290506Z 		},
2025-03-14T04:12:48.5290649Z 		{
2025-03-14T04:12:48.5290862Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5291113Z 			"size": 1485,
2025-03-14T04:12:48.5291378Z 			"digest": "sha256:8b3d8ccc53ec9443f345526e1411cbfb5910da12fad3f39f76ee42ce0ad14e1d"
2025-03-14T04:12:48.5291667Z 		},
2025-03-14T04:12:48.5291809Z 		{
2025-03-14T04:12:48.5292026Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5292278Z 			"size": 32,
2025-03-14T04:12:48.5292533Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5292818Z 		},
2025-03-14T04:12:48.5292961Z 		{
2025-03-14T04:12:48.5293217Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5293472Z 			"size": 135,
2025-03-14T04:12:48.5293735Z 			"digest": "sha256:07259ecbb7c987e75528fb0aa9e313d0ae77eb9a8f6e6249e4fdfd7d985a80b7"
2025-03-14T04:12:48.5294028Z 		},
2025-03-14T04:12:48.5294171Z 		{
2025-03-14T04:12:48.5294382Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5294633Z 			"size": 380,
2025-03-14T04:12:48.5294891Z 			"digest": "sha256:afabfb1e95267970e90e2058d9c09f857443f80b997adfe57208801f5b8db81b"
2025-03-14T04:12:48.5295172Z 		},
2025-03-14T04:12:48.5295314Z 		{
2025-03-14T04:12:48.5295522Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5295774Z 			"size": 32,
2025-03-14T04:12:48.5296031Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5296306Z 		},
2025-03-14T04:12:48.5296446Z 		{
2025-03-14T04:12:48.5296663Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5296918Z 			"size": 104,
2025-03-14T04:12:48.5297178Z 			"digest": "sha256:56aa7cdd744f50ae4b9a678f5e53e7e9471f9dcf42ae8f15323d71ae01af8bd1"
2025-03-14T04:12:48.5297464Z 		},
2025-03-14T04:12:48.5297606Z 		{
2025-03-14T04:12:48.5297819Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5298070Z 			"size": 1899,
2025-03-14T04:12:48.5298337Z 			"digest": "sha256:3d413cedb292cce13e279df55899acbcf1227ea646c86a599808a03ae8b7aba9"
2025-03-14T04:12:48.5298620Z 		},
2025-03-14T04:12:48.5298761Z 		{
2025-03-14T04:12:48.5298972Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5299228Z 			"size": 196997029,
2025-03-14T04:12:48.5299501Z 			"digest": "sha256:c4d93cca7501ea10375008b5a60aef7eee5cf0d7d670fd766e7be3479726c58c"
2025-03-14T04:12:48.5299789Z 		},
2025-03-14T04:12:48.5299926Z 		{
2025-03-14T04:12:48.5300141Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5300400Z 			"size": 106,
2025-03-14T04:12:48.5300674Z 			"digest": "sha256:be17a58842f02580271fffb31b6d71f17498b862bce2cb181d9897e73ce18af5"
2025-03-14T04:12:48.5300956Z 		},
2025-03-14T04:12:48.5301097Z 		{
2025-03-14T04:12:48.5301311Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5301604Z 			"size": 163,
2025-03-14T04:12:48.5301869Z 			"digest": "sha256:af209379fbc2a1ce9c38f2383ec08f704de1b1eb23a531463224e80d937a13a3"
2025-03-14T04:12:48.5302155Z 		},
2025-03-14T04:12:48.5302300Z 		{
2025-03-14T04:12:48.5302516Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5302773Z 			"size": 7943,
2025-03-14T04:12:48.5303032Z 			"digest": "sha256:879b59207c78a7748870b6aea98a65bafa1b3f0c63ec86b59a9b142260d41250"
2025-03-14T04:12:48.5303315Z 		},
2025-03-14T04:12:48.5303456Z 		{
2025-03-14T04:12:48.5303664Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5303919Z 			"size": 8069,
2025-03-14T04:12:48.5304186Z 			"digest": "sha256:4918b9b279ff8944ea8eb1ba1ea23f23f39710864919f41470520c03f36ba04c"
2025-03-14T04:12:48.5304467Z 		},
2025-03-14T04:12:48.5304610Z 		{
2025-03-14T04:12:48.5304827Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5305089Z 			"size": 304,
2025-03-14T04:12:48.5305352Z 			"digest": "sha256:f3e4cb9dda5d3af4525d8c720afb11c9ba9a48a146bbfb268434720eb33f9b7b"
2025-03-14T04:12:48.5305641Z 		},
2025-03-14T04:12:48.5305783Z 		{
2025-03-14T04:12:48.5306000Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5306252Z 			"size": 32,
2025-03-14T04:12:48.5306515Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5306800Z 		},
2025-03-14T04:12:48.5306940Z 		{
2025-03-14T04:12:48.5307155Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5307408Z 			"size": 106,
2025-03-14T04:12:48.5307711Z 			"digest": "sha256:da83488e1344293ac1fcf6c9ed132b6a3746e8c347dc0c5b4ebc8e24a3b73eee"
2025-03-14T04:12:48.5308004Z 		},
2025-03-14T04:12:48.5308147Z 		{
2025-03-14T04:12:48.5308363Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5308623Z 			"size": 54145653,
2025-03-14T04:12:48.5308904Z 			"digest": "sha256:78dfb83debe9f57e9eec061eb7ad61e56e2549b77b32b9ca98395ba6655ab167"
2025-03-14T04:12:48.5309194Z 		},
2025-03-14T04:12:48.5309337Z 		{
2025-03-14T04:12:48.5309552Z 			"mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",
2025-03-14T04:12:48.5309813Z 			"size": 32,
2025-03-14T04:12:48.5310077Z 			"digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1"
2025-03-14T04:12:48.5310365Z 		}
2025-03-14T04:12:48.5310510Z 	]
2025-03-14T04:12:48.5310658Z }
2025-03-14T04:12:48.5310827Z + exit 0
2025-03-14T04:12:48.5345410Z ##[group]Run set -eux
2025-03-14T04:12:48.5345635Z set -eux
2025-03-14T04:12:48.5346167Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin
2025-03-14T04:12:48.5351711Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:48.5351984Z env:
2025-03-14T04:12:48.5352164Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:48.5352365Z ##[endgroup]
2025-03-14T04:12:48.5379299Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token
2025-03-14T04:12:48.5383438Z + docker login --username pytorchbot --password-stdin
2025-03-14T04:12:48.5388206Z + jq -r .docker_hub_readonly_token
2025-03-14T04:12:48.5395390Z + jq --raw-output .SecretString
2025-03-14T04:12:48.9904597Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T04:12:48.9904961Z Login Succeeded
2025-03-14T04:12:48.9907111Z Configure a credential helper to remove this warning. See
2025-03-14T04:12:48.9907602Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T04:12:48.9907845Z 
2025-03-14T04:12:48.9999783Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/}
2025-03-14T04:12:49.0000126Z tag=${ECR_DOCKER_IMAGE##*/}
2025-03-14T04:12:49.0000439Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}"
2025-03-14T04:12:49.0005171Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:49.0005503Z env:
2025-03-14T04:12:49.0005749Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:49.0006313Z   ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.0006895Z ##[endgroup]
2025-03-14T04:12:49.0030097Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks-aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.0082991Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main
2025-03-14T04:12:49.0083331Z with:
2025-03-14T04:12:49.0083921Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.0084523Z   docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:49.0084854Z env:
2025-03-14T04:12:49.0085092Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:49.0085340Z ##[endgroup]
2025-03-14T04:12:49.0144584Z ##[group]Run set -x
2025-03-14T04:12:49.0144787Z set -x
2025-03-14T04:12:49.0144961Z set +e
2025-03-14T04:12:49.0145125Z 
2025-03-14T04:12:49.0145286Z login() {
2025-03-14T04:12:49.0145600Z   aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1"
2025-03-14T04:12:49.0145915Z }
2025-03-14T04:12:49.0146072Z 
2025-03-14T04:12:49.0146273Z retry () {
2025-03-14T04:12:49.0146460Z   $*  || (sleep 1 && $*) || (sleep 2 && $*)
2025-03-14T04:12:49.0146673Z }
2025-03-14T04:12:49.0146826Z 
2025-03-14T04:12:49.0146997Z retry login "${DOCKER_REGISTRY}"
2025-03-14T04:12:49.0147205Z 
2025-03-14T04:12:49.0147359Z set -e
2025-03-14T04:12:49.0147590Z # ignore output since only exit code is used for conditional
2025-03-14T04:12:49.0147898Z # only pull docker image if it's not available locally
2025-03-14T04:12:49.0148229Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then
2025-03-14T04:12:49.0148537Z   retry docker pull "${DOCKER_IMAGE}"
2025-03-14T04:12:49.0148751Z fi
2025-03-14T04:12:49.0152398Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:12:49.0152651Z env:
2025-03-14T04:12:49.0152825Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:12:49.0153378Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.0153907Z   DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:49.0154161Z ##[endgroup]
2025-03-14T04:12:49.0175578Z + set +e
2025-03-14T04:12:49.0177847Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:49.0178277Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:49.0183825Z + aws ecr get-login-password --region us-east-1
2025-03-14T04:12:49.0186038Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com
2025-03-14T04:12:49.4228043Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json.
2025-03-14T04:12:49.4228490Z Configure a credential helper to remove this warning. See
2025-03-14T04:12:49.4228902Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store
2025-03-14T04:12:49.4229140Z 
2025-03-14T04:12:49.4238564Z Login Succeeded
2025-03-14T04:12:49.4250521Z + set -e
2025-03-14T04:12:49.4251085Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.4383223Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.4384553Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:12:49.6890208Z aa89d6e739080d90fa18625d57297c6734465849: Pulling from pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks
2025-03-14T04:12:49.6895983Z 8f84a9f2102e: Pulling fs layer
2025-03-14T04:12:49.6896391Z f35880ae6ee6: Pulling fs layer
2025-03-14T04:12:49.6896642Z 8eb502731466: Pulling fs layer
2025-03-14T04:12:49.6897149Z d4ce6a1f04ff: Pulling fs layer
2025-03-14T04:12:49.6897364Z ca18d6003a18: Pulling fs layer
2025-03-14T04:12:49.6897570Z f6b56646e2f0: Pulling fs layer
2025-03-14T04:12:49.6897766Z 454c9d6c7abb: Pulling fs layer
2025-03-14T04:12:49.6897961Z a66b8377f49f: Pulling fs layer
2025-03-14T04:12:49.6898153Z c75867b7d634: Pulling fs layer
2025-03-14T04:12:49.6898391Z 64866485623d: Pulling fs layer
2025-03-14T04:12:49.6898578Z 04b678046b3a: Pulling fs layer
2025-03-14T04:12:49.6898779Z 1e2892d1c0d6: Pulling fs layer
2025-03-14T04:12:49.6898970Z 564c8877ceb5: Pulling fs layer
2025-03-14T04:12:49.6899163Z 8d7dafab91e2: Pulling fs layer
2025-03-14T04:12:49.6899356Z 4f4fb700ef54: Pulling fs layer
2025-03-14T04:12:49.6899545Z 3195860f4968: Pulling fs layer
2025-03-14T04:12:49.6899737Z 64889f83e276: Pulling fs layer
2025-03-14T04:12:49.6899926Z a2f45c18f0c1: Pulling fs layer
2025-03-14T04:12:49.6900105Z 16d7101d1441: Pulling fs layer
2025-03-14T04:12:49.6900300Z 9f39c1b701e2: Pulling fs layer
2025-03-14T04:12:49.6900498Z 2edf8a767cf2: Pulling fs layer
2025-03-14T04:12:49.6900688Z 6ee1d4017bc6: Pulling fs layer
2025-03-14T04:12:49.6900882Z aa5b1d7b7a2c: Pulling fs layer
2025-03-14T04:12:49.6901069Z 6100538713cb: Pulling fs layer
2025-03-14T04:12:49.6901259Z f53dff608124: Pulling fs layer
2025-03-14T04:12:49.6901487Z 692dab4cd4df: Pulling fs layer
2025-03-14T04:12:49.6901715Z 2e13cb071445: Pulling fs layer
2025-03-14T04:12:49.6901905Z 12fc0b985540: Pulling fs layer
2025-03-14T04:12:49.6902097Z 9c0523cdc042: Pulling fs layer
2025-03-14T04:12:49.6902287Z 76be39b43c8f: Pulling fs layer
2025-03-14T04:12:49.6902476Z a813b158a421: Pulling fs layer
2025-03-14T04:12:49.6902664Z bbc30b7542d1: Pulling fs layer
2025-03-14T04:12:49.6902852Z 2a30d35d5515: Pulling fs layer
2025-03-14T04:12:49.6903040Z 34c633845b89: Pulling fs layer
2025-03-14T04:12:49.6903220Z f4328165c8f3: Pulling fs layer
2025-03-14T04:12:49.6903410Z ced742050257: Pulling fs layer
2025-03-14T04:12:49.6903596Z 7543460794d1: Pulling fs layer
2025-03-14T04:12:49.6903789Z 81f896b48ff0: Pulling fs layer
2025-03-14T04:12:49.6903976Z f11b57697037: Pulling fs layer
2025-03-14T04:12:49.6904166Z d09490ef7bbf: Pulling fs layer
2025-03-14T04:12:49.6904358Z 595c6ea973ce: Pulling fs layer
2025-03-14T04:12:49.6904545Z b65570655a31: Pulling fs layer
2025-03-14T04:12:49.6904732Z f3024011b7b6: Pulling fs layer
2025-03-14T04:12:49.6904922Z 0b7e81f1bc5d: Pulling fs layer
2025-03-14T04:12:49.6905112Z c9603583aaa0: Pulling fs layer
2025-03-14T04:12:49.6905299Z 68f75179d122: Pulling fs layer
2025-03-14T04:12:49.6905835Z 2ce6ce002394: Pulling fs layer
2025-03-14T04:12:49.6906027Z cb03b7532b5e: Pulling fs layer
2025-03-14T04:12:49.6906215Z 046ab5a4210d: Pulling fs layer
2025-03-14T04:12:49.6906415Z da2b385f2f54: Pulling fs layer
2025-03-14T04:12:49.6906653Z f53dff608124: Waiting
2025-03-14T04:12:49.6906900Z 7bc635713dd5: Pulling fs layer
2025-03-14T04:12:49.6907163Z cd296e79aaba: Pulling fs layer
2025-03-14T04:12:49.6907382Z 692dab4cd4df: Waiting
2025-03-14T04:12:49.6907561Z 26ea03719a99: Pulling fs layer
2025-03-14T04:12:49.6907757Z f37a0227cb69: Pulling fs layer
2025-03-14T04:12:49.6908030Z 2e13cb071445: Waiting
2025-03-14T04:12:49.6908260Z 12fc0b985540: Waiting
2025-03-14T04:12:49.6908461Z 9c0523cdc042: Waiting
2025-03-14T04:12:49.6908687Z 76be39b43c8f: Waiting
2025-03-14T04:12:49.6908873Z 0bd4004e84e3: Pulling fs layer
2025-03-14T04:12:49.6909065Z a813b158a421: Waiting
2025-03-14T04:12:49.6909244Z 967b86e63131: Pulling fs layer
2025-03-14T04:12:49.6909575Z bbc30b7542d1: Waiting
2025-03-14T04:12:49.6909750Z 905d662f8eef: Pulling fs layer
2025-03-14T04:12:49.6909942Z 2a30d35d5515: Waiting
2025-03-14T04:12:49.6910126Z 39fff80b800e: Pulling fs layer
2025-03-14T04:12:49.6910326Z d681503af97a: Pulling fs layer
2025-03-14T04:12:49.6910520Z 34c633845b89: Waiting
2025-03-14T04:12:49.6910701Z f4328165c8f3: Waiting
2025-03-14T04:12:49.6910889Z acd125116d9b: Pulling fs layer
2025-03-14T04:12:49.6911087Z 78b00f805b53: Pulling fs layer
2025-03-14T04:12:49.6911279Z 564c8877ceb5: Waiting
2025-03-14T04:12:49.6911737Z 8b3d8ccc53ec: Pulling fs layer
2025-03-14T04:12:49.6911957Z 07259ecbb7c9: Pulling fs layer
2025-03-14T04:12:49.6912161Z afabfb1e9526: Pulling fs layer
2025-03-14T04:12:49.6912365Z 56aa7cdd744f: Pulling fs layer
2025-03-14T04:12:49.6912564Z 3d413cedb292: Pulling fs layer
2025-03-14T04:12:49.6912761Z c4d93cca7501: Pulling fs layer
2025-03-14T04:12:49.6912976Z 16d7101d1441: Waiting
2025-03-14T04:12:49.6913160Z 9f39c1b701e2: Waiting
2025-03-14T04:12:49.6913340Z 2edf8a767cf2: Waiting
2025-03-14T04:12:49.6913518Z 4f4fb700ef54: Waiting
2025-03-14T04:12:49.6913691Z 3195860f4968: Waiting
2025-03-14T04:12:49.6913865Z a2f45c18f0c1: Waiting
2025-03-14T04:12:49.6914038Z 64889f83e276: Waiting
2025-03-14T04:12:49.6914208Z ced742050257: Waiting
2025-03-14T04:12:49.6914381Z 7543460794d1: Waiting
2025-03-14T04:12:49.6914544Z 81f896b48ff0: Waiting
2025-03-14T04:12:49.6914720Z f11b57697037: Waiting
2025-03-14T04:12:49.6914893Z d09490ef7bbf: Waiting
2025-03-14T04:12:49.6915067Z 6ee1d4017bc6: Waiting
2025-03-14T04:12:49.6915241Z f37a0227cb69: Waiting
2025-03-14T04:12:49.6915415Z aa5b1d7b7a2c: Waiting
2025-03-14T04:12:49.6915596Z 6100538713cb: Waiting
2025-03-14T04:12:49.6915764Z acd125116d9b: Waiting
2025-03-14T04:12:49.6915933Z 78b00f805b53: Waiting
2025-03-14T04:12:49.6916105Z 8b3d8ccc53ec: Waiting
2025-03-14T04:12:49.6916277Z 0bd4004e84e3: Waiting
2025-03-14T04:12:49.6916448Z 967b86e63131: Waiting
2025-03-14T04:12:49.6916619Z 595c6ea973ce: Waiting
2025-03-14T04:12:49.6916791Z 64866485623d: Waiting
2025-03-14T04:12:49.6916957Z 454c9d6c7abb: Waiting
2025-03-14T04:12:49.6917130Z a66b8377f49f: Waiting
2025-03-14T04:12:49.6917301Z ca18d6003a18: Waiting
2025-03-14T04:12:49.6917473Z b65570655a31: Waiting
2025-03-14T04:12:49.6917645Z 8d7dafab91e2: Waiting
2025-03-14T04:12:49.6917819Z c75867b7d634: Waiting
2025-03-14T04:12:49.6918008Z be17a58842f0: Pulling fs layer
2025-03-14T04:12:49.6918202Z 905d662f8eef: Waiting
2025-03-14T04:12:49.6918385Z af209379fbc2: Pulling fs layer
2025-03-14T04:12:49.6918584Z 879b59207c78: Pulling fs layer
2025-03-14T04:12:49.6918780Z 39fff80b800e: Waiting
2025-03-14T04:12:49.6918952Z 04b678046b3a: Waiting
2025-03-14T04:12:49.6919131Z 4918b9b279ff: Pulling fs layer
2025-03-14T04:12:49.6919324Z 1e2892d1c0d6: Waiting
2025-03-14T04:12:49.6919501Z f3e4cb9dda5d: Pulling fs layer
2025-03-14T04:12:49.6919698Z 07259ecbb7c9: Waiting
2025-03-14T04:12:49.6919878Z da83488e1344: Pulling fs layer
2025-03-14T04:12:49.6920071Z d681503af97a: Waiting
2025-03-14T04:12:49.6920252Z afabfb1e9526: Waiting
2025-03-14T04:12:49.6920436Z 78dfb83debe9: Pulling fs layer
2025-03-14T04:12:49.6920634Z d4ce6a1f04ff: Waiting
2025-03-14T04:12:49.6920929Z 56aa7cdd744f: Waiting
2025-03-14T04:12:49.6921120Z be17a58842f0: Waiting
2025-03-14T04:12:49.6921290Z 4918b9b279ff: Waiting
2025-03-14T04:12:49.6921613Z f3e4cb9dda5d: Waiting
2025-03-14T04:12:49.6921940Z da83488e1344: Waiting
2025-03-14T04:12:49.6922177Z da2b385f2f54: Waiting
2025-03-14T04:12:49.6922426Z 78dfb83debe9: Waiting
2025-03-14T04:12:49.6922651Z 3d413cedb292: Waiting
2025-03-14T04:12:49.6922918Z c4d93cca7501: Waiting
2025-03-14T04:12:49.6923111Z 7bc635713dd5: Waiting
2025-03-14T04:12:49.6923279Z 26ea03719a99: Waiting
2025-03-14T04:12:49.6923445Z af209379fbc2: Waiting
2025-03-14T04:12:49.6923626Z 879b59207c78: Waiting
2025-03-14T04:12:49.6923846Z 0b7e81f1bc5d: Waiting
2025-03-14T04:12:49.6924079Z 68f75179d122: Waiting
2025-03-14T04:12:49.6924331Z cb03b7532b5e: Waiting
2025-03-14T04:12:49.6924507Z 046ab5a4210d: Waiting
2025-03-14T04:12:49.6924806Z c9603583aaa0: Waiting
2025-03-14T04:12:49.6924975Z cd296e79aaba: Waiting
2025-03-14T04:12:49.7676793Z f35880ae6ee6: Verifying Checksum
2025-03-14T04:12:49.7677227Z f35880ae6ee6: Download complete
2025-03-14T04:12:49.8505521Z d4ce6a1f04ff: Verifying Checksum
2025-03-14T04:12:49.8507873Z d4ce6a1f04ff: Download complete
2025-03-14T04:12:49.9392724Z ca18d6003a18: Verifying Checksum
2025-03-14T04:12:49.9393112Z ca18d6003a18: Download complete
2025-03-14T04:12:50.0576611Z 8f84a9f2102e: Verifying Checksum
2025-03-14T04:12:50.0603807Z 8f84a9f2102e: Download complete
2025-03-14T04:12:50.0728657Z f6b56646e2f0: Verifying Checksum
2025-03-14T04:12:50.0729091Z f6b56646e2f0: Download complete
2025-03-14T04:12:50.1500038Z a66b8377f49f: Verifying Checksum
2025-03-14T04:12:50.1500356Z 454c9d6c7abb: Verifying Checksum
2025-03-14T04:12:50.1500568Z a66b8377f49f: Download complete
2025-03-14T04:12:50.1500804Z 454c9d6c7abb: Download complete
2025-03-14T04:12:50.2394187Z 64866485623d: Download complete
2025-03-14T04:12:50.3517136Z 04b678046b3a: Verifying Checksum
2025-03-14T04:12:50.3517461Z 04b678046b3a: Download complete
2025-03-14T04:12:50.5071658Z 1e2892d1c0d6: Download complete
2025-03-14T04:12:50.5964195Z 564c8877ceb5: Download complete
2025-03-14T04:12:51.0896279Z 8f84a9f2102e: Pull complete
2025-03-14T04:12:51.1151560Z f35880ae6ee6: Pull complete
2025-03-14T04:12:51.3022202Z c75867b7d634: Verifying Checksum
2025-03-14T04:12:51.3022542Z c75867b7d634: Download complete
2025-03-14T04:12:51.3112799Z 4f4fb700ef54: Download complete
2025-03-14T04:12:51.4102105Z 3195860f4968: Verifying Checksum
2025-03-14T04:12:51.4102414Z 3195860f4968: Download complete
2025-03-14T04:12:51.4959706Z 64889f83e276: Verifying Checksum
2025-03-14T04:12:51.4960002Z 64889f83e276: Download complete
2025-03-14T04:12:51.5674579Z a2f45c18f0c1: Verifying Checksum
2025-03-14T04:12:51.5674884Z a2f45c18f0c1: Download complete
2025-03-14T04:12:51.6631285Z 16d7101d1441: Download complete
2025-03-14T04:12:51.7352732Z 9f39c1b701e2: Download complete
2025-03-14T04:12:51.8117360Z 2edf8a767cf2: Verifying Checksum
2025-03-14T04:12:51.8119224Z 2edf8a767cf2: Download complete
2025-03-14T04:12:51.9079351Z 6ee1d4017bc6: Download complete
2025-03-14T04:12:51.9980600Z aa5b1d7b7a2c: Verifying Checksum
2025-03-14T04:12:51.9985257Z aa5b1d7b7a2c: Download complete
2025-03-14T04:12:52.0879508Z 6100538713cb: Verifying Checksum
2025-03-14T04:12:52.0883284Z 6100538713cb: Download complete
2025-03-14T04:12:52.9813752Z 8eb502731466: Download complete
2025-03-14T04:12:53.0591155Z 692dab4cd4df: Verifying Checksum
2025-03-14T04:12:53.0591679Z 692dab4cd4df: Download complete
2025-03-14T04:12:53.1456881Z 2e13cb071445: Verifying Checksum
2025-03-14T04:12:53.1461963Z 2e13cb071445: Download complete
2025-03-14T04:12:53.1670213Z f53dff608124: Verifying Checksum
2025-03-14T04:12:53.1670492Z f53dff608124: Download complete
2025-03-14T04:12:53.2200496Z 12fc0b985540: Verifying Checksum
2025-03-14T04:12:53.2200740Z 12fc0b985540: Download complete
2025-03-14T04:12:53.2331169Z 9c0523cdc042: Verifying Checksum
2025-03-14T04:12:53.2331582Z 9c0523cdc042: Download complete
2025-03-14T04:12:53.3103291Z 76be39b43c8f: Verifying Checksum
2025-03-14T04:12:53.3103610Z 76be39b43c8f: Download complete
2025-03-14T04:12:53.3851496Z bbc30b7542d1: Verifying Checksum
2025-03-14T04:12:53.3851818Z bbc30b7542d1: Download complete
2025-03-14T04:12:53.4843643Z 2a30d35d5515: Download complete
2025-03-14T04:12:53.5695054Z 34c633845b89: Verifying Checksum
2025-03-14T04:12:53.5695477Z 34c633845b89: Download complete
2025-03-14T04:12:53.6712039Z f4328165c8f3: Verifying Checksum
2025-03-14T04:12:53.6712612Z f4328165c8f3: Download complete
2025-03-14T04:12:53.7409757Z ced742050257: Verifying Checksum
2025-03-14T04:12:53.7410086Z ced742050257: Download complete
2025-03-14T04:12:53.8366428Z 7543460794d1: Verifying Checksum
2025-03-14T04:12:53.8366735Z 7543460794d1: Download complete
2025-03-14T04:12:54.3134925Z 81f896b48ff0: Verifying Checksum
2025-03-14T04:12:54.3138278Z 81f896b48ff0: Download complete
2025-03-14T04:12:54.3876410Z f11b57697037: Verifying Checksum
2025-03-14T04:12:54.3876970Z f11b57697037: Download complete
2025-03-14T04:12:54.4832269Z d09490ef7bbf: Download complete
2025-03-14T04:12:54.5748958Z 595c6ea973ce: Verifying Checksum
2025-03-14T04:12:54.5749288Z 595c6ea973ce: Download complete
2025-03-14T04:12:54.6614291Z b65570655a31: Download complete
2025-03-14T04:12:54.9143518Z f3024011b7b6: Verifying Checksum
2025-03-14T04:12:54.9147764Z f3024011b7b6: Download complete
2025-03-14T04:12:54.9975327Z 0b7e81f1bc5d: Download complete
2025-03-14T04:12:55.0710913Z c9603583aaa0: Download complete
2025-03-14T04:12:55.1576598Z 68f75179d122: Verifying Checksum
2025-03-14T04:12:55.1577358Z 68f75179d122: Download complete
2025-03-14T04:12:55.2335181Z 2ce6ce002394: Verifying Checksum
2025-03-14T04:12:55.2336865Z 2ce6ce002394: Download complete
2025-03-14T04:12:57.7557766Z a813b158a421: Verifying Checksum
2025-03-14T04:12:57.7558329Z a813b158a421: Download complete
2025-03-14T04:12:57.8524277Z 046ab5a4210d: Download complete
2025-03-14T04:12:57.9226268Z da2b385f2f54: Verifying Checksum
2025-03-14T04:12:57.9226589Z da2b385f2f54: Download complete
2025-03-14T04:12:58.0254713Z 7bc635713dd5: Verifying Checksum
2025-03-14T04:12:58.0257914Z 7bc635713dd5: Download complete
2025-03-14T04:13:01.7017030Z 8eb502731466: Pull complete
2025-03-14T04:13:01.7298079Z d4ce6a1f04ff: Pull complete
2025-03-14T04:13:01.7551168Z ca18d6003a18: Pull complete
2025-03-14T04:13:01.7803198Z f6b56646e2f0: Pull complete
2025-03-14T04:13:01.8105019Z 454c9d6c7abb: Pull complete
2025-03-14T04:13:01.8321571Z a66b8377f49f: Pull complete
2025-03-14T04:13:04.7208111Z c75867b7d634: Pull complete
2025-03-14T04:13:04.7670689Z 64866485623d: Pull complete
2025-03-14T04:13:04.7909241Z 04b678046b3a: Pull complete
2025-03-14T04:13:04.8157440Z 1e2892d1c0d6: Pull complete
2025-03-14T04:13:04.8381673Z 564c8877ceb5: Pull complete
2025-03-14T04:13:23.0291712Z 8d7dafab91e2: Verifying Checksum
2025-03-14T04:13:23.0294800Z 8d7dafab91e2: Download complete
2025-03-14T04:13:23.1280821Z 26ea03719a99: Verifying Checksum
2025-03-14T04:13:23.1286171Z 26ea03719a99: Download complete
2025-03-14T04:13:23.2610684Z f37a0227cb69: Verifying Checksum
2025-03-14T04:13:23.2616245Z f37a0227cb69: Download complete
2025-03-14T04:13:23.3442582Z 0bd4004e84e3: Download complete
2025-03-14T04:13:23.4467700Z 967b86e63131: Verifying Checksum
2025-03-14T04:13:23.4468864Z 967b86e63131: Download complete
2025-03-14T04:13:23.5392676Z 905d662f8eef: Verifying Checksum
2025-03-14T04:13:23.5392996Z 905d662f8eef: Download complete
2025-03-14T04:13:23.6354428Z 39fff80b800e: Download complete
2025-03-14T04:13:23.7218770Z d681503af97a: Verifying Checksum
2025-03-14T04:13:23.7220670Z d681503af97a: Download complete
2025-03-14T04:13:23.8037641Z acd125116d9b: Verifying Checksum
2025-03-14T04:13:23.8042646Z acd125116d9b: Download complete
2025-03-14T04:13:23.9670136Z 78b00f805b53: Download complete
2025-03-14T04:13:24.0459709Z 8b3d8ccc53ec: Verifying Checksum
2025-03-14T04:13:24.0523405Z 8b3d8ccc53ec: Download complete
2025-03-14T04:13:24.1187577Z 07259ecbb7c9: Verifying Checksum
2025-03-14T04:13:24.1188091Z 07259ecbb7c9: Download complete
2025-03-14T04:13:24.1981271Z afabfb1e9526: Download complete
2025-03-14T04:13:24.2847769Z 56aa7cdd744f: Verifying Checksum
2025-03-14T04:13:24.2848297Z 56aa7cdd744f: Download complete
2025-03-14T04:13:24.3742788Z 3d413cedb292: Verifying Checksum
2025-03-14T04:13:24.3743115Z 3d413cedb292: Download complete
2025-03-14T04:13:27.6725275Z c4d93cca7501: Verifying Checksum
2025-03-14T04:13:27.6729245Z c4d93cca7501: Download complete
2025-03-14T04:13:27.8766669Z be17a58842f0: Verifying Checksum
2025-03-14T04:13:27.8771540Z be17a58842f0: Download complete
2025-03-14T04:13:27.9911581Z af209379fbc2: Download complete
2025-03-14T04:13:28.0791715Z 879b59207c78: Verifying Checksum
2025-03-14T04:13:28.0792051Z 879b59207c78: Download complete
2025-03-14T04:13:28.1756660Z 4918b9b279ff: Verifying Checksum
2025-03-14T04:13:28.1756938Z 4918b9b279ff: Download complete
2025-03-14T04:13:28.2528032Z f3e4cb9dda5d: Verifying Checksum
2025-03-14T04:13:28.2529043Z f3e4cb9dda5d: Download complete
2025-03-14T04:13:28.3531462Z da83488e1344: Verifying Checksum
2025-03-14T04:13:28.3533178Z da83488e1344: Download complete
2025-03-14T04:13:29.3033633Z 78dfb83debe9: Verifying Checksum
2025-03-14T04:13:29.3034093Z 78dfb83debe9: Download complete
2025-03-14T04:14:07.0948295Z cb03b7532b5e: Verifying Checksum
2025-03-14T04:14:07.0948641Z cb03b7532b5e: Download complete
2025-03-14T04:14:12.6305873Z cd296e79aaba: Verifying Checksum
2025-03-14T04:14:12.6306190Z cd296e79aaba: Download complete
2025-03-14T04:14:20.4218839Z 8d7dafab91e2: Pull complete
2025-03-14T04:14:20.7580686Z 4f4fb700ef54: Pull complete
2025-03-14T04:14:21.1172225Z 3195860f4968: Pull complete
2025-03-14T04:14:21.6091697Z 64889f83e276: Pull complete
2025-03-14T04:14:22.1132966Z a2f45c18f0c1: Pull complete
2025-03-14T04:14:22.7438552Z 16d7101d1441: Pull complete
2025-03-14T04:14:23.0749183Z 9f39c1b701e2: Pull complete
2025-03-14T04:14:23.4793762Z 2edf8a767cf2: Pull complete
2025-03-14T04:14:23.9291127Z 6ee1d4017bc6: Pull complete
2025-03-14T04:14:24.2626917Z aa5b1d7b7a2c: Pull complete
2025-03-14T04:14:24.6059341Z 6100538713cb: Pull complete
2025-03-14T04:14:27.6036199Z f53dff608124: Pull complete
2025-03-14T04:14:27.6428926Z 692dab4cd4df: Pull complete
2025-03-14T04:14:27.6836415Z 2e13cb071445: Pull complete
2025-03-14T04:14:27.7294332Z 12fc0b985540: Pull complete
2025-03-14T04:14:27.7696499Z 9c0523cdc042: Pull complete
2025-03-14T04:14:27.8254031Z 76be39b43c8f: Pull complete
2025-03-14T04:14:36.4600894Z a813b158a421: Pull complete
2025-03-14T04:14:36.4892900Z bbc30b7542d1: Pull complete
2025-03-14T04:14:36.5172434Z 2a30d35d5515: Pull complete
2025-03-14T04:14:36.5744295Z 34c633845b89: Pull complete
2025-03-14T04:14:36.6008298Z f4328165c8f3: Pull complete
2025-03-14T04:14:36.6814239Z ced742050257: Pull complete
2025-03-14T04:14:36.7211783Z 7543460794d1: Pull complete
2025-03-14T04:14:38.6409319Z 81f896b48ff0: Pull complete
2025-03-14T04:14:38.6576736Z f11b57697037: Pull complete
2025-03-14T04:14:38.6735895Z d09490ef7bbf: Pull complete
2025-03-14T04:14:38.7140450Z 595c6ea973ce: Pull complete
2025-03-14T04:14:38.7307624Z b65570655a31: Pull complete
2025-03-14T04:14:38.9824214Z f3024011b7b6: Pull complete
2025-03-14T04:14:39.0000010Z 0b7e81f1bc5d: Pull complete
2025-03-14T04:14:39.0217083Z c9603583aaa0: Pull complete
2025-03-14T04:14:39.0578038Z 68f75179d122: Pull complete
2025-03-14T04:14:39.0737654Z 2ce6ce002394: Pull complete
2025-03-14T04:15:24.8623940Z cb03b7532b5e: Pull complete
2025-03-14T04:15:25.3196385Z 046ab5a4210d: Pull complete
2025-03-14T04:15:25.7419576Z da2b385f2f54: Pull complete
2025-03-14T04:15:26.6360124Z 7bc635713dd5: Pull complete
2025-03-14T04:17:10.8804106Z cd296e79aaba: Pull complete
2025-03-14T04:17:11.3158790Z 26ea03719a99: Pull complete
2025-03-14T04:17:12.5941152Z f37a0227cb69: Pull complete
2025-03-14T04:17:13.3671142Z 0bd4004e84e3: Pull complete
2025-03-14T04:17:13.8077836Z 967b86e63131: Pull complete
2025-03-14T04:17:14.6267229Z 905d662f8eef: Pull complete
2025-03-14T04:17:15.4082896Z 39fff80b800e: Pull complete
2025-03-14T04:17:15.7782366Z d681503af97a: Pull complete
2025-03-14T04:17:16.4837398Z acd125116d9b: Pull complete
2025-03-14T04:17:17.2840952Z 78b00f805b53: Pull complete
2025-03-14T04:17:17.7178617Z 8b3d8ccc53ec: Pull complete
2025-03-14T04:17:18.2290818Z 07259ecbb7c9: Pull complete
2025-03-14T04:17:18.5503092Z afabfb1e9526: Pull complete
2025-03-14T04:17:19.3440281Z 56aa7cdd744f: Pull complete
2025-03-14T04:17:19.7643473Z 3d413cedb292: Pull complete
2025-03-14T04:17:27.3138350Z c4d93cca7501: Pull complete
2025-03-14T04:17:27.7952392Z be17a58842f0: Pull complete
2025-03-14T04:17:28.2302433Z af209379fbc2: Pull complete
2025-03-14T04:17:28.5823787Z 879b59207c78: Pull complete
2025-03-14T04:17:29.0386124Z 4918b9b279ff: Pull complete
2025-03-14T04:17:29.5762262Z f3e4cb9dda5d: Pull complete
2025-03-14T04:17:30.3739272Z da83488e1344: Pull complete
2025-03-14T04:17:32.4836727Z 78dfb83debe9: Pull complete
2025-03-14T04:17:33.2315763Z Digest: sha256:2f16eb7d476b5dc359eb789543b0cfc9aa5c04fe105d51acd219f91259bad5ab
2025-03-14T04:17:33.3077166Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:17:33.3540212Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:17:33.3587723Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:17:33.3588307Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT"
2025-03-14T04:17:33.3593878Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:33.3594144Z env:
2025-03-14T04:17:33.3594321Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:33.3594514Z ##[endgroup]
2025-03-14T04:17:33.3662421Z Prepare all required actions
2025-03-14T04:17:33.3900662Z ##[group]Run ./.github/actions/get-workflow-job-id
2025-03-14T04:17:33.3900908Z with:
2025-03-14T04:17:33.3901246Z   github-token: ***
2025-03-14T04:17:33.3901415Z env:
2025-03-14T04:17:33.3901578Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:33.3901766Z ##[endgroup]
2025-03-14T04:17:33.4047254Z ##[group]Run set -eux
2025-03-14T04:17:33.4047583Z set -eux
2025-03-14T04:17:33.4047879Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2025-03-14T04:17:33.4052207Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:33.4052453Z env:
2025-03-14T04:17:33.4052624Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:33.4053060Z   GITHUB_TOKEN: ***
2025-03-14T04:17:33.4053249Z ##[endgroup]
2025-03-14T04:17:33.4071694Z + python3 .github/scripts/get_workflow_job_id.py 13849515380 i-049962b53c600fa33
2025-03-14T04:17:33.9939202Z setting job-id=38754841887
2025-03-14T04:17:33.9943430Z setting job-name=linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:34.0181598Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 dataclasses_json==0.6.7
2025-03-14T04:17:34.0182059Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 dataclasses_json==0.6.7
2025-03-14T04:17:34.0182427Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 &
2025-03-14T04:17:34.0182738Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:17:34.0187225Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:34.0187483Z env:
2025-03-14T04:17:34.0187657Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:34.0187851Z   JOB_ID: 38754841887
2025-03-14T04:17:34.0188206Z   JOB_NAME: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:34.0188580Z   WORKFLOW_NAME: inductor
2025-03-14T04:17:34.0188782Z   WORKFLOW_RUN_ID: 13849515380
2025-03-14T04:17:34.0188996Z ##[endgroup]
2025-03-14T04:17:34.1844880Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T04:17:34.1975918Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1)
2025-03-14T04:17:34.1981233Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84)
2025-03-14T04:17:34.1986563Z Requirement already satisfied: dataclasses_json==0.6.7 in /home/ec2-user/.local/lib/python3.9/site-packages (0.6.7)
2025-03-14T04:17:34.2052116Z Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (3.26.1)
2025-03-14T04:17:34.2056061Z Requirement already satisfied: typing-inspect<1,>=0.4.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (0.9.0)
2025-03-14T04:17:34.2112329Z Requirement already satisfied: packaging>=17.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses_json==0.6.7) (24.2)
2025-03-14T04:17:34.2133178Z Requirement already satisfied: typing-extensions>=3.7.4 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (4.12.2)
2025-03-14T04:17:34.2135026Z Requirement already satisfied: mypy-extensions>=0.3.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (1.0.0)
2025-03-14T04:17:34.3572303Z Prepare all required actions
2025-03-14T04:17:34.3572594Z Getting action download info
2025-03-14T04:17:34.4871936Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6)
2025-03-14T04:17:35.5067128Z Download action repository 'actions/download-artifact@v4' (SHA:cc203385981b70ca67e1cc392babf9cc229d5806)
2025-03-14T04:17:38.7984745Z ##[group]Run ./.github/actions/download-build-artifacts
2025-03-14T04:17:38.7985020Z with:
2025-03-14T04:17:38.7985209Z   name: linux-jammy-py3.9-gcc11-build
2025-03-14T04:17:38.7985430Z   s3-bucket: gha-artifacts
2025-03-14T04:17:38.7985618Z env:
2025-03-14T04:17:38.7985779Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:38.7985954Z ##[endgroup]
2025-03-14T04:17:38.8080491Z ##[group]Run seemethere/download-artifact-s3@v4
2025-03-14T04:17:38.8080738Z with:
2025-03-14T04:17:38.8080933Z   name: linux-jammy-py3.9-gcc11-build
2025-03-14T04:17:38.8081164Z   s3-bucket: gha-artifacts
2025-03-14T04:17:38.8081403Z   region: us-east-1
2025-03-14T04:17:38.8081577Z env:
2025-03-14T04:17:38.8081741Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:38.8081929Z ##[endgroup]
2025-03-14T04:17:39.3629763Z (node:91085) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2025-03-14T04:17:39.3630909Z 
2025-03-14T04:17:39.3631102Z Please migrate your code to use AWS SDK for JavaScript (v3).
2025-03-14T04:17:39.3631470Z For more information, check the migration guide at https://a.co/7PzMCcy
2025-03-14T04:17:39.3632007Z (Use `node --trace-warnings ...` to show where the warning was created)
2025-03-14T04:17:39.4509706Z Found 1 objects with prefix pytorch/pytorch/13849515380/linux-jammy-py3.9-gcc11-build/
2025-03-14T04:17:39.4511022Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2025-03-14T04:17:43.4553033Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip
2025-03-14T04:17:43.4559977Z Artifact download has finished successfully
2025-03-14T04:17:43.4729876Z ##[group]Run unzip -o artifacts.zip
2025-03-14T04:17:43.4730128Z unzip -o artifacts.zip
2025-03-14T04:17:43.4734780Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:43.4735037Z env:
2025-03-14T04:17:43.4735203Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:43.4735397Z ##[endgroup]
2025-03-14T04:17:43.4769111Z Archive:  artifacts.zip
2025-03-14T04:17:43.4772202Z    creating: dist/
2025-03-14T04:17:44.3406857Z   inflating: dist/torch-2.8.0a0+gitaed0b7a-cp39-cp39-linux_x86_64.whl  
2025-03-14T04:17:44.3514117Z   inflating: dist/.ninja_log         
2025-03-14T04:17:44.3516003Z    creating: build/custom_test_artifacts/
2025-03-14T04:17:44.3516498Z    creating: build/custom_test_artifacts/custom-op-build/
2025-03-14T04:17:44.3521498Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/
2025-03-14T04:17:44.3526400Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/
2025-03-14T04:17:44.3531761Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml  
2025-03-14T04:17:44.3533917Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/
2025-03-14T04:17:44.3537459Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CMakeSystem.cmake  
2025-03-14T04:17:44.3538030Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdC/
2025-03-14T04:17:44.3542439Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdC/tmp/
2025-03-14T04:17:44.3544671Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdC/CMakeCCompilerId.c  
2025-03-14T04:17:44.3545377Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdC/a.out  
2025-03-14T04:17:44.3545835Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CMakeCCompiler.cmake  
2025-03-14T04:17:44.3546570Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdCXX/
2025-03-14T04:17:44.3547009Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdCXX/tmp/
2025-03-14T04:17:44.3547508Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2025-03-14T04:17:44.3547992Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CompilerIdCXX/a.out  
2025-03-14T04:17:44.3548443Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CMakeCXXCompiler.cmake  
2025-03-14T04:17:44.3548954Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_C.bin  
2025-03-14T04:17:44.3549474Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_CXX.bin  
2025-03-14T04:17:44.3549926Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/
2025-03-14T04:17:44.3550323Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache  
2025-03-14T04:17:44.3550724Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/
2025-03-14T04:17:44.3551160Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts  
2025-03-14T04:17:44.3551765Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make  
2025-03-14T04:17:44.3552238Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make  
2025-03-14T04:17:44.3552680Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt  
2025-03-14T04:17:44.3553134Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake  
2025-03-14T04:17:44.3553580Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make  
2025-03-14T04:17:44.3554029Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake  
2025-03-14T04:17:44.3554472Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make  
2025-03-14T04:17:44.3554913Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make  
2025-03-14T04:17:44.3555350Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d  
2025-03-14T04:17:44.3703313Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o  
2025-03-14T04:17:44.3705208Z    creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/
2025-03-14T04:17:44.3705888Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts  
2025-03-14T04:17:44.3706398Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make  
2025-03-14T04:17:44.3706898Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make  
2025-03-14T04:17:44.3707354Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt  
2025-03-14T04:17:44.3707819Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake  
2025-03-14T04:17:44.3708286Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make  
2025-03-14T04:17:44.3708752Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake  
2025-03-14T04:17:44.3709441Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make  
2025-03-14T04:17:44.3709892Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make  
2025-03-14T04:17:44.3752634Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d  
2025-03-14T04:17:44.3789081Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o  
2025-03-14T04:17:44.3792030Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2025-03-14T04:17:44.3796352Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt  
2025-03-14T04:17:44.3825758Z  extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks  
2025-03-14T04:17:44.3829972Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2  
2025-03-14T04:17:44.3834274Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake  
2025-03-14T04:17:44.3838257Z   inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt  
2025-03-14T04:17:44.3842599Z   inflating: build/custom_test_artifacts/custom-op-build/Makefile  
2025-03-14T04:17:44.3843019Z   inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake  
2025-03-14T04:17:44.3927125Z   inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so  
2025-03-14T04:17:44.3979454Z   inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops  
2025-03-14T04:17:44.3981754Z    creating: build/custom_test_artifacts/jit-hook-build/
2025-03-14T04:17:44.3982193Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/
2025-03-14T04:17:44.3985892Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/
2025-03-14T04:17:44.3986383Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml  
2025-03-14T04:17:44.3986783Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/
2025-03-14T04:17:44.3987175Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CMakeSystem.cmake  
2025-03-14T04:17:44.3987594Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdC/
2025-03-14T04:17:44.3988011Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdC/tmp/
2025-03-14T04:17:44.3988467Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdC/CMakeCCompilerId.c  
2025-03-14T04:17:44.3988950Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdC/a.out  
2025-03-14T04:17:44.3989381Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CMakeCCompiler.cmake  
2025-03-14T04:17:44.3989800Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdCXX/
2025-03-14T04:17:44.3990206Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdCXX/tmp/
2025-03-14T04:17:44.3990679Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2025-03-14T04:17:44.3991160Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CompilerIdCXX/a.out  
2025-03-14T04:17:44.3991744Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CMakeCXXCompiler.cmake  
2025-03-14T04:17:44.3992251Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_C.bin  
2025-03-14T04:17:44.3992793Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_CXX.bin  
2025-03-14T04:17:44.3993241Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/
2025-03-14T04:17:44.3993628Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache  
2025-03-14T04:17:44.3994227Z    creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/
2025-03-14T04:17:44.3994679Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts  
2025-03-14T04:17:44.3995180Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make  
2025-03-14T04:17:44.3995725Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make  
2025-03-14T04:17:44.3996194Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt  
2025-03-14T04:17:44.3996690Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake  
2025-03-14T04:17:44.3997188Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make  
2025-03-14T04:17:44.3997684Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake  
2025-03-14T04:17:44.3998171Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make  
2025-03-14T04:17:44.3998728Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make  
2025-03-14T04:17:44.4013425Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d  
2025-03-14T04:17:44.4064120Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o  
2025-03-14T04:17:44.4066316Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2025-03-14T04:17:44.4066928Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt  
2025-03-14T04:17:44.4070289Z  extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks  
2025-03-14T04:17:44.4070812Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2  
2025-03-14T04:17:44.4075924Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake  
2025-03-14T04:17:44.4079926Z   inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt  
2025-03-14T04:17:44.4082118Z   inflating: build/custom_test_artifacts/jit-hook-build/Makefile  
2025-03-14T04:17:44.4082625Z   inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake  
2025-03-14T04:17:44.4111486Z   inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks  
2025-03-14T04:17:44.4112151Z    creating: build/custom_test_artifacts/custom-backend-build/
2025-03-14T04:17:44.4112514Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/
2025-03-14T04:17:44.4112890Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/
2025-03-14T04:17:44.4113324Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml  
2025-03-14T04:17:44.4113751Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/
2025-03-14T04:17:44.4114164Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeSystem.cmake  
2025-03-14T04:17:44.4114601Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/
2025-03-14T04:17:44.4115028Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/tmp/
2025-03-14T04:17:44.4115982Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/CMakeCCompilerId.c  
2025-03-14T04:17:44.4116531Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/a.out  
2025-03-14T04:17:44.4117007Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeCCompiler.cmake  
2025-03-14T04:17:44.4117467Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/
2025-03-14T04:17:44.4118137Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/tmp/
2025-03-14T04:17:44.4118831Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/CMakeCXXCompilerId.cpp  
2025-03-14T04:17:44.4119349Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/a.out  
2025-03-14T04:17:44.4119826Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeCXXCompiler.cmake  
2025-03-14T04:17:44.4120534Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_C.bin  
2025-03-14T04:17:44.4122697Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_CXX.bin  
2025-03-14T04:17:44.4123337Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/
2025-03-14T04:17:44.4123837Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache  
2025-03-14T04:17:44.4124264Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/
2025-03-14T04:17:44.4124739Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts  
2025-03-14T04:17:44.4125263Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make  
2025-03-14T04:17:44.4125764Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make  
2025-03-14T04:17:44.4126236Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt  
2025-03-14T04:17:44.4126723Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake  
2025-03-14T04:17:44.4127211Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make  
2025-03-14T04:17:44.4127689Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake  
2025-03-14T04:17:44.4128176Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make  
2025-03-14T04:17:44.4128656Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make  
2025-03-14T04:17:44.4129268Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d  
2025-03-14T04:17:44.4228437Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o  
2025-03-14T04:17:44.4232982Z    creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/
2025-03-14T04:17:44.4235209Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts  
2025-03-14T04:17:44.4235955Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make  
2025-03-14T04:17:44.4240669Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make  
2025-03-14T04:17:44.4243308Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt  
2025-03-14T04:17:44.4248857Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake  
2025-03-14T04:17:44.4249660Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make  
2025-03-14T04:17:44.4250308Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake  
2025-03-14T04:17:44.4254668Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make  
2025-03-14T04:17:44.4257040Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make  
2025-03-14T04:17:44.4258170Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d  
2025-03-14T04:17:44.4292758Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o  
2025-03-14T04:17:44.4294667Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake  
2025-03-14T04:17:44.4295492Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt  
2025-03-14T04:17:44.4300219Z  extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks  
2025-03-14T04:17:44.4305282Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2  
2025-03-14T04:17:44.4307323Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake  
2025-03-14T04:17:44.4307852Z   inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt  
2025-03-14T04:17:44.4308281Z   inflating: build/custom_test_artifacts/custom-backend-build/Makefile  
2025-03-14T04:17:44.4308655Z   inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake  
2025-03-14T04:17:44.4380653Z   inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so  
2025-03-14T04:17:44.4416539Z   inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend  
2025-03-14T04:17:44.4420139Z    creating: build/lib/
2025-03-14T04:17:44.4487148Z   inflating: build/lib/libprotobuf-lite.a  
2025-03-14T04:17:44.4863377Z   inflating: build/lib/libprotobuf.a  
2025-03-14T04:17:44.5285852Z   inflating: build/lib/libprotoc.a   
2025-03-14T04:17:44.5293360Z   inflating: build/lib/libpthreadpool.a  
2025-03-14T04:17:44.5297165Z   inflating: build/lib/libcpuinfo.a  
2025-03-14T04:17:44.5304883Z   inflating: build/lib/libcpuinfo_internals.a  
2025-03-14T04:17:44.5305298Z   inflating: build/lib/libclog.a     
2025-03-14T04:17:44.5305667Z   inflating: build/lib/libnnpack_reference_layers.a  
2025-03-14T04:17:44.5325654Z   inflating: build/lib/libpytorch_qnnpack.a  
2025-03-14T04:17:44.5485789Z   inflating: build/lib/libmicrokernels-prod.a  
2025-03-14T04:17:44.5500584Z   inflating: build/lib/libnnpack.a   
2025-03-14T04:17:44.6252081Z   inflating: build/lib/libmicrokernels-all.a  
2025-03-14T04:17:44.6311204Z   inflating: build/lib/libgtest.a    
2025-03-14T04:17:44.6326373Z   inflating: build/lib/libgmock.a    
2025-03-14T04:17:44.6330909Z   inflating: build/lib/libgtest_main.a  
2025-03-14T04:17:44.6335278Z   inflating: build/lib/libgmock_main.a  
2025-03-14T04:17:44.6404524Z   inflating: build/lib/libXNNPACK.a  
2025-03-14T04:17:44.6466197Z   inflating: build/lib/libbenchmark.a  
2025-03-14T04:17:44.6470562Z   inflating: build/lib/libbenchmark_main.a  
2025-03-14T04:17:44.6470852Z   inflating: build/lib/libittnotify.a  
2025-03-14T04:17:44.6526787Z   inflating: build/lib/libasmjit.a   
2025-03-14T04:17:44.7395382Z   inflating: build/lib/libfbgemm.a   
2025-03-14T04:17:44.7416663Z   inflating: build/lib/libtensorpipe_uv.a  
2025-03-14T04:17:44.7883080Z   inflating: build/lib/libtensorpipe.a  
2025-03-14T04:17:44.7980753Z   inflating: build/lib/libgloo.a     
2025-03-14T04:17:44.8014979Z   inflating: build/lib/libonnx_proto.a  
2025-03-14T04:17:44.8628341Z   inflating: build/lib/libonnx.a     
2025-03-14T04:17:45.7175159Z   inflating: build/lib/libdnnl.a     
2025-03-14T04:17:45.7191377Z   inflating: build/lib/libfmt.a      
2025-03-14T04:17:45.7415104Z   inflating: build/lib/libkineto.a   
2025-03-14T04:17:45.7510905Z   inflating: build/lib/libc10.so     
2025-03-14T04:17:45.7511424Z   inflating: build/lib/libtorch_global_deps.so  
2025-03-14T04:17:47.8288386Z   inflating: build/lib/libtorch_cpu.so  
2025-03-14T04:17:47.8290146Z   inflating: build/lib/libunbox_lib.a  
2025-03-14T04:17:47.8295853Z   inflating: build/lib/libtorch.so   
2025-03-14T04:17:47.8351484Z   inflating: build/lib/libtorchbind_test.so  
2025-03-14T04:17:47.8368651Z   inflating: build/lib/libjitbackend_test.so  
2025-03-14T04:17:47.8387965Z   inflating: build/lib/libbackend_with_compiler.so  
2025-03-14T04:17:47.8410176Z   inflating: build/lib/libaoti_custom_ops.so  
2025-03-14T04:17:47.8415199Z   inflating: build/lib/libshm.so     
2025-03-14T04:17:48.0042773Z   inflating: build/lib/libtorch_python.so  
2025-03-14T04:17:48.0071334Z   inflating: build/lib/libnnapi_backend.so  
2025-03-14T04:17:48.0071882Z    creating: build/bin/
2025-03-14T04:17:48.0077146Z    creating: build/bin/CMakeFiles/
2025-03-14T04:17:48.0081180Z   inflating: build/bin/cmake_install.cmake  
2025-03-14T04:17:48.0085069Z   inflating: build/bin/CTestTestfile.cmake  
2025-03-14T04:17:48.0465837Z   inflating: build/bin/protoc-3.13.0.0  
2025-03-14T04:17:48.0864883Z   inflating: build/bin/protoc        
2025-03-14T04:17:48.0913393Z   inflating: build/bin/c10_CompileTimeFunctionPointer_test  
2025-03-14T04:17:48.0963445Z   inflating: build/bin/c10_DeviceGuard_test  
2025-03-14T04:17:48.1013240Z   inflating: build/bin/c10_Device_test  
2025-03-14T04:17:48.1068715Z   inflating: build/bin/c10_DispatchKeySet_test  
2025-03-14T04:17:48.1117473Z   inflating: build/bin/c10_StreamGuard_test  
2025-03-14T04:17:48.1166390Z   inflating: build/bin/c10_Scalar_test  
2025-03-14T04:17:48.1215638Z   inflating: build/bin/c10_SymInt_test  
2025-03-14T04:17:48.1266622Z   inflating: build/bin/c10_InlineStreamGuard_test  
2025-03-14T04:17:48.1320527Z   inflating: build/bin/c10_InlineDeviceGuard_test  
2025-03-14T04:17:48.1372796Z   inflating: build/bin/c10_SizesAndStrides_test  
2025-03-14T04:17:48.1439080Z   inflating: build/bin/c10_cow_test  
2025-03-14T04:17:48.1486710Z   inflating: build/bin/c10_ConstexprCrc_test  
2025-03-14T04:17:48.1533513Z   inflating: build/bin/c10_ArrayRef_test  
2025-03-14T04:17:48.1582395Z   inflating: build/bin/c10_Bitset_test  
2025-03-14T04:17:48.1630581Z   inflating: build/bin/c10_DeadlockDetection_test  
2025-03-14T04:17:48.1679924Z   inflating: build/bin/c10_Half_test  
2025-03-14T04:17:48.1733285Z   inflating: build/bin/c10_LeftRight_test  
2025-03-14T04:17:48.1782761Z   inflating: build/bin/c10_NetworkFlow_test  
2025-03-14T04:17:48.1836613Z   inflating: build/bin/c10_Metaprogramming_test  
2025-03-14T04:17:48.1884653Z   inflating: build/bin/c10_Synchronized_test  
2025-03-14T04:17:48.1933169Z   inflating: build/bin/c10_TypeIndex_test  
2025-03-14T04:17:48.1986010Z   inflating: build/bin/c10_ThreadLocal_test  
2025-03-14T04:17:48.2034126Z   inflating: build/bin/c10_TypeList_test  
2025-03-14T04:17:48.2082268Z   inflating: build/bin/c10_TypeTraits_test  
2025-03-14T04:17:48.2130885Z   inflating: build/bin/c10_accumulate_test  
2025-03-14T04:17:48.2178409Z   inflating: build/bin/c10_bit_cast_test  
2025-03-14T04:17:48.2232679Z   inflating: build/bin/c10_complex_math_test  
2025-03-14T04:17:48.2287019Z   inflating: build/bin/c10_bfloat16_test  
2025-03-14T04:17:48.2339877Z   inflating: build/bin/c10_complex_test  
2025-03-14T04:17:48.2386170Z   inflating: build/bin/c10_error_test  
2025-03-14T04:17:48.2438596Z   inflating: build/bin/c10_exception_test  
2025-03-14T04:17:48.2485182Z   inflating: build/bin/c10_flags_test  
2025-03-14T04:17:48.2631052Z   inflating: build/bin/c10_intrusive_ptr_test  
2025-03-14T04:17:48.2680723Z   inflating: build/bin/c10_generic_math_test  
2025-03-14T04:17:48.2729532Z   inflating: build/bin/c10_irange_test  
2025-03-14T04:17:48.2778627Z   inflating: build/bin/c10_lazy_test  
2025-03-14T04:17:48.2832943Z   inflating: build/bin/c10_logging_test  
2025-03-14T04:17:48.2886112Z   inflating: build/bin/c10_registry_test  
2025-03-14T04:17:48.2943546Z   inflating: build/bin/c10_ordered_preserving_dict_test  
2025-03-14T04:17:48.3014352Z   inflating: build/bin/c10_optional_test  
2025-03-14T04:17:48.3150622Z   inflating: build/bin/c10_small_vector_test  
2025-03-14T04:17:48.3201520Z   inflating: build/bin/c10_ssize_test  
2025-03-14T04:17:48.3251042Z   inflating: build/bin/c10_string_util_test  
2025-03-14T04:17:48.3299914Z   inflating: build/bin/c10_tempfile_test  
2025-03-14T04:17:48.3342549Z   inflating: build/bin/c10_intrusive_ptr_benchmark  
2025-03-14T04:17:48.3386350Z   inflating: build/bin/c10_string_view_test  
2025-03-14T04:17:48.3441959Z   inflating: build/bin/c10_typeid_test  
2025-03-14T04:17:48.3791094Z   inflating: build/bin/vec_test_all_types_DEFAULT  
2025-03-14T04:17:48.4156405Z   inflating: build/bin/vec_test_all_types_AVX512  
2025-03-14T04:17:48.4529343Z   inflating: build/bin/vec_test_all_types_AVX2  
2025-03-14T04:17:48.4580064Z   inflating: build/bin/test_edge_op_registration  
2025-03-14T04:17:48.4629832Z   inflating: build/bin/static_runtime_bench  
2025-03-14T04:17:48.4852333Z   inflating: build/bin/static_runtime_test  
2025-03-14T04:17:48.4922776Z   inflating: build/bin/Dict_test     
2025-03-14T04:17:48.4972767Z   inflating: build/bin/Dimname_test  
2025-03-14T04:17:48.5032547Z   inflating: build/bin/MaybeOwned_test  
2025-03-14T04:17:48.5087954Z   inflating: build/bin/NamedTensor_test  
2025-03-14T04:17:48.5142740Z   inflating: build/bin/apply_utils_test  
2025-03-14T04:17:48.5198718Z   inflating: build/bin/atest         
2025-03-14T04:17:48.5256822Z   inflating: build/bin/basic         
2025-03-14T04:17:48.5310207Z   inflating: build/bin/broadcast_test  
2025-03-14T04:17:48.5366214Z   inflating: build/bin/cpu_allocator_test  
2025-03-14T04:17:48.5414379Z   inflating: build/bin/cpu_generator_test  
2025-03-14T04:17:48.5464979Z   inflating: build/bin/cpu_profiling_allocator_test  
2025-03-14T04:17:48.5547546Z   inflating: build/bin/cpu_rng_test  
2025-03-14T04:17:48.5597526Z   inflating: build/bin/dispatch_key_set_test  
2025-03-14T04:17:48.5670556Z   inflating: build/bin/dlconvertor_test  
2025-03-14T04:17:48.5697956Z   inflating: build/bin/extension_backend_test  
2025-03-14T04:17:48.5750393Z   inflating: build/bin/half_test     
2025-03-14T04:17:48.5838601Z   inflating: build/bin/ivalue_test   
2025-03-14T04:17:48.5886359Z   inflating: build/bin/lazy_tensor_test  
2025-03-14T04:17:48.5937207Z   inflating: build/bin/math_kernel_test  
2025-03-14T04:17:48.5987835Z   inflating: build/bin/memory_format_test  
2025-03-14T04:17:48.6038609Z   inflating: build/bin/memory_overlapping_test  
2025-03-14T04:17:48.6089761Z   inflating: build/bin/mobile_memory_cleanup  
2025-03-14T04:17:48.6142916Z   inflating: build/bin/native_test   
2025-03-14T04:17:48.6190625Z   inflating: build/bin/operator_name_test  
2025-03-14T04:17:48.6239547Z   inflating: build/bin/operators_test  
2025-03-14T04:17:48.6290307Z   inflating: build/bin/packedtensoraccessor_test  
2025-03-14T04:17:48.6351976Z   inflating: build/bin/pow_test      
2025-03-14T04:17:48.6408329Z   inflating: build/bin/quantized_test  
2025-03-14T04:17:48.6455618Z   inflating: build/bin/reduce_ops_test  
2025-03-14T04:17:48.6504089Z   inflating: build/bin/reportMemoryUsage_test  
2025-03-14T04:17:48.6558134Z   inflating: build/bin/scalar_tensor_test  
2025-03-14T04:17:48.6613681Z   inflating: build/bin/scalar_test   
2025-03-14T04:17:48.6661524Z   inflating: build/bin/StorageUtils_test  
2025-03-14T04:17:48.6712467Z   inflating: build/bin/stride_properties_test  
2025-03-14T04:17:48.6785574Z   inflating: build/bin/tensor_iterator_test  
2025-03-14T04:17:48.6838344Z   inflating: build/bin/test_parallel  
2025-03-14T04:17:48.6838642Z   inflating: build/bin/thread_init_test  
2025-03-14T04:17:48.6893236Z   inflating: build/bin/type_ptr_test  
2025-03-14T04:17:48.6948975Z   inflating: build/bin/type_test     
2025-03-14T04:17:48.6999346Z   inflating: build/bin/undefined_tensor_test  
2025-03-14T04:17:48.6999846Z   inflating: build/bin/verify_api_visibility  
2025-03-14T04:17:48.7065990Z   inflating: build/bin/legacy_vmap_test  
2025-03-14T04:17:48.7115774Z   inflating: build/bin/weakref_test  
2025-03-14T04:17:48.7165495Z   inflating: build/bin/wrapdim_test  
2025-03-14T04:17:48.7214189Z   inflating: build/bin/xla_tensor_test  
2025-03-14T04:17:48.7270570Z   inflating: build/bin/IListRef_test  
2025-03-14T04:17:48.7392602Z   inflating: build/bin/List_test     
2025-03-14T04:17:48.7429547Z   inflating: build/bin/KernelFunction_test  
2025-03-14T04:17:48.7539134Z   inflating: build/bin/kernel_function_legacy_test  
2025-03-14T04:17:48.7627067Z   inflating: build/bin/kernel_function_test  
2025-03-14T04:17:48.7740286Z   inflating: build/bin/kernel_lambda_legacy_test  
2025-03-14T04:17:48.7832370Z   inflating: build/bin/kernel_lambda_test  
2025-03-14T04:17:48.7889899Z   inflating: build/bin/kernel_stackbased_test  
2025-03-14T04:17:48.7976393Z   inflating: build/bin/make_boxed_from_unboxed_functor_test  
2025-03-14T04:17:48.8024447Z   inflating: build/bin/CppSignature_test  
2025-03-14T04:17:48.8078033Z   inflating: build/bin/backend_fallback_test  
2025-03-14T04:17:48.8124532Z   inflating: build/bin/op_allowlist_test  
2025-03-14T04:17:48.8396908Z   inflating: build/bin/op_registration_test  
2025-03-14T04:17:48.8456461Z   inflating: build/bin/inline_container_test  
2025-03-14T04:17:48.8959131Z   inflating: build/bin/test_jit      
2025-03-14T04:17:48.9648469Z   inflating: build/bin/test_tensorexpr  
2025-03-14T04:17:48.9698473Z   inflating: build/bin/BackoffTest   
2025-03-14T04:17:48.9749360Z   inflating: build/bin/HashStoreTest  
2025-03-14T04:17:48.9799942Z   inflating: build/bin/FileStoreTest  
2025-03-14T04:17:48.9853648Z   inflating: build/bin/TCPStoreTest  
2025-03-14T04:17:48.9864036Z   inflating: build/bin/tutorial_tensorexpr  
2025-03-14T04:17:48.9864397Z   inflating: build/bin/example_allreduce  
2025-03-14T04:17:48.9928265Z   inflating: build/bin/ProcessGroupGlooTest  
2025-03-14T04:17:48.9980347Z   inflating: build/bin/test_dist_autograd  
2025-03-14T04:17:49.0045544Z   inflating: build/bin/test_cpp_rpc  
2025-03-14T04:17:49.1037941Z   inflating: build/bin/test_api      
2025-03-14T04:17:49.1038530Z   inflating: build/bin/parallel_benchmark  
2025-03-14T04:17:49.1102438Z   inflating: build/bin/test_mobile_nnc  
2025-03-14T04:17:49.1108105Z   inflating: build/bin/aot_model_compiler_test  
2025-03-14T04:17:49.1412490Z   inflating: build/bin/test_lazy     
2025-03-14T04:17:49.1414065Z   inflating: build/bin/torch_shm_manager  
2025-03-14T04:17:49.1414498Z    creating: .additional_ci_files/
2025-03-14T04:17:49.1506239Z   inflating: .additional_ci_files/test-times.json  
2025-03-14T04:17:49.1864243Z   inflating: .additional_ci_files/test-class-times.json  
2025-03-14T04:17:49.1910319Z ##[group]Run rm artifacts.zip
2025-03-14T04:17:49.1910559Z rm artifacts.zip
2025-03-14T04:17:49.1915192Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:49.1915447Z env:
2025-03-14T04:17:49.1915610Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.1915819Z ##[endgroup]
2025-03-14T04:17:49.2691853Z ##[group]Run df -H
2025-03-14T04:17:49.2692072Z df -H
2025-03-14T04:17:49.2696697Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:49.2696964Z env:
2025-03-14T04:17:49.2697145Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.2697431Z ##[endgroup]
2025-03-14T04:17:49.2735330Z Filesystem        Size  Used Avail Use% Mounted on
2025-03-14T04:17:49.2735875Z devtmpfs          4.2M     0  4.2M   0% /dev
2025-03-14T04:17:49.2736254Z tmpfs              67G     0   67G   0% /dev/shm
2025-03-14T04:17:49.2736514Z tmpfs              27G  783k   27G   1% /run
2025-03-14T04:17:49.2736759Z /dev/nvme0n1p1    215G   49G  167G  23% /
2025-03-14T04:17:49.2737077Z tmpfs              67G   25k   67G   1% /tmp
2025-03-14T04:17:49.2737327Z /dev/nvme0n1p128   11M  1.4M  9.2M  13% /boot/efi
2025-03-14T04:17:49.2766864Z Prepare all required actions
2025-03-14T04:17:49.2767183Z Getting action download info
2025-03-14T04:17:49.4105393Z ##[group]Run ./.github/actions/download-td-artifacts
2025-03-14T04:17:49.4105635Z with:
2025-03-14T04:17:49.4105837Z env:
2025-03-14T04:17:49.4106014Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.4106205Z ##[endgroup]
2025-03-14T04:17:49.4292427Z ##[group]Run seemethere/download-artifact-s3@v4
2025-03-14T04:17:49.4292684Z with:
2025-03-14T04:17:49.4292853Z   name: td_results
2025-03-14T04:17:49.4293033Z   s3-bucket: gha-artifacts
2025-03-14T04:17:49.4293224Z   region: us-east-1
2025-03-14T04:17:49.4293561Z env:
2025-03-14T04:17:49.4293734Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.4293923Z ##[endgroup]
2025-03-14T04:17:49.7551625Z (node:91103) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
2025-03-14T04:17:49.7551970Z 
2025-03-14T04:17:49.7552213Z Please migrate your code to use AWS SDK for JavaScript (v3).
2025-03-14T04:17:49.7552584Z For more information, check the migration guide at https://a.co/7PzMCcy
2025-03-14T04:17:49.7552946Z (Use `node --trace-warnings ...` to show where the warning was created)
2025-03-14T04:17:49.8393216Z Found 0 objects with prefix pytorch/pytorch/13849515380/td_results/
2025-03-14T04:17:49.8399848Z Artifact download has finished successfully
2025-03-14T04:17:49.8776476Z ##[group]Run mkdir -p .additional_ci_files
2025-03-14T04:17:49.8776752Z mkdir -p .additional_ci_files
2025-03-14T04:17:49.8777036Z mv td_results.json .additional_ci_files/td_results.json || true
2025-03-14T04:17:49.8782047Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:49.8782303Z env:
2025-03-14T04:17:49.8782476Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.8782695Z ##[endgroup]
2025-03-14T04:17:49.8829788Z mv: cannot stat 'td_results.json': No such file or directory
2025-03-14T04:17:49.9110420Z ##[group]Run .github/scripts/parse_ref.py
2025-03-14T04:17:49.9110704Z .github/scripts/parse_ref.py
2025-03-14T04:17:49.9115428Z shell: /usr/bin/bash -e {0}
2025-03-14T04:17:49.9115626Z env:
2025-03-14T04:17:49.9115793Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:49.9115977Z ##[endgroup]
2025-03-14T04:17:49.9366338Z Prepare all required actions
2025-03-14T04:17:49.9366902Z Getting action download info
2025-03-14T04:17:50.0530407Z ##[group]Run ./.github/actions/filter-test-configs
2025-03-14T04:17:50.0530661Z with:
2025-03-14T04:17:50.0531024Z   github-token: ***
2025-03-14T04:17:50.0532536Z   test-matrix: {"include": [{"config": "cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "inductor_torchbench_cpu_smoketest_perf", "shard": 1, "num_shards": 1, "runner": "linux.24xl.spr-metal"}]}
2025-03-14T04:17:50.0534188Z   job-name: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:50.0534572Z env:
2025-03-14T04:17:50.0534743Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:50.0534937Z ##[endgroup]
2025-03-14T04:17:50.0680526Z ##[group]Run nick-fields/retry@v3.0.0
2025-03-14T04:17:50.0680750Z with:
2025-03-14T04:17:50.0680917Z   shell: bash
2025-03-14T04:17:50.0681086Z   timeout_minutes: 10
2025-03-14T04:17:50.0681267Z   max_attempts: 5
2025-03-14T04:17:50.0681443Z   retry_wait_seconds: 30
2025-03-14T04:17:50.0681913Z   command: set -eux
# PyYAML 6.0 doesn't work with MacOS x86 anymore
# This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2
python3 -m pip install requests==2.27.1 pyyaml==6.0.1

2025-03-14T04:17:50.0682386Z   polling_interval_seconds: 1
2025-03-14T04:17:50.0682596Z   warning_on_retry: true
2025-03-14T04:17:50.0682784Z   continue_on_error: false
2025-03-14T04:17:50.0682969Z env:
2025-03-14T04:17:50.0683132Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:50.0683471Z   GITHUB_TOKEN: ***
2025-03-14T04:17:50.0683644Z ##[endgroup]
2025-03-14T04:17:50.1473321Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1
2025-03-14T04:17:50.3137339Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T04:17:50.3261263Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1)
2025-03-14T04:17:50.3272506Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1)
2025-03-14T04:17:50.3349357Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10)
2025-03-14T04:17:50.3355251Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10)
2025-03-14T04:17:50.3355820Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2025.1.31)
2025-03-14T04:17:50.3366825Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12)
2025-03-14T04:17:51.1293025Z Command completed after 1 attempt(s).
2025-03-14T04:17:51.1710051Z ##[group]Run set -x
2025-03-14T04:17:51.1710272Z set -x
2025-03-14T04:17:51.1710447Z 
2025-03-14T04:17:51.1710714Z # Use relative path here as this could be checked out anywhere, not necessarily
2025-03-14T04:17:51.1711024Z # in runner workspace
2025-03-14T04:17:51.1711299Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py"
2025-03-14T04:17:51.1716044Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:51.1716292Z env:
2025-03-14T04:17:51.1716461Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:51.1716800Z ##[endgroup]
2025-03-14T04:17:51.1741049Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py
2025-03-14T04:17:51.2042035Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}"
2025-03-14T04:17:51.2042329Z echo "Workflow: ${GITHUB_WORKFLOW}"
2025-03-14T04:17:51.2042559Z echo "Job name: ${JOB_NAME}"
2025-03-14T04:17:51.2042784Z 
2025-03-14T04:17:51.2043037Z # Use relative path here as this could be checked out anywhere, not necessarily
2025-03-14T04:17:51.2043333Z # in runner workspace
2025-03-14T04:17:51.2043608Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \
2025-03-14T04:17:51.2043908Z   --workflow "${GITHUB_WORKFLOW}" \
2025-03-14T04:17:51.2044131Z   --job-name "${JOB_NAME}" \
2025-03-14T04:17:51.2045689Z   --test-matrix "{"include": [{"config": "cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "inductor_torchbench_cpu_smoketest_perf", "shard": 1, "num_shards": 1, "runner": "linux.24xl.spr-metal"}]}" \
2025-03-14T04:17:51.2047331Z   --selected-test-configs "" \
2025-03-14T04:17:51.2047556Z   --pr-number "${PR_NUMBER}" \
2025-03-14T04:17:51.2047762Z   --tag "${TAG}" \
2025-03-14T04:17:51.2047970Z   --event-name "${EVENT_NAME}" \
2025-03-14T04:17:51.2048187Z   --schedule "${SCHEDULE}" \
2025-03-14T04:17:51.2048397Z   --branch "${HEAD_BRANCH}"
2025-03-14T04:17:51.2052411Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:51.2052652Z env:
2025-03-14T04:17:51.2052826Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:51.2053198Z   GITHUB_TOKEN: ***
2025-03-14T04:17:51.2053642Z   JOB_NAME: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:51.2054007Z   PR_NUMBER: 
2025-03-14T04:17:51.2054178Z   TAG: 
2025-03-14T04:17:51.2054345Z   EVENT_NAME: push
2025-03-14T04:17:51.2054524Z   SCHEDULE: 
2025-03-14T04:17:51.2054691Z   HEAD_BRANCH: 
2025-03-14T04:17:51.2054860Z ##[endgroup]
2025-03-14T04:17:51.2077407Z Workflow: inductor
2025-03-14T04:17:51.2079488Z Job name: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:51.4004884Z ##[group]Run echo "Filtered matrix:"
2025-03-14T04:17:51.4005154Z echo "Filtered matrix:"
2025-03-14T04:17:51.4006730Z echo "{"include": [{"config": "cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_huggingface", "shard": 1, "num_shards": 1, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_timm", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 1, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "dynamic_cpu_inductor_torchbench", "shard": 2, "num_shards": 2, "runner": "linux.8xlarge.amx"}, {"config": "inductor_torchbench_cpu_smoketest_perf", "shard": 1, "num_shards": 1, "runner": "linux.24xl.spr-metal"}]}"
2025-03-14T04:17:51.4008410Z 
2025-03-14T04:17:51.4008580Z echo
2025-03-14T04:17:51.4008785Z echo "Is the current job unstable? False"
2025-03-14T04:17:51.4009021Z 
2025-03-14T04:17:51.4009182Z echo
2025-03-14T04:17:51.4009375Z echo "Is keep-going label set? False"
2025-03-14T04:17:51.4009603Z 
2025-03-14T04:17:51.4009761Z echo
2025-03-14T04:17:51.4009945Z echo "Renabled issues? "
2025-03-14T04:17:51.4014590Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:51.4014844Z env:
2025-03-14T04:17:51.4015015Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:51.4015205Z ##[endgroup]
2025-03-14T04:17:51.4035991Z Filtered matrix:
2025-03-14T04:17:51.4041142Z {include: [{config: cpu_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.8xlarge.amx}, {config: cpu_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.8xlarge.amx}, {config: dynamic_cpu_inductor_huggingface, shard: 1, num_shards: 1, runner: linux.8xlarge.amx}, {config: dynamic_cpu_inductor_timm, shard: 1, num_shards: 2, runner: linux.8xlarge.amx}, {config: dynamic_cpu_inductor_timm, shard: 2, num_shards: 2, runner: linux.8xlarge.amx}, {config: dynamic_cpu_inductor_torchbench, shard: 1, num_shards: 2, runner: linux.8xlarge.amx}, {config: dynamic_cpu_inductor_torchbench, shard: 2, num_shards: 2, runner: linux.8xlarge.amx}, {config: inductor_torchbench_cpu_smoketest_perf, shard: 1, num_shards: 1, runner: linux.24xl.spr-metal}]}
2025-03-14T04:17:51.4042726Z 
2025-03-14T04:17:51.4042858Z Is the current job unstable? False
2025-03-14T04:17:51.4043017Z 
2025-03-14T04:17:51.4043122Z Is keep-going label set? False
2025-03-14T04:17:51.4043268Z 
2025-03-14T04:17:51.4043350Z Renabled issues? 
2025-03-14T04:17:51.4152170Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2025-03-14T04:17:51.4152528Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}"
2025-03-14T04:17:51.4156690Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:17:51.4156939Z env:
2025-03-14T04:17:51.4157101Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:51.4157291Z   JOB_TIMEOUT: 240
2025-03-14T04:17:51.4157463Z ##[endgroup]
2025-03-14T04:17:51.4332364Z ##[group]Run set -x
2025-03-14T04:17:51.4332631Z set -x
2025-03-14T04:17:51.4332807Z 
2025-03-14T04:17:51.4333003Z if [[ $TEST_CONFIG == 'multigpu' ]]; then
2025-03-14T04:17:51.4333362Z   TEST_COMMAND=.ci/pytorch/multigpu-test.sh
2025-03-14T04:17:51.4333624Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then
2025-03-14T04:17:51.4333863Z   TEST_COMMAND=.ci/onnx/test.sh
2025-03-14T04:17:51.4334070Z else
2025-03-14T04:17:51.4334256Z   TEST_COMMAND=.ci/pytorch/test.sh
2025-03-14T04:17:51.4334467Z fi
2025-03-14T04:17:51.4334627Z 
2025-03-14T04:17:51.4334817Z # Leaving 1GB for the runner and other things
2025-03-14T04:17:51.4335171Z TOTAL_AVAILABLE_MEMORY_IN_GB=$(awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo)
2025-03-14T04:17:51.4335709Z # https://docs.docker.com/engine/containers/resource_constraints/#--memory-swap-details, the 3GB swap
2025-03-14T04:17:51.4336137Z # comes from https://github.com/pytorch/test-infra/pull/6058
2025-03-14T04:17:51.4336465Z TOTAL_MEMORY_WITH_SWAP=$(("${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}" + 3))
2025-03-14T04:17:51.4336728Z 
2025-03-14T04:17:51.4336916Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then
2025-03-14T04:17:51.4337151Z   SHM_OPTS=
2025-03-14T04:17:51.4337335Z   JENKINS_USER=
2025-03-14T04:17:51.4337574Z   # ensure that docker container cleanly exits in 12 hours
2025-03-14T04:17:51.4337875Z   # if for some reason cleanup action doesn't stop container
2025-03-14T04:17:51.4338133Z   # when job is cancelled
2025-03-14T04:17:51.4338350Z   DOCKER_SHELL_CMD="sleep 12h"
2025-03-14T04:17:51.4338551Z 
2025-03-14T04:17:51.4338794Z   # since some steps are skipped on s390x, if they are necessary, run them here
2025-03-14T04:17:51.4339123Z   env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T04:17:51.4339402Z   env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}"
2025-03-14T04:17:51.4339633Z else
2025-03-14T04:17:51.4339822Z   SHM_OPTS="--shm-size=${SHM_SIZE}"
2025-03-14T04:17:51.4340052Z   JENKINS_USER="--user jenkins"
2025-03-14T04:17:51.4360967Z   DOCKER_SHELL_CMD=
2025-03-14T04:17:51.4361172Z fi
2025-03-14T04:17:51.4361336Z 
2025-03-14T04:17:51.4361573Z # detached container should get cleaned up by teardown_ec2_linux
2025-03-14T04:17:51.4361913Z # TODO: Stop building test binaries as part of the build phase
2025-03-14T04:17:51.4362287Z # Used for GPU_FLAG, SHM_OPTS, JENKINS_USER and DOCKER_SHELL_CMD since that doesn't play nice
2025-03-14T04:17:51.4362622Z # shellcheck disable=SC2086,SC2090
2025-03-14T04:17:51.4362852Z container_name=$(docker run \
2025-03-14T04:17:51.4363074Z   ${GPU_FLAG:-} \
2025-03-14T04:17:51.4363298Z   ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \
2025-03-14T04:17:51.4363541Z   -e BUILD_ENVIRONMENT \
2025-03-14T04:17:51.4363753Z   -e PR_NUMBER \
2025-03-14T04:17:51.4363954Z   -e GITHUB_ACTIONS \
2025-03-14T04:17:51.4364158Z   -e GITHUB_REPOSITORY \
2025-03-14T04:17:51.4364359Z   -e GITHUB_WORKFLOW \
2025-03-14T04:17:51.4364564Z   -e GITHUB_JOB \
2025-03-14T04:17:51.4364759Z   -e GITHUB_RUN_ID \
2025-03-14T04:17:51.4364961Z   -e GITHUB_RUN_NUMBER \
2025-03-14T04:17:51.4365170Z   -e GITHUB_RUN_ATTEMPT \
2025-03-14T04:17:51.4365378Z   -e JOB_ID \
2025-03-14T04:17:51.4365569Z   -e JOB_NAME \
2025-03-14T04:17:51.4365760Z   -e BASE_SHA \
2025-03-14T04:17:51.4365942Z   -e BRANCH \
2025-03-14T04:17:51.4366125Z   -e SHA1 \
2025-03-14T04:17:51.4366313Z   -e AWS_DEFAULT_REGION \
2025-03-14T04:17:51.4366632Z   -e IN_WHEEL_TEST \
2025-03-14T04:17:51.4366837Z   -e SHARD_NUMBER \
2025-03-14T04:17:51.4367035Z   -e TEST_CONFIG \
2025-03-14T04:17:51.4367358Z   -e NUM_TEST_SHARDS \
2025-03-14T04:17:51.4367635Z   -e REENABLED_ISSUES \
2025-03-14T04:17:51.4367855Z   -e CONTINUE_THROUGH_ERROR \
2025-03-14T04:17:51.4368075Z   -e VERBOSE_TEST_LOGS \
2025-03-14T04:17:51.4368287Z   -e TEST_SHOWLOCALS \
2025-03-14T04:17:51.4368493Z   -e NO_TEST_TIMEOUT \
2025-03-14T04:17:51.4368689Z   -e NO_TD \
2025-03-14T04:17:51.4368878Z   -e TD_DISTRIBUTED \
2025-03-14T04:17:51.4369078Z   -e PR_LABELS \
2025-03-14T04:17:51.4369292Z   -e MAX_JOBS="$(nproc --ignore=2)" \
2025-03-14T04:17:51.4369519Z   -e SCCACHE_BUCKET \
2025-03-14T04:17:51.4369715Z   -e SCCACHE_REGION \
2025-03-14T04:17:51.4369910Z   -e XLA_CUDA \
2025-03-14T04:17:51.4370117Z   -e XLA_CLANG_CACHE_S3_BUCKET_NAME \
2025-03-14T04:17:51.4370396Z   -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \
2025-03-14T04:17:51.4370650Z   -e PYTORCH_TEST_RERUN_DISABLED_TESTS \
2025-03-14T04:17:51.4370897Z   -e SKIP_SCCACHE_INITIALIZATION=1 \
2025-03-14T04:17:51.4371138Z   -e HUGGING_FACE_HUB_TOKEN \
2025-03-14T04:17:51.4392431Z   -e SCRIBE_GRAPHQL_ACCESS_TOKEN \
2025-03-14T04:17:51.4392723Z   -e DASHBOARD_TAG \
2025-03-14T04:17:51.4392934Z   -e IS_A100_RUNNER \
2025-03-14T04:17:51.4393147Z   -e ARTIFACTS_FILE_SUFFIX \
2025-03-14T04:17:51.4393402Z   --memory="${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}g" \
2025-03-14T04:17:51.4393680Z   --memory-swap="${TOTAL_MEMORY_WITH_SWAP}g" \
2025-03-14T04:17:51.4393954Z   --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \
2025-03-14T04:17:51.4394218Z   --security-opt seccomp=unconfined \
2025-03-14T04:17:51.4394448Z   --cap-add=SYS_PTRACE \
2025-03-14T04:17:51.4394673Z   --ipc=host \
2025-03-14T04:17:51.4394864Z   ${SHM_OPTS} \
2025-03-14T04:17:51.4395050Z   --tty \
2025-03-14T04:17:51.4395226Z   --detach \
2025-03-14T04:17:51.4395418Z   --name="${container_name}" \
2025-03-14T04:17:51.4395646Z   ${JENKINS_USER} \
2025-03-14T04:17:51.4395895Z   -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \
2025-03-14T04:17:51.4396164Z   -w /var/lib/jenkins/workspace \
2025-03-14T04:17:51.4396401Z   "${DOCKER_IMAGE}" \
2025-03-14T04:17:51.4396599Z   ${DOCKER_SHELL_CMD}
2025-03-14T04:17:51.4396787Z )
2025-03-14T04:17:51.4396997Z # Propagate download.pytorch.org IP to container
2025-03-14T04:17:51.4397402Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts"
2025-03-14T04:17:51.4397828Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}"
2025-03-14T04:17:51.4398094Z 
2025-03-14T04:17:51.4398289Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then
2025-03-14T04:17:51.4398640Z   docker exec -t "${container_name}" sh -c "python3 -m pip install -r .ci/docker/requirements-ci.txt"
2025-03-14T04:17:51.4398960Z fi
2025-03-14T04:17:51.4399126Z 
2025-03-14T04:17:51.4399511Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}"
2025-03-14T04:17:51.4403801Z shell: /usr/bin/bash -e {0}
2025-03-14T04:17:51.4403994Z env:
2025-03-14T04:17:51.4404163Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:17:51.4404388Z   BUILD_ENVIRONMENT: linux-jammy-py3.9-gcc11-build
2025-03-14T04:17:51.4404623Z   PR_NUMBER: 
2025-03-14T04:17:51.4404808Z   GITHUB_REPOSITORY: pytorch/pytorch
2025-03-14T04:17:51.4405023Z   GITHUB_WORKFLOW: inductor
2025-03-14T04:17:51.4405211Z   GITHUB_JOB: test
2025-03-14T04:17:51.4405387Z   GITHUB_RUN_ID: 13849515380
2025-03-14T04:17:51.4405664Z   GITHUB_RUN_NUMBER: 122697
2025-03-14T04:17:51.4405860Z   GITHUB_RUN_ATTEMPT: 1
2025-03-14T04:17:51.4406042Z   JOB_ID: 38754841887
2025-03-14T04:17:51.4406387Z   JOB_NAME: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:17:51.4406796Z   BRANCH: main
2025-03-14T04:17:51.4406988Z   SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:17:51.4407237Z   BASE_SHA: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:17:51.4407485Z   TEST_CONFIG: dynamic_cpu_inductor_huggingface
2025-03-14T04:17:51.4407702Z   SHARD_NUMBER: 1
2025-03-14T04:17:51.4407878Z   NUM_TEST_SHARDS: 1
2025-03-14T04:17:51.4408053Z   REENABLED_ISSUES: 
2025-03-14T04:17:51.4408232Z   CONTINUE_THROUGH_ERROR: False
2025-03-14T04:17:51.4408427Z   VERBOSE_TEST_LOGS: False
2025-03-14T04:17:51.4408616Z   TEST_SHOWLOCALS: False
2025-03-14T04:17:51.4408801Z   NO_TEST_TIMEOUT: False
2025-03-14T04:17:51.4408980Z   NO_TD: False
2025-03-14T04:17:51.4409147Z   TD_DISTRIBUTED: False
2025-03-14T04:17:51.4409361Z   SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2
2025-03-14T04:17:51.4409598Z   SCCACHE_REGION: us-east-1
2025-03-14T04:17:51.4409784Z   SHM_SIZE: 1g
2025-03-14T04:17:51.4410228Z   DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:17:51.4410694Z   XLA_CUDA: 
2025-03-14T04:17:51.4410932Z   XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla
2025-03-14T04:17:51.4411222Z   PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0
2025-03-14T04:17:51.4411440Z   PYTORCH_TEST_RERUN_DISABLED_TESTS: 0
2025-03-14T04:17:51.4411637Z   DASHBOARD_TAG: 
2025-03-14T04:17:51.4411980Z   HUGGING_FACE_HUB_TOKEN: ***
2025-03-14T04:17:51.4412250Z   SCRIBE_GRAPHQL_ACCESS_TOKEN: ***
2025-03-14T04:17:51.4412455Z   IS_A100_RUNNER: 0
2025-03-14T04:17:51.4412755Z   ARTIFACTS_FILE_SUFFIX: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:17:51.4413089Z ##[endgroup]
2025-03-14T04:17:51.4432548Z + [[ dynamic_cpu_inductor_huggingface == \m\u\l\t\i\g\p\u ]]
2025-03-14T04:17:51.4433013Z + [[ linux-jammy-py3.9-gcc11-build == *onnx* ]]
2025-03-14T04:17:51.4438448Z + TEST_COMMAND=.ci/pytorch/test.sh
2025-03-14T04:17:51.4442925Z ++ awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo
2025-03-14T04:17:51.4470303Z + TOTAL_AVAILABLE_MEMORY_IN_GB='122.780 '
2025-03-14T04:17:51.4472463Z + TOTAL_MEMORY_WITH_SWAP=125
2025-03-14T04:17:51.4472871Z + [[ linux-jammy-py3.9-gcc11-build == *\s\3\9\0\x* ]]
2025-03-14T04:17:51.4478237Z + SHM_OPTS=--shm-size=1g
2025-03-14T04:17:51.4483087Z + JENKINS_USER='--user jenkins'
2025-03-14T04:17:51.4485492Z + DOCKER_SHELL_CMD=
2025-03-14T04:17:51.4485878Z +++ nproc --ignore=2
2025-03-14T04:17:51.4494662Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=30 -e SCCACHE_BUCKET -e SCCACHE_REGION -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --memory=122g --memory-swap=125g --env-file=/tmp/github_env_13849515380 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:18:40.1755543Z + container_name=7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:18:40.1756417Z + grep download.pytorch.org /etc/hosts
2025-03-14T04:18:40.1757035Z + docker exec -i 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b sudo bash -c '/bin/cat >> /etc/hosts'
2025-03-14T04:18:40.3016046Z + echo DOCKER_CONTAINER_ID=7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:18:40.3016640Z + [[ linux-jammy-py3.9-gcc11-build == *\s\3\9\0\x* ]]
2025-03-14T04:18:40.3017074Z ++ echo dist/torch-2.8.0a0+gitaed0b7a-cp39-cp39-linux_x86_64.whl
2025-03-14T04:18:40.3019947Z + docker exec -t 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b sh -c 'python3 -m pip install dist/torch-2.8.0a0+gitaed0b7a-cp39-cp39-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh'
2025-03-14T04:18:40.5978673Z Processing ./dist/torch-2.8.0a0+gitaed0b7a-cp39-cp39-linux_x86_64.whl (from torch==2.8.0a0+gitaed0b7a)
2025-03-14T04:18:40.7747262Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (3.16.1)
2025-03-14T04:18:40.7749009Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (4.12.2)
2025-03-14T04:18:40.7941549Z Collecting sympy>=1.13.3 (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a)
2025-03-14T04:18:40.7950713Z   Using cached sympy-1.13.3-py3-none-any.whl.metadata (12 kB)
2025-03-14T04:18:40.7966630Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (2.8.8)
2025-03-14T04:18:40.7967455Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (3.1.6)
2025-03-14T04:18:40.7973420Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (2024.10.0)
2025-03-14T04:18:40.7982808Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (3.3.0)
2025-03-14T04:18:40.8000445Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from opt-einsum>=3.3->torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (1.22.4)
2025-03-14T04:18:40.8009872Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy>=1.13.3->torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (1.3.0)
2025-03-14T04:18:40.8272796Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (3.0.2)
2025-03-14T04:18:40.8336520Z Using cached sympy-1.13.3-py3-none-any.whl (6.2 MB)
2025-03-14T04:18:41.3362582Z Installing collected packages: sympy, torch
2025-03-14T04:18:41.3363067Z   Attempting uninstall: sympy
2025-03-14T04:18:41.3372168Z     Found existing installation: sympy 1.13.1
2025-03-14T04:18:41.4229293Z     Uninstalling sympy-1.13.1:
2025-03-14T04:18:41.8888684Z       Successfully uninstalled sympy-1.13.1
2025-03-14T04:18:50.7386313Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
2025-03-14T04:18:50.7386955Z timm 1.0.14 requires torchvision, which is not installed.
2025-03-14T04:18:50.7387336Z Successfully installed sympy-1.13.3 torch-2.8.0a0+gitaed0b7a
2025-03-14T04:18:50.8123533Z + export TERM=vt100
2025-03-14T04:18:50.8128998Z + TERM=vt100
2025-03-14T04:18:50.8132459Z ++ dirname .ci/pytorch/test.sh
2025-03-14T04:18:50.8137601Z + source .ci/pytorch/common.sh
2025-03-14T04:18:50.8137939Z +++ dirname .ci/pytorch/common.sh
2025-03-14T04:18:50.8138501Z ++ source .ci/pytorch/common_utils.sh
2025-03-14T04:18:50.8138748Z +++ declare -f -t trap_add
2025-03-14T04:18:50.8139412Z ++ set -ex -o pipefail
2025-03-14T04:18:50.8139655Z ++ [[ linux-jammy-py3.9-gcc11-build == *rocm* ]]
2025-03-14T04:18:50.8140028Z ++ BUILD_TEST_LIBTORCH=0
2025-03-14T04:18:50.8140250Z + [[ linux-jammy-py3.9-gcc11-build != *rocm* ]]
2025-03-14T04:18:50.8140504Z + [[ linux-jammy-py3.9-gcc11-build != *s390x* ]]
2025-03-14T04:18:50.8140747Z + [[ -d /var/lib/jenkins/workspace ]]
2025-03-14T04:18:50.8143528Z ++ stat -c %u /var/lib/jenkins/workspace
2025-03-14T04:18:50.8156862Z + WORKSPACE_ORIGINAL_OWNER_ID=1000
2025-03-14T04:18:50.8161820Z + trap_add cleanup_workspace EXIT
2025-03-14T04:18:50.8167150Z + trap_add_cmd=cleanup_workspace
2025-03-14T04:18:50.8171305Z + shift
2025-03-14T04:18:50.8176198Z + for trap_add_name in "$@"
2025-03-14T04:18:50.8178045Z +++ trap -p EXIT
2025-03-14T04:18:50.8178334Z ++ eval 'extract_trap_cmd '
2025-03-14T04:18:50.8183512Z +++ extract_trap_cmd
2025-03-14T04:18:50.8186464Z +++ printf '%s\n' ''
2025-03-14T04:18:50.8186734Z ++ printf '%s\n' cleanup_workspace
2025-03-14T04:18:50.8186978Z + trap -- '
2025-03-14T04:18:50.8187469Z cleanup_workspace' EXIT
2025-03-14T04:18:50.8187785Z + sudo chown -R jenkins /var/lib/jenkins/workspace
2025-03-14T04:18:51.1573545Z + git config --global --add safe.directory /var/lib/jenkins/workspace
2025-03-14T04:18:51.1594152Z + echo 'Environment variables:'
2025-03-14T04:18:51.1603650Z Environment variables:
2025-03-14T04:18:51.1612725Z + env
2025-03-14T04:18:51.1622551Z INSTALLED_DB=yes
2025-03-14T04:18:51.1629651Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T04:18:51.1631367Z CONTINUE_THROUGH_ERROR=False
2025-03-14T04:18:51.1631762Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11-build
2025-03-14T04:18:51.1641624Z HOSTNAME=7adbb43661e0
2025-03-14T04:18:51.1653314Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1658667Z GITHUB_ACTION=__self
2025-03-14T04:18:51.1664025Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2025-03-14T04:18:51.1672871Z GITHUB_RUN_NUMBER=122697
2025-03-14T04:18:51.1682894Z TEST_CONFIG=dynamic_cpu_inductor_huggingface
2025-03-14T04:18:51.1692853Z GITHUB_REPOSITORY_OWNER_ID=21003710
2025-03-14T04:18:51.1702643Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2025-03-14T04:18:51.1708488Z IS_A100_RUNNER=0
2025-03-14T04:18:51.1716002Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2025-03-14T04:18:51.1717624Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot
2025-03-14T04:18:51.1728638Z GITHUB_REF_TYPE=branch
2025-03-14T04:18:51.1739527Z TORCH_CUDA_ARCH_LIST=Maxwell
2025-03-14T04:18:51.1749260Z BASE_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1754739Z XLA_CUDA=
2025-03-14T04:18:51.1759351Z HUGGING_FACE_HUB_TOKEN=***
2025-03-14T04:18:51.1769350Z ***
2025-03-14T04:18:51.1779372Z GITHUB_REPOSITORY_ID=65600975
2025-03-14T04:18:51.1787658Z GITHUB_ACTIONS=true
2025-03-14T04:18:51.1798955Z SHA1=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1807748Z GITHUB_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1813903Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/heads/main
2025-03-14T04:18:51.1814386Z UCC_HOME=/usr
2025-03-14T04:18:51.1814922Z VERBOSE_TEST_LOGS=False
2025-03-14T04:18:51.1815206Z GITHUB_REF=refs/heads/main
2025-03-14T04:18:51.1815474Z SHARD_NUMBER=1
2025-03-14T04:18:51.1815693Z GITHUB_REF_PROTECTED=true
2025-03-14T04:18:51.1815936Z HOME=/var/lib/jenkins
2025-03-14T04:18:51.1816244Z GITHUB_API_URL=https://api.github.com
2025-03-14T04:18:51.1816485Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2025-03-14T04:18:51.1816695Z UCX_COMMIT=
2025-03-14T04:18:51.1816860Z NUM_TEST_SHARDS=1
2025-03-14T04:18:51.1817031Z UCX_HOME=/usr
2025-03-14T04:18:51.1817461Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1818309Z JOB_NAME=linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:18:51.1818926Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1819414Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2025-03-14T04:18:51.1819807Z GITHUB_EVENT_NAME=push
2025-03-14T04:18:51.1819992Z DASHBOARD_TAG=
2025-03-14T04:18:51.1820164Z GITHUB_RUN_ID=13849515380
2025-03-14T04:18:51.1820542Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1820945Z GITHUB_ACTOR=pytorchmergebot
2025-03-14T04:18:51.1821136Z PR_NUMBER=
2025-03-14T04:18:51.1821296Z DESIRED_CUDA=
2025-03-14T04:18:51.1821466Z GITHUB_RUN_ATTEMPT=1
2025-03-14T04:18:51.1821654Z ANACONDA_PYTHON_VERSION=3.9
2025-03-14T04:18:51.1821884Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2025-03-14T04:18:51.1822111Z TERM=vt100
2025-03-14T04:18:51.1822277Z INSTALLED_VISION=yes
2025-03-14T04:18:51.1822451Z BRANCH=main
2025-03-14T04:18:51.1822617Z SCCACHE_REGION=us-east-1
2025-03-14T04:18:51.1822813Z OPENSSL_ROOT_DIR=/opt/openssl
2025-03-14T04:18:51.1823013Z CUDA_PATH=/usr/local/cuda
2025-03-14T04:18:51.1823341Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2025-03-14T04:18:51.1823693Z GITHUB_SERVER_URL=https://github.com
2025-03-14T04:18:51.1823897Z UCC_COMMIT=
2025-03-14T04:18:51.1824053Z REENABLED_ISSUES=
2025-03-14T04:18:51.1824221Z DOCS=yes
2025-03-14T04:18:51.1824375Z SHLVL=1
2025-03-14T04:18:51.1824524Z MAX_JOBS=30
2025-03-14T04:18:51.1824683Z GITHUB_ACTOR_ID=97764156
2025-03-14T04:18:51.1824914Z GITHUB_WORKFLOW_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1825160Z GITHUB_REF_NAME=main
2025-03-14T04:18:51.1825411Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2025-03-14T04:18:51.1825680Z GITHUB_JOB=test
2025-03-14T04:18:51.1825852Z NO_TEST_TIMEOUT=False
2025-03-14T04:18:51.1826037Z TD_DISTRIBUTED=False
2025-03-14T04:18:51.1826226Z GITHUB_REPOSITORY=pytorch/pytorch
2025-03-14T04:18:51.1826436Z GITHUB_RETENTION_DAYS=90
2025-03-14T04:18:51.1826619Z OPENSSL_DIR=/opt/openssl
2025-03-14T04:18:51.1826811Z GITHUB_ACTION_REPOSITORY=
2025-03-14T04:18:51.1827271Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2025-03-14T04:18:51.1827729Z GITHUB_BASE_REF=
2025-03-14T04:18:51.1827901Z INSTALLED_ACL=
2025-03-14T04:18:51.1828197Z ARTIFACTS_FILE_SUFFIX=test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:18:51.1828516Z CI=true
2025-03-14T04:18:51.1828683Z GITHUB_REPOSITORY_OWNER=pytorch
2025-03-14T04:18:51.1828881Z JOB_ID=38754841887
2025-03-14T04:18:51.1829059Z INSTALLED_PROTOBUF=yes
2025-03-14T04:18:51.1829247Z GITHUB_HEAD_REF=
2025-03-14T04:18:51.1829417Z GITHUB_ACTION_REF=
2025-03-14T04:18:51.1829628Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2025-03-14T04:18:51.1829865Z TEST_SHOWLOCALS=False
2025-03-14T04:18:51.1830049Z GITHUB_WORKFLOW=inductor
2025-03-14T04:18:51.1830244Z DEBIAN_FRONTEND=noninteractive
2025-03-14T04:18:51.1830625Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1831012Z NO_TD=False
2025-03-14T04:18:51.1831188Z SKIP_SCCACHE_INITIALIZATION=1
2025-03-14T04:18:51.1831386Z _=/usr/bin/env
2025-03-14T04:18:51.1831751Z ++ python -c 'import site; print(site.getsitepackages()[0])'
2025-03-14T04:18:51.1832103Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch
2025-03-14T04:18:51.1832476Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/bin
2025-03-14T04:18:51.1832839Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/lib
2025-03-14T04:18:51.1833190Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.9/lib/python3.9/site-packages/torch/test
2025-03-14T04:18:51.1833539Z + BUILD_DIR=build
2025-03-14T04:18:51.1833727Z + BUILD_RENAMED_DIR=build_renamed
2025-03-14T04:18:51.1833935Z + BUILD_BIN_DIR=build/bin
2025-03-14T04:18:51.1834119Z + SHARD_NUMBER=1
2025-03-14T04:18:51.1834296Z + NUM_TEST_SHARDS=1
2025-03-14T04:18:51.1834535Z + export TORCH_SERIALIZATION_DEBUG=1
2025-03-14T04:18:51.1834756Z + TORCH_SERIALIZATION_DEBUG=1
2025-03-14T04:18:51.1834949Z + export VALGRIND=ON
2025-03-14T04:18:51.1835129Z + VALGRIND=ON
2025-03-14T04:18:51.1835352Z + [[ linux-jammy-py3.9-gcc11-build == *clang9* ]]
2025-03-14T04:18:51.1835613Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]]
2025-03-14T04:18:51.1835862Z + [[ linux-jammy-py3.9-gcc11-build == *s390x* ]]
2025-03-14T04:18:51.1836084Z + [[ 0 == \1 ]]
2025-03-14T04:18:51.1836254Z + [[ False == \1 ]]
2025-03-14T04:18:51.1836455Z + [[ linux-jammy-py3.9-gcc11-build != *bazel* ]]
2025-03-14T04:18:51.1836697Z ++ realpath build/custom_test_artifacts
2025-03-14T04:18:51.1837017Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts
2025-03-14T04:18:51.1837324Z + [[ -n '' ]]
2025-03-14T04:18:51.1837500Z + echo 'Environment variables'
2025-03-14T04:18:51.1837705Z Environment variables
2025-03-14T04:18:51.1837881Z + env
2025-03-14T04:18:51.1838041Z INSTALLED_DB=yes
2025-03-14T04:18:51.1838292Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T04:18:51.1838576Z CONTINUE_THROUGH_ERROR=False
2025-03-14T04:18:51.1838808Z BUILD_ENVIRONMENT=linux-jammy-py3.9-gcc11-build
2025-03-14T04:18:51.1839041Z HOSTNAME=7adbb43661e0
2025-03-14T04:18:51.1839406Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1839792Z GITHUB_ACTION=__self
2025-03-14T04:18:51.1839980Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0
2025-03-14T04:18:51.1840193Z GITHUB_RUN_NUMBER=122697
2025-03-14T04:18:51.1840410Z TEST_CONFIG=dynamic_cpu_inductor_huggingface
2025-03-14T04:18:51.1840644Z GITHUB_REPOSITORY_OWNER_ID=21003710
2025-03-14T04:18:51.1840875Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all
2025-03-14T04:18:51.1841087Z IS_A100_RUNNER=0
2025-03-14T04:18:51.1841410Z SCRIBE_GRAPHQL_ACCESS_TOKEN=***
2025-03-14T04:18:51.1841637Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot
2025-03-14T04:18:51.1841861Z GITHUB_REF_TYPE=branch
2025-03-14T04:18:51.1842056Z TORCH_CUDA_ARCH_LIST=Maxwell
2025-03-14T04:18:51.1842280Z BASE_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1842510Z XLA_CUDA=
2025-03-14T04:18:51.1842744Z HUGGING_FACE_HUB_TOKEN=***
2025-03-14T04:18:51.1843131Z ***
2025-03-14T04:18:51.1843306Z GITHUB_REPOSITORY_ID=65600975
2025-03-14T04:18:51.1843506Z GITHUB_ACTIONS=true
2025-03-14T04:18:51.1843708Z SHA1=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1843947Z GITHUB_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1844275Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/inductor.yml@refs/heads/main
2025-03-14T04:18:51.1844571Z UCC_HOME=/usr
2025-03-14T04:18:51.1844758Z TORCH_SERIALIZATION_DEBUG=1
2025-03-14T04:18:51.1845029Z VERBOSE_TEST_LOGS=False
2025-03-14T04:18:51.1845218Z GITHUB_REF=refs/heads/main
2025-03-14T04:18:51.1845404Z SHARD_NUMBER=1
2025-03-14T04:18:51.1845579Z GITHUB_REF_PROTECTED=true
2025-03-14T04:18:51.1845774Z HOME=/var/lib/jenkins
2025-03-14T04:18:51.1845982Z GITHUB_API_URL=https://api.github.com
2025-03-14T04:18:51.1846211Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0
2025-03-14T04:18:51.1846417Z UCX_COMMIT=
2025-03-14T04:18:51.1846583Z NUM_TEST_SHARDS=1
2025-03-14T04:18:51.1846756Z UCX_HOME=/usr
2025-03-14T04:18:51.1847108Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1847657Z JOB_NAME=linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:18:51.1848191Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1848738Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json
2025-03-14T04:18:51.1849064Z GITHUB_EVENT_NAME=push
2025-03-14T04:18:51.1849241Z DASHBOARD_TAG=
2025-03-14T04:18:51.1849414Z GITHUB_RUN_ID=13849515380
2025-03-14T04:18:51.1849861Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1850263Z GITHUB_ACTOR=pytorchmergebot
2025-03-14T04:18:51.1850459Z PR_NUMBER=
2025-03-14T04:18:51.1850621Z DESIRED_CUDA=
2025-03-14T04:18:51.1850789Z GITHUB_RUN_ATTEMPT=1
2025-03-14T04:18:51.1850965Z VALGRIND=ON
2025-03-14T04:18:51.1851132Z ANACONDA_PYTHON_VERSION=3.9
2025-03-14T04:18:51.1851362Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql
2025-03-14T04:18:51.1851588Z TERM=vt100
2025-03-14T04:18:51.1851749Z INSTALLED_VISION=yes
2025-03-14T04:18:51.1851916Z BRANCH=main
2025-03-14T04:18:51.1852082Z SCCACHE_REGION=us-east-1
2025-03-14T04:18:51.1852273Z OPENSSL_ROOT_DIR=/opt/openssl
2025-03-14T04:18:51.1852469Z CUDA_PATH=/usr/local/cuda
2025-03-14T04:18:51.1852789Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux
2025-03-14T04:18:51.1853141Z GITHUB_SERVER_URL=https://github.com
2025-03-14T04:18:51.1853356Z UCC_COMMIT=
2025-03-14T04:18:51.1853518Z REENABLED_ISSUES=
2025-03-14T04:18:51.1853689Z DOCS=yes
2025-03-14T04:18:51.1853846Z SHLVL=1
2025-03-14T04:18:51.1854000Z MAX_JOBS=30
2025-03-14T04:18:51.1854165Z GITHUB_ACTOR_ID=97764156
2025-03-14T04:18:51.1854401Z GITHUB_WORKFLOW_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:18:51.1854651Z GITHUB_REF_NAME=main
2025-03-14T04:18:51.1854913Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla
2025-03-14T04:18:51.1855180Z GITHUB_JOB=test
2025-03-14T04:18:51.1855342Z NO_TEST_TIMEOUT=False
2025-03-14T04:18:51.1855523Z TD_DISTRIBUTED=False
2025-03-14T04:18:51.1855704Z GITHUB_REPOSITORY=pytorch/pytorch
2025-03-14T04:18:51.1855909Z GITHUB_RETENTION_DAYS=90
2025-03-14T04:18:51.1856093Z OPENSSL_DIR=/opt/openssl
2025-03-14T04:18:51.1856494Z GITHUB_ACTION_REPOSITORY=
2025-03-14T04:18:51.1856951Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2025-03-14T04:18:51.1857412Z GITHUB_BASE_REF=
2025-03-14T04:18:51.1857594Z INSTALLED_ACL=
2025-03-14T04:18:51.1857903Z ARTIFACTS_FILE_SUFFIX=test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:18:51.1858217Z CI=true
2025-03-14T04:18:51.1858384Z GITHUB_REPOSITORY_OWNER=pytorch
2025-03-14T04:18:51.1858578Z JOB_ID=38754841887
2025-03-14T04:18:51.1858752Z INSTALLED_PROTOBUF=yes
2025-03-14T04:18:51.1858929Z GITHUB_HEAD_REF=
2025-03-14T04:18:51.1859091Z GITHUB_ACTION_REF=
2025-03-14T04:18:51.1859296Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2
2025-03-14T04:18:51.1859527Z TEST_SHOWLOCALS=False
2025-03-14T04:18:51.1859708Z GITHUB_WORKFLOW=inductor
2025-03-14T04:18:51.1859901Z DEBIAN_FRONTEND=noninteractive
2025-03-14T04:18:51.1860281Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_2e5cbd8d-4b75-4a99-9cda-e0ad2a9ade9d
2025-03-14T04:18:51.1860650Z NO_TD=False
2025-03-14T04:18:51.1860819Z SKIP_SCCACHE_INITIALIZATION=1
2025-03-14T04:18:51.1861013Z _=/usr/bin/env
2025-03-14T04:18:51.1861183Z + echo 'Testing pytorch'
2025-03-14T04:18:51.1861366Z Testing pytorch
2025-03-14T04:18:51.1861552Z + export LANG=C.UTF-8
2025-03-14T04:18:51.1861728Z + LANG=C.UTF-8
2025-03-14T04:18:51.1861889Z + PR_NUMBER=
2025-03-14T04:18:51.1862095Z + [[ dynamic_cpu_inductor_huggingface == \d\e\f\a\u\l\t ]]
2025-03-14T04:18:51.1862386Z + [[ dynamic_cpu_inductor_huggingface == \d\i\s\t\r\i\b\u\t\e\d ]]
2025-03-14T04:18:51.1862665Z + [[ dynamic_cpu_inductor_huggingface == \s\l\o\w ]]
2025-03-14T04:18:51.1862935Z + [[ linux-jammy-py3.9-gcc11-build == *slow-gradcheck* ]]
2025-03-14T04:18:51.1863191Z + [[ linux-jammy-py3.9-gcc11-build == *cuda* ]]
2025-03-14T04:18:51.1863439Z + [[ linux-jammy-py3.9-gcc11-build == *rocm* ]]
2025-03-14T04:18:51.1863762Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]]
2025-03-14T04:18:51.1864013Z + [[ dynamic_cpu_inductor_huggingface == *crossref* ]]
2025-03-14T04:18:51.1864265Z + [[ linux-jammy-py3.9-gcc11-build == *rocm* ]]
2025-03-14T04:18:51.1865211Z + [[ linux-jammy-py3.9-gcc11-build == *xpu* ]]
2025-03-14T04:18:51.1865453Z + [[ linux-jammy-py3.9-gcc11-build != *-bazel-* ]]
2025-03-14T04:18:51.1865694Z + pip_install --user ninja==1.10.2
2025-03-14T04:18:51.1865953Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2025-03-14T04:18:51.1866257Z + python3 -m pip install --progress-bar off --user ninja==1.10.2
2025-03-14T04:18:51.4796442Z Collecting ninja==1.10.2
2025-03-14T04:18:51.4898928Z   Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB)
2025-03-14T04:18:51.5288903Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB)
2025-03-14T04:18:52.0379667Z Installing collected packages: ninja
2025-03-14T04:18:52.0445597Z   WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH.
2025-03-14T04:18:52.0447225Z   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
2025-03-14T04:18:52.0510210Z Successfully installed ninja-1.10.2
2025-03-14T04:18:52.1271035Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2025-03-14T04:18:52.1272092Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2025-03-14T04:18:52.1272659Z + [[ linux-jammy-py3.9-gcc11-build == *aarch64* ]]
2025-03-14T04:18:52.1272916Z + install_tlparse
2025-03-14T04:18:52.1273134Z + pip_install --user tlparse==0.3.30
2025-03-14T04:18:52.1273445Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2025-03-14T04:18:52.1273767Z + python3 -m pip install --progress-bar off --user tlparse==0.3.30
2025-03-14T04:18:52.4081418Z Collecting tlparse==0.3.30
2025-03-14T04:18:52.4162204Z   Downloading tlparse-0.3.30-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.9 kB)
2025-03-14T04:18:52.4266636Z Downloading tlparse-0.3.30-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB)
2025-03-14T04:18:52.9151215Z Installing collected packages: tlparse
2025-03-14T04:18:52.9474830Z Successfully installed tlparse-0.3.30
2025-03-14T04:18:53.0211759Z ++ python -m site --user-base
2025-03-14T04:18:53.0430557Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.9/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2025-03-14T04:18:53.0431935Z + [[ linux-jammy-py3.9-gcc11-build == *asan* ]]
2025-03-14T04:18:53.0432335Z + [[ linux-jammy-py3.9-gcc11-build == *-debug* ]]
2025-03-14T04:18:53.0432632Z + [[ linux-jammy-py3.9-gcc11-build != *-bazel-* ]]
2025-03-14T04:18:53.0433015Z + echo 'We are not in debug mode: linux-jammy-py3.9-gcc11-build. Expect the assertion to pass'
2025-03-14T04:18:53.0433482Z We are not in debug mode: linux-jammy-py3.9-gcc11-build. Expect the assertion to pass
2025-03-14T04:18:53.0433798Z + cd test
2025-03-14T04:18:53.0434045Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)'
2025-03-14T04:18:54.1257509Z + [[ dynamic_cpu_inductor_huggingface == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]]
2025-03-14T04:18:54.1257900Z + [[ dynamic_cpu_inductor_huggingface == \n\o\g\p\u\_\A\V\X\5\1\2 ]]
2025-03-14T04:18:54.1258174Z + DYNAMO_BENCHMARK_FLAGS=()
2025-03-14T04:18:54.1258438Z + [[ dynamic_cpu_inductor_huggingface == *pr_time_benchmarks* ]]
2025-03-14T04:18:54.1258743Z + [[ dynamic_cpu_inductor_huggingface == *dynamo_eager* ]]
2025-03-14T04:18:54.1259014Z + [[ dynamic_cpu_inductor_huggingface == *aot_eager* ]]
2025-03-14T04:18:54.1259637Z + [[ dynamic_cpu_inductor_huggingface == *aot_inductor* ]]
2025-03-14T04:18:54.1259930Z + [[ dynamic_cpu_inductor_huggingface == *max_autotune_inductor* ]]
2025-03-14T04:18:54.1260217Z + [[ dynamic_cpu_inductor_huggingface == *inductor* ]]
2025-03-14T04:18:54.1260627Z + [[ dynamic_cpu_inductor_huggingface != *perf* ]]
2025-03-14T04:18:54.1260889Z + DYNAMO_BENCHMARK_FLAGS+=(--inductor)
2025-03-14T04:18:54.1261134Z + [[ dynamic_cpu_inductor_huggingface == *dynamic* ]]
2025-03-14T04:18:54.1261437Z + DYNAMO_BENCHMARK_FLAGS+=(--dynamic-shapes --dynamic-batch-only)
2025-03-14T04:18:54.1261725Z + [[ dynamic_cpu_inductor_huggingface == *cpu* ]]
2025-03-14T04:18:54.1261975Z + DYNAMO_BENCHMARK_FLAGS+=(--device cpu)
2025-03-14T04:18:54.1275282Z + [[ linux-jammy-py3.9-gcc11-build == *libtorch* ]]
2025-03-14T04:18:54.1277412Z + [[ linux-jammy-py3.9-gcc11-build == *-bazel-* ]]
2025-03-14T04:18:54.1277728Z + cd test
2025-03-14T04:18:54.1277974Z + python -c 'import torch; print(torch.__config__.show())'
2025-03-14T04:18:55.0124108Z PyTorch built with:
2025-03-14T04:18:55.0124869Z   - GCC 11.4
2025-03-14T04:18:55.0125140Z   - C++ Version: 201703
2025-03-14T04:18:55.0125769Z   - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2025-03-14T04:18:55.0126529Z   - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d)
2025-03-14T04:18:55.0126896Z   - OpenMP 201511 (a.k.a. OpenMP 4.5)
2025-03-14T04:18:55.0127188Z   - LAPACK is enabled (usually provided by MKL)
2025-03-14T04:18:55.0127461Z   - NNPACK is enabled
2025-03-14T04:18:55.0127668Z   - CPU capability usage: AVX512
2025-03-14T04:18:55.0130351Z   - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Werror -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.8.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 
2025-03-14T04:18:55.0133159Z 
2025-03-14T04:18:55.2026603Z + cd test
2025-03-14T04:18:55.2027216Z + python -c 'import torch; print(torch.__config__.parallel_info())'
2025-03-14T04:18:56.0862447Z ATen/Parallel:
2025-03-14T04:18:56.0864697Z 	at::get_num_threads() : 16
2025-03-14T04:18:56.0865055Z 	at::get_num_interop_threads() : 16
2025-03-14T04:18:56.0865422Z OpenMP 201511 (a.k.a. OpenMP 4.5)
2025-03-14T04:18:56.0865721Z 	omp_get_max_threads() : 16
2025-03-14T04:18:56.0866193Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
2025-03-14T04:18:56.0866701Z 	mkl_get_max_threads() : 16
2025-03-14T04:18:56.0867059Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d)
2025-03-14T04:18:56.0867384Z std::thread::hardware_concurrency() : 32
2025-03-14T04:18:56.0867612Z Environment variables:
2025-03-14T04:18:56.0867803Z 	OMP_NUM_THREADS : [not set]
2025-03-14T04:18:56.0867989Z 	MKL_NUM_THREADS : [not set]
2025-03-14T04:18:56.0868189Z ATen parallel backend: OpenMP
2025-03-14T04:18:56.0868321Z 
2025-03-14T04:18:56.2742471Z + [[ dynamic_cpu_inductor_huggingface == *numpy_2* ]]
2025-03-14T04:18:56.2743284Z + [[ linux-jammy-py3.9-gcc11-build == *aarch64* ]]
2025-03-14T04:18:56.2743606Z + [[ dynamic_cpu_inductor_huggingface == *backward* ]]
2025-03-14T04:18:56.2743856Z + [[ dynamic_cpu_inductor_huggingface == *xla* ]]
2025-03-14T04:18:56.2744120Z + [[ dynamic_cpu_inductor_huggingface == *executorch* ]]
2025-03-14T04:18:56.2744513Z + [[ dynamic_cpu_inductor_huggingface == \j\i\t\_\l\e\g\a\c\y ]]
2025-03-14T04:18:56.2744791Z + [[ linux-jammy-py3.9-gcc11-build == *libtorch* ]]
2025-03-14T04:18:56.2745059Z + [[ dynamic_cpu_inductor_huggingface == distributed ]]
2025-03-14T04:18:56.2745358Z + [[ dynamic_cpu_inductor_huggingface == *inductor_distributed* ]]
2025-03-14T04:18:56.2745651Z + [[ dynamic_cpu_inductor_huggingface == *inductor-halide* ]]
2025-03-14T04:18:56.2745950Z + [[ dynamic_cpu_inductor_huggingface == *inductor-triton-cpu* ]]
2025-03-14T04:18:56.2746265Z + [[ dynamic_cpu_inductor_huggingface == *inductor-micro-benchmark* ]]
2025-03-14T04:18:56.2746561Z + [[ dynamic_cpu_inductor_huggingface == *huggingface* ]]
2025-03-14T04:18:56.2746804Z + install_torchvision
2025-03-14T04:18:56.2746995Z + local orig_preload
2025-03-14T04:18:56.2747173Z + local commit
2025-03-14T04:18:56.2747354Z ++ get_pinned_commit vision
2025-03-14T04:18:56.2747573Z ++ cat .github/ci_commit_pins/vision.txt
2025-03-14T04:18:56.2752724Z + commit=d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:56.2753062Z + orig_preload=
2025-03-14T04:18:56.2753303Z + '[' -n '' ']'
2025-03-14T04:18:56.2753851Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:56.2754302Z + pip_install_pkg='python3 -m pip install --progress-bar off'
2025-03-14T04:18:56.2754805Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:56.5327095Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:56.5328268Z   Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-jqspoahd
2025-03-14T04:18:56.5359491Z   Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-jqspoahd
2025-03-14T04:18:57.8568812Z   Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f'
2025-03-14T04:18:57.8600930Z   Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:57.9842438Z   Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:18:58.2749626Z   Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f
2025-03-14T04:19:00.0146635Z   Preparing metadata (setup.py) ... [?25l- \ done
2025-03-14T04:19:00.0187561Z [?25hRequirement already satisfied: numpy in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torchvision==0.19.0a0+d23a6e1) (1.22.4)
2025-03-14T04:19:00.0188642Z Requirement already satisfied: torch in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.8.0a0+gitaed0b7a)
2025-03-14T04:19:00.0189325Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torchvision==0.19.0a0+d23a6e1) (11.0.0)
2025-03-14T04:19:00.0238583Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.16.1)
2025-03-14T04:19:00.0239411Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2)
2025-03-14T04:19:00.0246320Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.3)
2025-03-14T04:19:00.0252074Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2.8.8)
2025-03-14T04:19:00.0253175Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.6)
2025-03-14T04:19:00.0254025Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2024.10.0)
2025-03-14T04:19:00.0265806Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from sympy>=1.13.3->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0)
2025-03-14T04:19:00.0660345Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.9/lib/python3.9/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (3.0.2)
2025-03-14T04:19:00.0708615Z Building wheels for collected packages: torchvision
2025-03-14T04:19:21.2509573Z   Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done
2025-03-14T04:19:21.2530234Z [?25h  Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp39-cp39-linux_x86_64.whl size=1218776 sha256=af751cd5460541872da922e61f857d5825a0e51a131b961bd6864f622c99b024
2025-03-14T04:19:21.2531349Z   Stored in directory: /var/lib/jenkins/.cache/pip/wheels/76/25/46/00629fe1ec5f276eb28faecc4ae7c48c9ef9e6bbaa0691ad87
2025-03-14T04:19:21.2570349Z Successfully built torchvision
2025-03-14T04:19:21.6813009Z Installing collected packages: torchvision
2025-03-14T04:19:21.9825113Z Successfully installed torchvision-0.19.0a0+d23a6e1
2025-03-14T04:19:22.0849434Z + '[' -n '' ']'
2025-03-14T04:19:22.0849871Z + id=0
2025-03-14T04:19:22.0855065Z + test_dynamo_benchmark huggingface 0
2025-03-14T04:19:22.0857590Z ++ pwd
2025-03-14T04:19:22.0857953Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports
2025-03-14T04:19:22.0858285Z + local suite=huggingface
2025-03-14T04:19:22.0858481Z + shift
2025-03-14T04:19:22.0858650Z + local shard_id=0
2025-03-14T04:19:22.0858862Z + shift
2025-03-14T04:19:22.0859070Z + [[ dynamic_cpu_inductor_huggingface == *perf_compare* ]]
2025-03-14T04:19:22.0859345Z + [[ dynamic_cpu_inductor_huggingface == *perf* ]]
2025-03-14T04:19:22.0859604Z + [[ dynamic_cpu_inductor_huggingface == *cpu* ]]
2025-03-14T04:19:22.0859840Z + local dt=float32
2025-03-14T04:19:22.0860052Z + [[ dynamic_cpu_inductor_huggingface == *amp* ]]
2025-03-14T04:19:22.0860312Z + [[ dynamic_cpu_inductor_huggingface == *freezing* ]]
2025-03-14T04:19:22.0860632Z + test_single_dynamo_benchmark inference huggingface 0 --inference --float32
2025-03-14T04:19:22.0865631Z ++ pwd
2025-03-14T04:19:22.0867391Z + TEST_REPORTS_DIR=/var/lib/jenkins/workspace/test/test-reports
2025-03-14T04:19:22.0867889Z + mkdir -p /var/lib/jenkins/workspace/test/test-reports
2025-03-14T04:19:22.0889285Z + local name=inference
2025-03-14T04:19:22.0891131Z + shift
2025-03-14T04:19:22.0891441Z + local suite=huggingface
2025-03-14T04:19:22.0896538Z + shift
2025-03-14T04:19:22.0901435Z + local shard_id=0
2025-03-14T04:19:22.0905467Z + shift
2025-03-14T04:19:22.0910074Z + partition_flags=()
2025-03-14T04:19:22.0910328Z + local partition_flags
2025-03-14T04:19:22.0910540Z + [[ -n 1 ]]
2025-03-14T04:19:22.0910705Z + [[ -n 0 ]]
2025-03-14T04:19:22.0911028Z + partition_flags=(--total-partitions "$NUM_TEST_SHARDS" --partition-id "$shard_id")
2025-03-14T04:19:22.0911513Z + [[ dynamic_cpu_inductor_huggingface == *perf_compare* ]]
2025-03-14T04:19:22.0911801Z + [[ dynamic_cpu_inductor_huggingface == *perf* ]]
2025-03-14T04:19:22.0912070Z + [[ dynamic_cpu_inductor_huggingface == *_avx2* ]]
2025-03-14T04:19:22.0912344Z + [[ dynamic_cpu_inductor_huggingface == *_avx512* ]]
2025-03-14T04:19:22.0913169Z + python benchmarks/dynamo/huggingface.py --ci --accuracy --timing --explain --print-compilation-time --inductor --dynamic-shapes --dynamic-batch-only --device cpu --inference --float32 --total-partitions 1 --partition-id 0 --output /var/lib/jenkins/workspace/test/test-reports/inference_huggingface.csv
2025-03-14T04:19:24.4992977Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:19:24.4993974Z   warnings.warn(
2025-03-14T04:19:24.7251582Z 
2025-03-14T04:19:24.7290954Z config.json:   0% 0.00/694 [00:00<?, ?B/s]
2025-03-14T04:19:24.7291464Z config.json: 100% 694/694 [00:00<00:00, 173kB/s]
2025-03-14T04:19:24.7936003Z 
2025-03-14T04:19:24.7968970Z config.json:   0% 0.00/1.21k [00:00<?, ?B/s]
2025-03-14T04:19:24.7974329Z config.json: 100% 1.21k/1.21k [00:00<00:00, 352kB/s]
2025-03-14T04:19:24.8554298Z 
2025-03-14T04:19:24.8562593Z config.json:   0% 0.00/762 [00:00<?, ?B/s]
2025-03-14T04:19:24.8564366Z config.json: 100% 762/762 [00:00<00:00, 900kB/s]
2025-03-14T04:19:24.9106924Z 
2025-03-14T04:19:24.9112172Z config.json:   0% 0.00/626 [00:00<?, ?B/s]
2025-03-14T04:19:24.9112637Z config.json: 100% 626/626 [00:00<00:00, 800kB/s]
2025-03-14T04:19:24.9610297Z 
2025-03-14T04:19:24.9615650Z config.json:   0% 0.00/674 [00:00<?, ?B/s]
2025-03-14T04:19:24.9619717Z config.json: 100% 674/674 [00:00<00:00, 929kB/s]
2025-03-14T04:19:25.0534916Z 
2025-03-14T04:19:25.0544591Z config.json:   0% 0.00/508 [00:00<?, ?B/s]
2025-03-14T04:19:25.0545120Z config.json: 100% 508/508 [00:00<00:00, 640kB/s]
2025-03-14T04:19:27.4444349Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:19:27.4445260Z   warnings.warn(
2025-03-14T04:19:27.7173604Z 
2025-03-14T04:19:31.2588381Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:19:31.2588727Z loading model: 0it [00:03, ?it/s]
2025-03-14T04:19:31.2593730Z cpu  eval  AlbertForMaskedLM                  
2025-03-14T04:19:36.4813887Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:19:39.8988738Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:19:42.8297467Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:02.6819597Z Compilation time (from dynamo_timed): 14.974594847
2025-03-14T04:20:02.6820651Z pass
2025-03-14T04:20:02.6820963Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:02.6821795Z TIMING: _recursive_pre_grad_passes:0.00599 _recursive_joint_graph_passes:0.34046 _recursive_post_grad_passes:0.05436 async_compile.wait:1.28163 code_gen:10.43888 inductor_compile:11.41922 backend_compile:13.50526 entire_frame_compile:14.97459 gc:0.00013 total_wall_time:14.97459
2025-03-14T04:20:02.6825032Z STATS: call_* op count: 439 | FakeTensorMode.__torch_dispatch__:12486 | FakeTensor.__torch_dispatch__:1275 | ProxyTorchDispatchMode.__torch_dispatch__:5088
2025-03-14T04:20:02.6825672Z Dynamo produced 1 graphs covering 439 ops with 0 graph breaks (0 unique)
2025-03-14T04:20:06.7903914Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:20:06.7905397Z   warnings.warn(
2025-03-14T04:20:07.2473614Z 
2025-03-14T04:20:11.2120893Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:20:11.2121264Z loading model: 0it [00:03, ?it/s]
2025-03-14T04:20:11.2125299Z cpu  eval  AlbertForQuestionAnswering         
2025-03-14T04:20:18.1414581Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:21.5499577Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:24.8833957Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:40.6314859Z Compilation time (from dynamo_timed): 11.807724856
2025-03-14T04:20:40.6315336Z pass
2025-03-14T04:20:40.6317443Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:40.6318904Z TIMING: _recursive_pre_grad_passes:0.006 _recursive_joint_graph_passes:0.33992 _recursive_post_grad_passes:0.05842 async_compile.wait:1.23674 code_gen:7.2794 inductor_compile:8.2735 backend_compile:10.35056 entire_frame_compile:11.80772 gc:0.00032 total_wall_time:11.80772
2025-03-14T04:20:40.6320586Z STATS: call_* op count: 439 | FakeTensorMode.__torch_dispatch__:12420 | FakeTensor.__torch_dispatch__:1282 | ProxyTorchDispatchMode.__torch_dispatch__:5094
2025-03-14T04:20:40.6321413Z Dynamo produced 1 graphs covering 439 ops with 0 graph breaks (0 unique)
2025-03-14T04:20:44.7627986Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:20:44.7634138Z   warnings.warn(
2025-03-14T04:20:44.9649196Z 
2025-03-14T04:20:47.8937590Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:20:47.8938130Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:20:47.8950238Z cpu  eval  AllenaiLongformerBase              
2025-03-14T04:20:49.8992083Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:50.4673626Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:51.4420630Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:20:52.7067146Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] Graph break from `Tensor.item()`, consider setting:
2025-03-14T04:20:52.7067785Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     torch._dynamo.config.capture_scalar_outputs = True
2025-03-14T04:20:52.7068281Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] or:
2025-03-14T04:20:52.7068752Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     env TORCHDYNAMO_CAPTURE_SCALAR_OUTPUTS=1
2025-03-14T04:20:52.7069305Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] to include these operations in the captured graph.
2025-03-14T04:20:52.7069824Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] 
2025-03-14T04:20:52.7070261Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] Graph break: from user code at:
2025-03-14T04:20:52.7070902Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]   File "/var/lib/jenkins/workspace/benchmarks/dynamo/huggingface.py", line 525, in forward_pass
2025-03-14T04:20:52.7071581Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     return mod(**inputs)
2025-03-14T04:20:52.7072424Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]   File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1835, in forward
2025-03-14T04:20:52.7073164Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     outputs = self.longformer(
2025-03-14T04:20:52.7073877Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]   File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1738, in forward
2025-03-14T04:20:52.7074590Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     encoder_outputs = self.encoder(
2025-03-14T04:20:52.7075620Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]   File "/opt/conda/envs/py_3.9/lib/python3.9/site-packages/transformers/models/longformer/modeling_longformer.py", line 1291, in forward
2025-03-14T04:20:52.7076463Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0]     is_global_attn = is_index_global_attn.flatten().any().item()
2025-03-14T04:20:52.7076938Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] 
2025-03-14T04:20:52.7077297Z W0314 04:20:52.705226 5982 site-packages/torch/_dynamo/variables/tensor.py:913] [0/0] 
2025-03-14T04:22:28.0333472Z Compilation time (from dynamo_timed): 94.541247845
2025-03-14T04:22:28.0516873Z pass
2025-03-14T04:22:28.0521503Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:22:28.0527356Z TIMING: entire_frame_compile:94.54125 gc:0.00799 _recursive_pre_grad_passes:0.01802 _recursive_joint_graph_passes:0.77313 _recursive_post_grad_passes:0.67723 async_compile.wait:5.15091 code_gen:74.84136 inductor_compile:79.96744 backend_compile:90.05305 total_wall_time:94.54125
2025-03-14T04:22:28.0528712Z STATS: call_* op count: 1787 | FakeTensorMode.__torch_dispatch__:56778 | FakeTensor.__torch_dispatch__:4832 | ProxyTorchDispatchMode.__torch_dispatch__:21518
2025-03-14T04:22:28.0529239Z Dynamo produced 4 graphs covering 1787 ops with 4 graph breaks (1 unique)
2025-03-14T04:22:33.5007344Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:22:33.5009244Z   warnings.warn(
2025-03-14T04:22:34.0495534Z 
2025-03-14T04:22:36.9849647Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:22:36.9851416Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:22:36.9859154Z cpu  eval  BartForCausalLM                    
2025-03-14T04:22:38.6537396Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:22:39.2288097Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:22:39.7828933Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:22:55.2539649Z Compilation time (from dynamo_timed): 13.46516142
2025-03-14T04:22:55.2788891Z pass
2025-03-14T04:22:55.2791737Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:22:55.2797339Z TIMING: _recursive_pre_grad_passes:0.00577 _recursive_joint_graph_passes:0.47053 _recursive_post_grad_passes:0.05245 async_compile.wait:1.14202 code_gen:8.02129 inductor_compile:8.99554 backend_compile:11.61715 entire_frame_compile:13.46516 gc:8e-05 total_wall_time:13.46516
2025-03-14T04:22:55.2798756Z STATS: call_* op count: 328 | FakeTensorMode.__torch_dispatch__:11595 | FakeTensor.__torch_dispatch__:1185 | ProxyTorchDispatchMode.__torch_dispatch__:4673
2025-03-14T04:22:55.2799272Z Dynamo produced 1 graphs covering 328 ops with 0 graph breaks (0 unique)
2025-03-14T04:22:59.3535382Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:22:59.3536140Z   warnings.warn(
2025-03-14T04:22:59.5519015Z 
2025-03-14T04:23:04.4798175Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:23:04.4799490Z loading model: 0it [00:04, ?it/s]
2025-03-14T04:23:04.4827993Z cpu  eval  BartForConditionalGeneration       
2025-03-14T04:23:07.7320974Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:08.8471700Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:09.9530242Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:35.9220042Z Compilation time (from dynamo_timed): 23.600407279
2025-03-14T04:23:35.9309655Z pass
2025-03-14T04:23:35.9315394Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:35.9320944Z TIMING: _recursive_pre_grad_passes:0.01157 _recursive_joint_graph_passes:0.59161 _recursive_post_grad_passes:0.111 async_compile.wait:1.29046 code_gen:9.55357 inductor_compile:12.23063 backend_compile:18.29712 entire_frame_compile:23.60041 gc:0.00046 total_wall_time:23.60041
2025-03-14T04:23:35.9322598Z STATS: call_* op count: 888 | FakeTensorMode.__torch_dispatch__:30159 | FakeTensor.__torch_dispatch__:3013 | ProxyTorchDispatchMode.__torch_dispatch__:12275
2025-03-14T04:23:35.9323111Z Dynamo produced 1 graphs covering 888 ops with 0 graph breaks (0 unique)
2025-03-14T04:23:40.7618257Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:23:40.7619129Z   warnings.warn(
2025-03-14T04:23:40.9504476Z 
2025-03-14T04:23:42.1379068Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:23:42.1379585Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:23:42.1388738Z cpu  eval  BertForMaskedLM                    
2025-03-14T04:23:42.7985658Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:43.0205722Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:43.2459544Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:58.7149510Z Compilation time (from dynamo_timed): 13.837821214
2025-03-14T04:23:58.7210694Z pass
2025-03-14T04:23:58.7215572Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:23:58.7216538Z TIMING: _recursive_pre_grad_passes:0.00621 _recursive_joint_graph_passes:0.34504 _recursive_post_grad_passes:0.05319 async_compile.wait:1.31186 code_gen:7.40564 inductor_compile:8.3735 backend_compile:11.35692 entire_frame_compile:13.83782 gc:0.00143 total_wall_time:13.83782
2025-03-14T04:23:58.7223561Z STATS: call_* op count: 370 | FakeTensorMode.__torch_dispatch__:13602 | FakeTensor.__torch_dispatch__:1172 | ProxyTorchDispatchMode.__torch_dispatch__:5587
2025-03-14T04:23:58.7225458Z Dynamo produced 1 graphs covering 370 ops with 0 graph breaks (0 unique)
2025-03-14T04:24:02.9654767Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:24:02.9656547Z   warnings.warn(
2025-03-14T04:24:03.3104013Z 
2025-03-14T04:24:04.2803088Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:24:04.2805479Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:24:04.2816384Z cpu  eval  BertForQuestionAnswering           
2025-03-14T04:24:04.8195858Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:04.9978705Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:05.1765613Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:18.7273348Z Compilation time (from dynamo_timed): 12.331757604
2025-03-14T04:24:18.7277767Z pass
2025-03-14T04:24:18.7282649Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:18.7289512Z TIMING: _recursive_pre_grad_passes:0.0064 _recursive_joint_graph_passes:0.33844 _recursive_post_grad_passes:0.05799 async_compile.wait:0.00146 code_gen:5.99445 inductor_compile:6.95639 backend_compile:9.91578 entire_frame_compile:12.33176 gc:0.00114 total_wall_time:12.33176
2025-03-14T04:24:18.7291865Z STATS: call_* op count: 377 | FakeTensorMode.__torch_dispatch__:13648 | FakeTensor.__torch_dispatch__:1186 | ProxyTorchDispatchMode.__torch_dispatch__:5623
2025-03-14T04:24:18.7292372Z Dynamo produced 1 graphs covering 377 ops with 0 graph breaks (0 unique)
2025-03-14T04:24:22.9635471Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:24:22.9636391Z   warnings.warn(
2025-03-14T04:24:23.1986383Z 
2025-03-14T04:24:41.4351951Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:24:41.4352521Z loading model: 0it [00:18, ?it/s]
2025-03-14T04:24:41.4382018Z cpu  eval  BlenderbotForCausalLM              
2025-03-14T04:24:41.6057555Z Compilation time (from dynamo_timed): 0
2025-03-14T04:24:41.6058666Z pass_due_to_skip
2025-03-14T04:24:41.6059097Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:41.6059473Z TIMING: total_wall_time:0
2025-03-14T04:24:41.6059686Z STATS: call_* op count: 0
2025-03-14T04:24:41.6059984Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique)
2025-03-14T04:24:44.8872843Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:24:44.8873607Z   warnings.warn(
2025-03-14T04:24:45.5112199Z 
2025-03-14T04:24:46.2729301Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:24:46.2730466Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:24:46.2732917Z cpu  eval  BlenderbotSmallForCausalLM         
2025-03-14T04:24:46.3663552Z WARNING:common:fp64 golden ref were not generated for BlenderbotSmallForCausalLM. Setting accuracy check to cosine
2025-03-14T04:24:46.3738338Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:46.4375304Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:46.5019374Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:59.2108158Z Compilation time (from dynamo_timed): 11.760001316
2025-03-14T04:24:59.2108716Z pass
2025-03-14T04:24:59.2119414Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:24:59.2124173Z TIMING: _recursive_pre_grad_passes:0.00574 _recursive_joint_graph_passes:0.26054 _recursive_post_grad_passes:0.08026 async_compile.wait:1.28319 code_gen:7.20716 inductor_compile:8.24516 backend_compile:10.18448 entire_frame_compile:11.76 gc:0.00084 total_wall_time:11.76
2025-03-14T04:24:59.2125341Z STATS: call_* op count: 326 | FakeTensorMode.__torch_dispatch__:9368 | FakeTensor.__torch_dispatch__:967 | ProxyTorchDispatchMode.__torch_dispatch__:3800
2025-03-14T04:24:59.2125956Z Dynamo produced 1 graphs covering 326 ops with 0 graph breaks (0 unique)
2025-03-14T04:25:03.3716670Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:25:03.3717463Z   warnings.warn(
2025-03-14T04:25:03.7559666Z 
2025-03-14T04:25:04.7483681Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:25:04.7487636Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:25:04.7503404Z cpu  eval  BlenderbotSmallForConditionalGeneration 
2025-03-14T04:25:04.8506415Z WARNING:common:fp64 golden ref were not generated for BlenderbotSmallForConditionalGeneration. Setting accuracy check to cosine
2025-03-14T04:25:04.8575994Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:04.9778362Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:05.0973973Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:25.5702105Z Compilation time (from dynamo_timed): 19.266570073
2025-03-14T04:25:25.5706209Z pass
2025-03-14T04:25:25.5708696Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:25.5709994Z TIMING: _recursive_pre_grad_passes:0.00965 _recursive_joint_graph_passes:0.62886 _recursive_post_grad_passes:0.12057 async_compile.wait:1.3235 code_gen:8.84259 inductor_compile:10.97236 backend_compile:15.64451 entire_frame_compile:19.26657 gc:0.00206 total_wall_time:19.26657
2025-03-14T04:25:25.5712126Z STATS: call_* op count: 838 | FakeTensorMode.__torch_dispatch__:23847 | FakeTensor.__torch_dispatch__:2338 | ProxyTorchDispatchMode.__torch_dispatch__:9961
2025-03-14T04:25:25.5712766Z Dynamo produced 1 graphs covering 838 ops with 0 graph breaks (0 unique)
2025-03-14T04:25:30.0653166Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:25:30.0654113Z   warnings.warn(
2025-03-14T04:25:30.2735689Z 
2025-03-14T04:25:31.4252910Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:25:31.4258039Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:25:31.4268051Z cpu  eval  CamemBert                          
2025-03-14T04:25:32.0153802Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:32.2237763Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:32.4403059Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:47.4347735Z Compilation time (from dynamo_timed): 13.667073541
2025-03-14T04:25:47.4378193Z pass
2025-03-14T04:25:47.4383144Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:47.4383963Z TIMING: _recursive_pre_grad_passes:0.00701 _recursive_joint_graph_passes:0.34089 _recursive_post_grad_passes:0.05379 async_compile.wait:1.27844 code_gen:7.31637 inductor_compile:8.27712 backend_compile:11.24548 entire_frame_compile:13.66707 gc:0.00113 total_wall_time:13.66707
2025-03-14T04:25:47.4384874Z STATS: call_* op count: 378 | FakeTensorMode.__torch_dispatch__:13704 | FakeTensor.__torch_dispatch__:1190 | ProxyTorchDispatchMode.__torch_dispatch__:5626
2025-03-14T04:25:47.4385366Z Dynamo produced 1 graphs covering 378 ops with 0 graph breaks (0 unique)
2025-03-14T04:25:51.6698204Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:25:51.6699098Z   warnings.warn(
2025-03-14T04:25:51.9245021Z 
2025-03-14T04:25:53.5524800Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:25:53.5528419Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:25:53.5531369Z cpu  eval  DebertaForMaskedLM                 
2025-03-14T04:25:54.6034701Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:54.9753653Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:25:55.2558913Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:11.1202628Z Compilation time (from dynamo_timed): 14.472031959
2025-03-14T04:26:11.1279270Z pass
2025-03-14T04:26:11.1283468Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:11.1285608Z TIMING: _recursive_pre_grad_passes:0.00923 _recursive_joint_graph_passes:0.32681 _recursive_post_grad_passes:0.11871 async_compile.wait:1.26439 code_gen:8.10604 inductor_compile:9.94661 backend_compile:12.41594 entire_frame_compile:14.47203 gc:0.0014 total_wall_time:14.47203
2025-03-14T04:26:11.1286637Z STATS: call_* op count: 790 | FakeTensorMode.__torch_dispatch__:16283 | FakeTensor.__torch_dispatch__:1652 | ProxyTorchDispatchMode.__torch_dispatch__:6301
2025-03-14T04:26:11.1287126Z Dynamo produced 1 graphs covering 790 ops with 0 graph breaks (0 unique)
2025-03-14T04:26:15.2866640Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:26:15.2870300Z   warnings.warn(
2025-03-14T04:26:15.6542986Z 
2025-03-14T04:26:16.7717815Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:26:16.7718347Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:26:16.7730359Z cpu  eval  DebertaForQuestionAnswering        
2025-03-14T04:26:17.2977266Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:17.5140848Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:17.7810237Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:33.3009834Z Compilation time (from dynamo_timed): 14.434764802
2025-03-14T04:26:33.3010384Z pass
2025-03-14T04:26:33.3010875Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:33.3011820Z TIMING: _recursive_pre_grad_passes:0.00866 _recursive_joint_graph_passes:0.32723 _recursive_post_grad_passes:0.12174 async_compile.wait:1.24492 code_gen:7.96777 inductor_compile:9.79714 backend_compile:12.24465 entire_frame_compile:14.43476 gc:9e-05 total_wall_time:14.43476
2025-03-14T04:26:33.3012879Z STATS: call_* op count: 797 | FakeTensorMode.__torch_dispatch__:16321 | ProxyTorchDispatchMode.__torch_dispatch__:6337 | FakeTensor.__torch_dispatch__:1659
2025-03-14T04:26:33.3013459Z Dynamo produced 1 graphs covering 797 ops with 0 graph breaks (0 unique)
2025-03-14T04:26:37.4935620Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:26:37.4940002Z   warnings.warn(
2025-03-14T04:26:37.7220151Z 
2025-03-14T04:26:45.9268643Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:26:45.9269098Z loading model: 0it [00:08, ?it/s]
2025-03-14T04:26:45.9290963Z cpu  eval  DebertaV2ForMaskedLM               
2025-03-14T04:26:46.0440518Z Compilation time (from dynamo_timed): 0
2025-03-14T04:26:46.0440942Z pass_due_to_skip
2025-03-14T04:26:46.0441396Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:26:46.0441754Z TIMING: total_wall_time:0
2025-03-14T04:26:46.0441974Z STATS: call_* op count: 0
2025-03-14T04:26:46.0442300Z Dynamo produced 0 graphs covering 0 ops with 0 graph breaks (0 unique)
2025-03-14T04:26:49.1674240Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:26:49.1677466Z   warnings.warn(
2025-03-14T04:26:49.3745731Z 
2025-03-14T04:26:56.2103589Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:26:56.2105825Z loading model: 0it [00:06, ?it/s]
2025-03-14T04:26:56.2120607Z cpu  eval  DebertaV2ForQuestionAnswering      
2025-03-14T04:26:59.2268835Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:00.7669405Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:01.9858158Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:26.0472454Z Compilation time (from dynamo_timed): 21.836606608
2025-03-14T04:27:26.0472764Z pass
2025-03-14T04:27:26.0473084Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:26.0473881Z TIMING: _recursive_pre_grad_passes:0.01226 _recursive_joint_graph_passes:0.86547 _recursive_post_grad_passes:0.219 async_compile.wait:1.13218 code_gen:10.0036 inductor_compile:12.93806 backend_compile:17.5353 entire_frame_compile:21.83661 gc:0.00061 total_wall_time:21.83661
2025-03-14T04:27:26.0474903Z STATS: call_* op count: 1086 | FakeTensorMode.__torch_dispatch__:27523 | FakeTensor.__torch_dispatch__:2995 | ProxyTorchDispatchMode.__torch_dispatch__:11372
2025-03-14T04:27:26.0475425Z Dynamo produced 1 graphs covering 1086 ops with 0 graph breaks (0 unique)
2025-03-14T04:27:30.8120440Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:27:30.8121714Z   warnings.warn(
2025-03-14T04:27:31.3299137Z 
2025-03-14T04:27:32.0819326Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:27:32.0822289Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:27:32.0823192Z cpu  eval  DistilBertForMaskedLM              
2025-03-14T04:27:32.2651742Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:32.3216788Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:32.3769906Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:44.3294752Z Compilation time (from dynamo_timed): 10.936848742
2025-03-14T04:27:44.3299165Z pass
2025-03-14T04:27:44.3301620Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:44.3307252Z TIMING: _recursive_pre_grad_passes:0.00488 _recursive_joint_graph_passes:0.23048 _recursive_post_grad_passes:0.25771 async_compile.wait:1.25114 code_gen:6.90758 inductor_compile:7.80513 backend_compile:9.49996 entire_frame_compile:10.93685 gc:9e-05 total_wall_time:10.93685
2025-03-14T04:27:44.3309071Z STATS: call_* op count: 206 | FakeTensorMode.__torch_dispatch__:7657 | FakeTensor.__torch_dispatch__:785 | ProxyTorchDispatchMode.__torch_dispatch__:2990
2025-03-14T04:27:44.3309646Z Dynamo produced 1 graphs covering 206 ops with 0 graph breaks (0 unique)
2025-03-14T04:27:48.2791748Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:27:48.2792572Z   warnings.warn(
2025-03-14T04:27:48.5313730Z 
2025-03-14T04:27:49.1000650Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:27:49.1001068Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:27:49.1001989Z cpu  eval  DistilBertForQuestionAnswering     
2025-03-14T04:27:49.2395898Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:49.2943009Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:27:49.4286351Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:01.3050491Z Compilation time (from dynamo_timed): 10.888545089
2025-03-14T04:28:01.3051381Z pass
2025-03-14T04:28:01.3054882Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:01.3055745Z TIMING: _recursive_pre_grad_passes:0.00539 _recursive_joint_graph_passes:0.23291 _recursive_post_grad_passes:0.2682 async_compile.wait:1.21775 code_gen:6.81826 inductor_compile:7.73418 backend_compile:9.44239 entire_frame_compile:10.88855 gc:7e-05 total_wall_time:10.88855
2025-03-14T04:28:01.3057473Z STATS: call_* op count: 214 | FakeTensorMode.__torch_dispatch__:7714 | FakeTensor.__torch_dispatch__:799 | ProxyTorchDispatchMode.__torch_dispatch__:3031
2025-03-14T04:28:01.3058132Z Dynamo produced 1 graphs covering 214 ops with 0 graph breaks (0 unique)
2025-03-14T04:28:05.3712997Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:28:05.3717849Z   warnings.warn(
2025-03-14T04:28:05.6123461Z 
2025-03-14T04:28:06.6448025Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:28:06.6448343Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:28:06.6448585Z cpu  eval  DistillGPT2                        
2025-03-14T04:28:07.1149712Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:07.3217657Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:07.5661268Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:19.3120089Z Compilation time (from dynamo_timed): 10.575215494
2025-03-14T04:28:19.3272004Z pass
2025-03-14T04:28:19.3277107Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:19.3279359Z TIMING: _recursive_pre_grad_passes:0.00648 _recursive_joint_graph_passes:0.22524 _recursive_post_grad_passes:0.03624 async_compile.wait:1.3793 code_gen:7.19832 inductor_compile:7.73582 backend_compile:9.31997 entire_frame_compile:10.57522 gc:0.00059 total_wall_time:10.57522
2025-03-14T04:28:19.3280405Z STATS: call_* op count: 324 | FakeTensorMode.__torch_dispatch__:6981 | FakeTensor.__torch_dispatch__:620 | ProxyTorchDispatchMode.__torch_dispatch__:2783
2025-03-14T04:28:19.3284526Z Dynamo produced 1 graphs covering 324 ops with 0 graph breaks (0 unique)
2025-03-14T04:28:23.3597235Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:28:23.3598156Z   warnings.warn(
2025-03-14T04:28:23.6576475Z 
2025-03-14T04:28:23.6586108Z loading model: 0it [00:00, ?it/s]If you want to use `ElectraForCausalLM` as a standalone, add `is_decoder=True.`
2025-03-14T04:28:23.9041311Z 
2025-03-14T04:28:23.9042195Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:28:23.9046933Z cpu  eval  ElectraForCausalLM                 
2025-03-14T04:28:24.0557240Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:24.1403288Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:24.2133635Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:39.0294525Z Compilation time (from dynamo_timed): 13.653444569
2025-03-14T04:28:39.0356445Z pass
2025-03-14T04:28:39.0356924Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:39.0362438Z TIMING: _recursive_pre_grad_passes:0.00627 _recursive_joint_graph_passes:0.3408 _recursive_post_grad_passes:0.05249 async_compile.wait:1.279 code_gen:7.26121 inductor_compile:8.23551 backend_compile:11.2079 entire_frame_compile:13.65344 gc:0.00153 total_wall_time:13.65344
2025-03-14T04:28:39.0363477Z STATS: call_* op count: 375 | FakeTensorMode.__torch_dispatch__:13828 | FakeTensor.__torch_dispatch__:1186 | ProxyTorchDispatchMode.__torch_dispatch__:5642
2025-03-14T04:28:39.0363968Z Dynamo produced 1 graphs covering 375 ops with 0 graph breaks (0 unique)
2025-03-14T04:28:43.2227034Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:28:43.2229290Z   warnings.warn(
2025-03-14T04:28:43.4246776Z 
2025-03-14T04:28:43.6249406Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:28:43.6249790Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:28:43.6267492Z cpu  eval  ElectraForQuestionAnswering        
2025-03-14T04:28:43.7515334Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:43.8867696Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:43.9413804Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:57.3418182Z Compilation time (from dynamo_timed): 12.302007664
2025-03-14T04:28:57.3419624Z pass
2025-03-14T04:28:57.3420162Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:28:57.3421198Z TIMING: _recursive_pre_grad_passes:0.00619 _recursive_joint_graph_passes:0.34464 _recursive_post_grad_passes:0.05834 async_compile.wait:0.00153 code_gen:5.89045 inductor_compile:6.87095 backend_compile:9.86645 entire_frame_compile:12.30201 gc:0.0002 total_wall_time:12.30201
2025-03-14T04:28:57.3426101Z STATS: call_* op count: 378 | FakeTensorMode.__torch_dispatch__:13776 | FakeTensor.__torch_dispatch__:1198 | ProxyTorchDispatchMode.__torch_dispatch__:5658
2025-03-14T04:28:57.3427970Z Dynamo produced 1 graphs covering 378 ops with 0 graph breaks (0 unique)
2025-03-14T04:29:01.6307651Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:29:01.6308599Z   warnings.warn(
2025-03-14T04:29:01.8584693Z 
2025-03-14T04:29:03.4631916Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:29:03.4632975Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:29:03.4641693Z cpu  eval  GPT2ForSequenceClassification      
2025-03-14T04:29:05.2426962Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:05.5989190Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:05.9553091Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:21.0508725Z Compilation time (from dynamo_timed): 13.703450766
2025-03-14T04:29:21.0513046Z pass
2025-03-14T04:29:21.0513447Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:21.0518833Z TIMING: _recursive_pre_grad_passes:0.00871 _recursive_joint_graph_passes:0.55145 _recursive_post_grad_passes:0.05326 async_compile.wait:1.39772 code_gen:7.87987 inductor_compile:8.80423 backend_compile:11.59586 entire_frame_compile:13.70345 gc:0.00132 total_wall_time:13.70345
2025-03-14T04:29:21.0519788Z STATS: call_* op count: 633 | FakeTensorMode.__torch_dispatch__:12950 | FakeTensor.__torch_dispatch__:1156 | ProxyTorchDispatchMode.__torch_dispatch__:5298
2025-03-14T04:29:21.0520555Z Dynamo produced 1 graphs covering 633 ops with 0 graph breaks (0 unique)
2025-03-14T04:29:25.2527216Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:29:25.2528538Z   warnings.warn(
2025-03-14T04:29:25.5231875Z 
2025-03-14T04:29:26.4351172Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:29:26.4360163Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:29:26.4361977Z cpu  eval  GoogleFnet                         
2025-03-14T04:29:27.0046905Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:27.2405311Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:27.5268854Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:40.5756323Z Compilation time (from dynamo_timed): 11.499633305
2025-03-14T04:29:40.5812167Z pass
2025-03-14T04:29:40.5816261Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:40.5821485Z TIMING: _recursive_pre_grad_passes:0.00563 _recursive_joint_graph_passes:0.35772 _recursive_post_grad_passes:0.05156 async_compile.wait:1.32705 code_gen:7.46449 inductor_compile:8.20034 backend_compile:9.9729 entire_frame_compile:11.49963 gc:0.00011 total_wall_time:11.49963
2025-03-14T04:29:40.5822685Z STATS: call_* op count: 232 | FakeTensorMode.__torch_dispatch__:7088 | FakeTensor.__torch_dispatch__:902 | ProxyTorchDispatchMode.__torch_dispatch__:2863
2025-03-14T04:29:40.5823267Z Dynamo produced 1 graphs covering 232 ops with 0 graph breaks (0 unique)
2025-03-14T04:29:44.6904440Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:29:44.6905503Z   warnings.warn(
2025-03-14T04:29:44.8866470Z 
2025-03-14T04:29:46.0398371Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:29:46.0398691Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:29:46.0409960Z cpu  eval  LayoutLMForMaskedLM                
2025-03-14T04:29:46.6103582Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:46.8181762Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:29:47.0291755Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:02.4341271Z Compilation time (from dynamo_timed): 13.879983605
2025-03-14T04:30:02.4370038Z pass
2025-03-14T04:30:02.4372460Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:02.4373338Z TIMING: _recursive_pre_grad_passes:0.00671 _recursive_joint_graph_passes:0.3502 _recursive_post_grad_passes:0.05455 async_compile.wait:1.16388 code_gen:7.19956 inductor_compile:8.21364 backend_compile:11.31052 entire_frame_compile:13.87998 gc:0.00016 total_wall_time:13.87998
2025-03-14T04:30:02.4377891Z STATS: call_* op count: 396 | FakeTensorMode.__torch_dispatch__:14172 | FakeTensor.__torch_dispatch__:1209 | ProxyTorchDispatchMode.__torch_dispatch__:5808
2025-03-14T04:30:02.4379788Z Dynamo produced 1 graphs covering 396 ops with 0 graph breaks (0 unique)
2025-03-14T04:30:06.7489858Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:30:06.7494272Z   warnings.warn(
2025-03-14T04:30:07.1378972Z 
2025-03-14T04:30:08.1924682Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:30:08.1925510Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:30:08.1936848Z cpu  eval  LayoutLMForSequenceClassification  
2025-03-14T04:30:08.6928163Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:08.9546190Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:09.1468466Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:24.4158171Z Compilation time (from dynamo_timed): 13.792632157
2025-03-14T04:30:24.4160527Z pass
2025-03-14T04:30:24.4165076Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:24.4170024Z TIMING: _recursive_pre_grad_passes:0.00668 _recursive_joint_graph_passes:0.34225 _recursive_post_grad_passes:0.05341 async_compile.wait:1.26223 code_gen:7.23045 inductor_compile:8.21727 backend_compile:11.2808 entire_frame_compile:13.79263 gc:0.00058 total_wall_time:13.79263
2025-03-14T04:30:24.4171173Z STATS: call_* op count: 394 | FakeTensorMode.__torch_dispatch__:14023 | FakeTensor.__torch_dispatch__:1183 | ProxyTorchDispatchMode.__torch_dispatch__:5734
2025-03-14T04:30:24.4171684Z Dynamo produced 1 graphs covering 394 ops with 0 graph breaks (0 unique)
2025-03-14T04:30:28.5764600Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:30:28.5765359Z   warnings.warn(
2025-03-14T04:30:28.7705231Z 
2025-03-14T04:30:35.1573399Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:30:35.1575095Z loading model: 0it [00:06, ?it/s]
2025-03-14T04:30:35.1592018Z cpu  eval  M2M100ForConditionalGeneration     
2025-03-14T04:30:35.5504172Z WARNING:common:fp64 golden ref were not generated for M2M100ForConditionalGeneration. Setting accuracy check to cosine
2025-03-14T04:30:35.6054330Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:35.9482254Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:30:36.2519923Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:04.5983923Z Compilation time (from dynamo_timed): 26.636666948
2025-03-14T04:31:04.6041707Z pass
2025-03-14T04:31:04.6051522Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:04.6052391Z TIMING: _recursive_pre_grad_passes:0.01466 _recursive_joint_graph_passes:0.8949 _recursive_post_grad_passes:0.16684 async_compile.wait:1.39309 code_gen:11.38988 inductor_compile:14.46417 backend_compile:21.39954 entire_frame_compile:26.63667 gc:0.00297 total_wall_time:26.63667
2025-03-14T04:31:04.6053302Z STATS: call_* op count: 1290 | FakeTensorMode.__torch_dispatch__:35636 | FakeTensor.__torch_dispatch__:3321 | ProxyTorchDispatchMode.__torch_dispatch__:14886
2025-03-14T04:31:04.6053827Z Dynamo produced 1 graphs covering 1290 ops with 0 graph breaks (0 unique)
2025-03-14T04:31:09.4444611Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:31:09.4445511Z   warnings.warn(
2025-03-14T04:31:09.7449837Z 
2025-03-14T04:31:12.3991398Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:31:12.3996302Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:31:12.4007176Z cpu  eval  MBartForCausalLM                   
2025-03-14T04:31:12.5234066Z WARNING:common:fp64 golden ref were not generated for MBartForCausalLM. Setting accuracy check to cosine
2025-03-14T04:31:12.5500343Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:13.5524419Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:14.5341594Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:31.2807318Z Compilation time (from dynamo_timed): 14.669990358
2025-03-14T04:31:31.2974401Z pass
2025-03-14T04:31:31.2978144Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:31.2980488Z TIMING: _recursive_pre_grad_passes:0.00704 _recursive_joint_graph_passes:0.33853 _recursive_post_grad_passes:0.11197 async_compile.wait:1.21226 code_gen:8.50073 inductor_compile:9.71746 backend_compile:12.66347 entire_frame_compile:14.66999 gc:0.00126 total_wall_time:14.66999
2025-03-14T04:31:31.2981534Z STATS: call_* op count: 482 | FakeTensorMode.__torch_dispatch__:13691 | FakeTensor.__torch_dispatch__:1430 | ProxyTorchDispatchMode.__torch_dispatch__:5616
2025-03-14T04:31:31.2984277Z Dynamo produced 1 graphs covering 482 ops with 0 graph breaks (0 unique)
2025-03-14T04:31:35.4499324Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:31:35.4501343Z   warnings.warn(
2025-03-14T04:31:35.6390122Z 
2025-03-14T04:31:40.9415114Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:31:40.9417303Z loading model: 0it [00:05, ?it/s]
2025-03-14T04:31:40.9438609Z cpu  eval  MBartForConditionalGeneration      
2025-03-14T04:31:41.9447777Z WARNING:common:fp64 golden ref were not generated for MBartForConditionalGeneration. Setting accuracy check to cosine
2025-03-14T04:31:41.9857536Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:43.4488223Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:31:45.5208825Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:14.2238901Z Compilation time (from dynamo_timed): 26.127878747
2025-03-14T04:32:14.2352593Z pass
2025-03-14T04:32:14.2355252Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:14.2356072Z TIMING: _recursive_pre_grad_passes:0.01389 _recursive_joint_graph_passes:0.88235 _recursive_post_grad_passes:0.17264 async_compile.wait:1.24634 code_gen:10.74216 inductor_compile:13.8568 backend_compile:20.81998 entire_frame_compile:26.12788 gc:0.00013 total_wall_time:26.12788
2025-03-14T04:32:14.2357252Z STATS: call_* op count: 1263 | FakeTensorMode.__torch_dispatch__:35653 | FakeTensor.__torch_dispatch__:3517 | ProxyTorchDispatchMode.__torch_dispatch__:14956
2025-03-14T04:32:14.2357784Z Dynamo produced 1 graphs covering 1263 ops with 0 graph breaks (0 unique)
2025-03-14T04:32:19.0750135Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:32:19.0750952Z   warnings.warn(
2025-03-14T04:32:19.2676456Z 
2025-03-14T04:32:21.5334084Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:32:21.5336130Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:32:21.5340019Z cpu  eval  MT5ForConditionalGeneration        
2025-03-14T04:32:22.1381022Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:22.3957289Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:22.6532142Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:44.1529609Z Compilation time (from dynamo_timed): 20.093689832
2025-03-14T04:32:44.1706360Z pass
2025-03-14T04:32:44.1709032Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:44.1714255Z TIMING: _recursive_pre_grad_passes:0.01412 _recursive_joint_graph_passes:0.80224 _recursive_post_grad_passes:0.18554 async_compile.wait:1.38338 code_gen:10.02981 inductor_compile:11.94988 backend_compile:16.52883 entire_frame_compile:20.09369 gc:0.00025 total_wall_time:20.09369
2025-03-14T04:32:44.1716978Z STATS: call_* op count: 1174 | FakeTensorMode.__torch_dispatch__:26983 | ProxyTorchDispatchMode.__torch_dispatch__:10624 | FakeTensor.__torch_dispatch__:2362
2025-03-14T04:32:44.1717670Z Dynamo produced 1 graphs covering 1174 ops with 0 graph breaks (0 unique)
2025-03-14T04:32:48.4996388Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:32:48.4997486Z   warnings.warn(
2025-03-14T04:32:48.7109767Z 
2025-03-14T04:32:48.7138076Z loading model: 0it [00:00, ?it/s]If you want to use `MegatronBertForCausalLM` as a standalone, add `is_decoder=True.`
2025-03-14T04:32:51.6877850Z 
2025-03-14T04:32:51.6880585Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:32:51.6896319Z cpu  eval  MegatronBertForCausalLM            
2025-03-14T04:32:53.1525480Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:53.6768558Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:32:54.2300171Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:17.2097872Z Compilation time (from dynamo_timed): 21.040094987
2025-03-14T04:33:17.2147591Z pass
2025-03-14T04:33:17.2148112Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:17.2148994Z TIMING: _recursive_pre_grad_passes:0.0103 _recursive_joint_graph_passes:0.5907 _recursive_post_grad_passes:0.08682 async_compile.wait:1.31788 code_gen:8.99317 inductor_compile:10.82593 backend_compile:16.22291 entire_frame_compile:21.04009 gc:7e-05 total_wall_time:21.04009
2025-03-14T04:33:17.2155485Z STATS: call_* op count: 721 | FakeTensorMode.__torch_dispatch__:26134 | FakeTensor.__torch_dispatch__:2242 | ProxyTorchDispatchMode.__torch_dispatch__:10869
2025-03-14T04:33:17.2156066Z Dynamo produced 1 graphs covering 721 ops with 0 graph breaks (0 unique)
2025-03-14T04:33:21.6971756Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:33:21.6972618Z   warnings.warn(
2025-03-14T04:33:22.0640118Z 
2025-03-14T04:33:24.9583724Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:33:24.9584321Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:33:24.9603291Z cpu  eval  MegatronBertForQuestionAnswering   
2025-03-14T04:33:26.4621555Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:27.0278724Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:27.5724912Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:49.0704527Z Compilation time (from dynamo_timed): 19.319446637
2025-03-14T04:33:49.0706166Z pass
2025-03-14T04:33:49.0711823Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:49.0715851Z TIMING: _recursive_pre_grad_passes:0.00947 _recursive_joint_graph_passes:0.58631 _recursive_post_grad_passes:0.09105 async_compile.wait:0.00241 code_gen:7.3726 inductor_compile:9.18795 backend_compile:14.56789 entire_frame_compile:19.31945 gc:0.00143 total_wall_time:19.31945
2025-03-14T04:33:49.0718561Z STATS: call_* op count: 724 | FakeTensorMode.__torch_dispatch__:26118 | FakeTensor.__torch_dispatch__:2254 | ProxyTorchDispatchMode.__torch_dispatch__:10885
2025-03-14T04:33:49.0723470Z Dynamo produced 1 graphs covering 724 ops with 0 graph breaks (0 unique)
2025-03-14T04:33:53.5651760Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:33:53.5652644Z   warnings.warn(
2025-03-14T04:33:58.7651124Z 
2025-03-14T04:33:59.3883043Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:33:59.3884795Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:33:59.3942945Z cpu  eval  MobileBertForMaskedLM              
2025-03-14T04:33:59.6709121Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:59.8274024Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:33:59.9754580Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:34:36.0251982Z Compilation time (from dynamo_timed): 34.674486943
2025-03-14T04:34:36.0252870Z pass
2025-03-14T04:34:36.0253684Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:34:36.0254503Z TIMING: _recursive_pre_grad_passes:0.01942 _recursive_joint_graph_passes:1.04474 _recursive_post_grad_passes:0.14417 async_compile.wait:1.34978 code_gen:8.69414 inductor_compile:12.47893 backend_compile:23.58898 entire_frame_compile:34.67449 gc:0.00014 total_wall_time:34.67449
2025-03-14T04:34:36.0255379Z STATS: call_* op count: 1449 | FakeTensorMode.__torch_dispatch__:52387 | FakeTensor.__torch_dispatch__:3803 | ProxyTorchDispatchMode.__torch_dispatch__:21556
2025-03-14T04:34:36.0255884Z Dynamo produced 1 graphs covering 1449 ops with 0 graph breaks (0 unique)
2025-03-14T04:34:40.8154625Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:34:40.8155468Z   warnings.warn(
2025-03-14T04:34:41.0728829Z 
2025-03-14T04:34:41.6275720Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:34:41.6280449Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:34:41.6330791Z cpu  eval  MobileBertForQuestionAnswering     
2025-03-14T04:34:41.9959485Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:34:42.1868650Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:34:42.3104484Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:17.5525044Z Compilation time (from dynamo_timed): 33.983690566
2025-03-14T04:35:17.5525467Z pass
2025-03-14T04:35:17.5525842Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:17.5527052Z TIMING: _recursive_pre_grad_passes:0.0202 _recursive_joint_graph_passes:1.03566 _recursive_post_grad_passes:0.14889 async_compile.wait:0.97554 code_gen:8.02141 inductor_compile:11.81456 backend_compile:22.83326 entire_frame_compile:33.98369 gc:0.00052 total_wall_time:33.98369
2025-03-14T04:35:17.5528557Z STATS: call_* op count: 1453 | FakeTensorMode.__torch_dispatch__:52385 | ProxyTorchDispatchMode.__torch_dispatch__:21579 | FakeTensor.__torch_dispatch__:3810
2025-03-14T04:35:17.5529657Z Dynamo produced 1 graphs covering 1453 ops with 0 graph breaks (0 unique)
2025-03-14T04:35:22.4736477Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:35:22.4737856Z   warnings.warn(
2025-03-14T04:35:22.7290424Z 
2025-03-14T04:35:25.0552606Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:35:25.0556965Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:35:25.0557434Z cpu  eval  OPTForCausalLM                     
2025-03-14T04:35:25.1425416Z WARNING:common:fp64 golden ref were not generated for OPTForCausalLM. Setting accuracy check to cosine
2025-03-14T04:35:25.1601713Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:27.5703275Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:29.8205516Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:47.2326883Z Compilation time (from dynamo_timed): 15.078024721
2025-03-14T04:35:47.2664288Z pass
2025-03-14T04:35:47.2667093Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:47.2668209Z TIMING: _recursive_pre_grad_passes:0.00787 _recursive_joint_graph_passes:0.33586 _recursive_post_grad_passes:0.11559 async_compile.wait:1.39768 code_gen:8.73255 inductor_compile:9.95049 backend_compile:12.85845 entire_frame_compile:15.07802 gc:0.00079 total_wall_time:15.07802
2025-03-14T04:35:47.2673166Z STATS: call_* op count: 534 | FakeTensorMode.__torch_dispatch__:13586 | FakeTensor.__torch_dispatch__:1347 | ProxyTorchDispatchMode.__torch_dispatch__:5583
2025-03-14T04:35:47.2677675Z Dynamo produced 1 graphs covering 534 ops with 0 graph breaks (0 unique)
2025-03-14T04:35:51.4177463Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:35:51.4183205Z   warnings.warn(
2025-03-14T04:35:53.9623276Z 
2025-03-14T04:35:55.5999956Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:35:55.6002770Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:35:55.6009627Z cpu  eval  PLBartForCausalLM                  
2025-03-14T04:35:55.7425813Z WARNING:common:fp64 golden ref were not generated for PLBartForCausalLM. Setting accuracy check to cosine
2025-03-14T04:35:55.7536666Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:56.7527443Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:35:57.1737144Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:09.5962791Z Compilation time (from dynamo_timed): 10.796667575
2025-03-14T04:36:09.6108384Z pass
2025-03-14T04:36:09.6108959Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:09.6109926Z TIMING: _recursive_pre_grad_passes:0.00575 _recursive_joint_graph_passes:0.2208 _recursive_post_grad_passes:0.06469 async_compile.wait:1.34951 code_gen:7.20181 inductor_compile:8.04514 backend_compile:9.68702 entire_frame_compile:10.79667 gc:0.00089 total_wall_time:10.79667
2025-03-14T04:36:09.6110852Z STATS: call_* op count: 253 | FakeTensorMode.__torch_dispatch__:7275 | FakeTensor.__torch_dispatch__:748 | ProxyTorchDispatchMode.__torch_dispatch__:2921
2025-03-14T04:36:09.6111355Z Dynamo produced 1 graphs covering 253 ops with 0 graph breaks (0 unique)
2025-03-14T04:36:13.5717490Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:36:13.5718331Z   warnings.warn(
2025-03-14T04:36:14.0709727Z 
2025-03-14T04:36:16.3058539Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:36:16.3060135Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:36:16.3070434Z cpu  eval  PLBartForConditionalGeneration     
2025-03-14T04:36:16.6204062Z WARNING:common:fp64 golden ref were not generated for PLBartForConditionalGeneration. Setting accuracy check to cosine
2025-03-14T04:36:16.6326407Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:17.1125385Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:17.6531387Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:35.6154976Z Compilation time (from dynamo_timed): 16.109371039
2025-03-14T04:36:35.6265662Z pass
2025-03-14T04:36:35.6271534Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:35.6273174Z TIMING: _recursive_pre_grad_passes:0.00821 _recursive_joint_graph_passes:0.49461 _recursive_post_grad_passes:0.09863 async_compile.wait:1.24732 code_gen:8.05427 inductor_compile:9.76211 backend_compile:13.48172 entire_frame_compile:16.10937 gc:0.00155 total_wall_time:16.10937
2025-03-14T04:36:35.6274199Z STATS: call_* op count: 656 | FakeTensorMode.__torch_dispatch__:18450 | FakeTensor.__torch_dispatch__:1812 | ProxyTorchDispatchMode.__torch_dispatch__:7669
2025-03-14T04:36:35.6276618Z Dynamo produced 1 graphs covering 656 ops with 0 graph breaks (0 unique)
2025-03-14T04:36:39.8367271Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:36:39.8368017Z   warnings.warn(
2025-03-14T04:36:40.0827214Z 
2025-03-14T04:36:43.3481223Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:36:43.3481558Z loading model: 0it [00:03, ?it/s]
2025-03-14T04:36:43.3502071Z cpu  eval  PegasusForCausalLM                 
2025-03-14T04:36:43.5304531Z WARNING:common:fp64 golden ref were not generated for PegasusForCausalLM. Setting accuracy check to cosine
2025-03-14T04:36:43.5547408Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:43.7107454Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:43.8362652Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:59.6863971Z Compilation time (from dynamo_timed): 14.424045948
2025-03-14T04:36:59.6864351Z pass
2025-03-14T04:36:59.6868808Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:36:59.6869884Z TIMING: _recursive_pre_grad_passes:0.00675 _recursive_joint_graph_passes:0.3392 _recursive_post_grad_passes:0.11019 async_compile.wait:1.24637 code_gen:8.33622 inductor_compile:9.53015 backend_compile:12.43728 entire_frame_compile:14.42405 gc:0.00069 total_wall_time:14.42405
2025-03-14T04:36:59.6871026Z STATS: call_* op count: 478 | FakeTensorMode.__torch_dispatch__:13598 | FakeTensor.__torch_dispatch__:1411 | ProxyTorchDispatchMode.__torch_dispatch__:5575
2025-03-14T04:36:59.6871654Z Dynamo produced 1 graphs covering 478 ops with 0 graph breaks (0 unique)
2025-03-14T04:37:03.8848325Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:37:03.8849203Z   warnings.warn(
2025-03-14T04:37:04.0820222Z 
2025-03-14T04:37:09.4338033Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:37:09.4338587Z loading model: 0it [00:05, ?it/s]
2025-03-14T04:37:09.4359225Z cpu  eval  PegasusForConditionalGeneration    
2025-03-14T04:37:09.7047816Z WARNING:common:fp64 golden ref were not generated for PegasusForConditionalGeneration. Setting accuracy check to cosine
2025-03-14T04:37:09.7555442Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:10.0408188Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:10.2972477Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:37.8946299Z Compilation time (from dynamo_timed): 25.70576727
2025-03-14T04:37:37.8947467Z pass
2025-03-14T04:37:37.8953697Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:37.8958664Z TIMING: _recursive_pre_grad_passes:0.01349 _recursive_joint_graph_passes:0.88261 _recursive_post_grad_passes:0.16758 async_compile.wait:1.11227 code_gen:10.60955 inductor_compile:13.68196 backend_compile:20.52893 entire_frame_compile:25.70577 gc:0.00028 total_wall_time:25.70577
2025-03-14T04:37:37.8964139Z STATS: call_* op count: 1242 | FakeTensorMode.__torch_dispatch__:35223 | FakeTensor.__torch_dispatch__:3454 | ProxyTorchDispatchMode.__torch_dispatch__:14775
2025-03-14T04:37:37.8968119Z Dynamo produced 1 graphs covering 1242 ops with 0 graph breaks (0 unique)
2025-03-14T04:37:42.8166889Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:37:42.8167934Z   warnings.warn(
2025-03-14T04:37:43.0499206Z 
2025-03-14T04:37:43.0519693Z loading model: 0it [00:00, ?it/s]If you want to use `RobertaLMHeadModel` as a standalone, add `is_decoder=True.`
2025-03-14T04:37:44.2751506Z We strongly recommend passing in an `attention_mask` since your input_ids may be padded. See https://huggingface.co/docs/transformers/troubleshooting#incorrect-output-when-padding-tokens-arent-masked.
2025-03-14T04:37:44.2752921Z You may ignore this warning if your `pad_token_id` (0) is identical to the `bos_token_id` (0), `eos_token_id` (2), or the `sep_token_id` (None), and your input is not padded.
2025-03-14T04:37:44.4298815Z 
2025-03-14T04:37:44.4301254Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:37:44.4306842Z cpu  eval  RobertaForCausalLM                 
2025-03-14T04:37:45.0743348Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:45.3344643Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:37:45.6344486Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:01.1065478Z Compilation time (from dynamo_timed): 13.901484458
2025-03-14T04:38:01.1131644Z pass
2025-03-14T04:38:01.1133758Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:01.1134600Z TIMING: _recursive_pre_grad_passes:0.00634 _recursive_joint_graph_passes:0.34396 _recursive_post_grad_passes:0.05457 async_compile.wait:1.30766 code_gen:7.47019 inductor_compile:8.44669 backend_compile:11.44128 entire_frame_compile:13.90148 gc:0.00093 total_wall_time:13.90148
2025-03-14T04:38:01.1137441Z STATS: call_* op count: 382 | FakeTensorMode.__torch_dispatch__:13753 | FakeTensor.__torch_dispatch__:1191 | ProxyTorchDispatchMode.__torch_dispatch__:5642
2025-03-14T04:38:01.1137954Z Dynamo produced 1 graphs covering 382 ops with 0 graph breaks (0 unique)
2025-03-14T04:38:05.2108007Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:38:05.2109091Z   warnings.warn(
2025-03-14T04:38:05.5391532Z 
2025-03-14T04:38:06.4392927Z loading model: 0it [00:00, ?it/s]We strongly recommend passing in an `attention_mask` since your input_ids may be padded. See https://huggingface.co/docs/transformers/troubleshooting#incorrect-output-when-padding-tokens-arent-masked.
2025-03-14T04:38:06.4394509Z You may ignore this warning if your `pad_token_id` (0) is identical to the `bos_token_id` (0), `eos_token_id` (2), or the `sep_token_id` (None), and your input is not padded.
2025-03-14T04:38:06.5681430Z 
2025-03-14T04:38:06.5686406Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:38:06.5693445Z cpu  eval  RobertaForQuestionAnswering        
2025-03-14T04:38:07.0509956Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:07.4578473Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:07.7251466Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:21.4010638Z Compilation time (from dynamo_timed): 12.417753695
2025-03-14T04:38:21.4015097Z pass
2025-03-14T04:38:21.4017281Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:21.4018360Z TIMING: _recursive_pre_grad_passes:0.00627 _recursive_joint_graph_passes:0.33749 _recursive_post_grad_passes:0.05881 async_compile.wait:0.00168 code_gen:6.06608 inductor_compile:7.0256 backend_compile:9.99459 entire_frame_compile:12.41775 gc:8e-05 total_wall_time:12.41775
2025-03-14T04:38:21.4020035Z STATS: call_* op count: 384 | FakeTensorMode.__torch_dispatch__:13735 | FakeTensor.__torch_dispatch__:1203 | ProxyTorchDispatchMode.__torch_dispatch__:5658
2025-03-14T04:38:21.4020572Z Dynamo produced 1 graphs covering 384 ops with 0 graph breaks (0 unique)
2025-03-14T04:38:25.5536753Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:38:25.5537560Z   warnings.warn(
2025-03-14T04:38:25.8010333Z 
2025-03-14T04:38:26.0293711Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:38:26.0294135Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:38:26.0301947Z cpu  eval  Speech2Text2ForCausalLM            
2025-03-14T04:38:26.0443899Z WARNING:common:fp64 golden ref were not generated for Speech2Text2ForCausalLM. Setting accuracy check to cosine
2025-03-14T04:38:26.0460382Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:26.0705134Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:26.0926176Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:37.6227279Z Compilation time (from dynamo_timed): 10.432064039
2025-03-14T04:38:37.6227610Z pass
2025-03-14T04:38:37.6233828Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:37.6234779Z TIMING: _recursive_pre_grad_passes:0.00501 _recursive_joint_graph_passes:0.21747 _recursive_post_grad_passes:0.0632 async_compile.wait:1.25987 code_gen:6.88696 inductor_compile:7.70319 backend_compile:9.32963 entire_frame_compile:10.43206 gc:0.00074 total_wall_time:10.43206
2025-03-14T04:38:37.6235675Z STATS: call_* op count: 259 | FakeTensorMode.__torch_dispatch__:7292 | FakeTensor.__torch_dispatch__:701 | ProxyTorchDispatchMode.__torch_dispatch__:2910
2025-03-14T04:38:37.6236162Z Dynamo produced 1 graphs covering 259 ops with 0 graph breaks (0 unique)
2025-03-14T04:38:41.4488590Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:38:41.4489594Z   warnings.warn(
2025-03-14T04:38:41.7152169Z 
2025-03-14T04:38:42.6561545Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:38:42.6567127Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:38:42.6610817Z cpu  eval  T5ForConditionalGeneration         
2025-03-14T04:38:43.8214435Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:44.1881841Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:38:44.5946439Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:02.5966639Z Compilation time (from dynamo_timed): 16.399511879
2025-03-14T04:39:02.6048502Z pass
2025-03-14T04:39:02.6054117Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:02.6059103Z TIMING: _recursive_pre_grad_passes:0.00923 _recursive_joint_graph_passes:0.42581 _recursive_post_grad_passes:0.13641 async_compile.wait:1.73488 code_gen:9.00859 inductor_compile:10.57582 backend_compile:13.9547 entire_frame_compile:16.39951 gc:0.00017 total_wall_time:16.39951
2025-03-14T04:39:02.6060325Z STATS: call_* op count: 799 | FakeTensorMode.__torch_dispatch__:18727 | ProxyTorchDispatchMode.__torch_dispatch__:7316 | FakeTensor.__torch_dispatch__:1564
2025-03-14T04:39:02.6060830Z Dynamo produced 1 graphs covering 799 ops with 0 graph breaks (0 unique)
2025-03-14T04:39:06.7738633Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:39:06.7740217Z   warnings.warn(
2025-03-14T04:39:06.9815664Z 
2025-03-14T04:39:07.8999341Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:39:07.9002307Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:39:07.9009641Z cpu  eval  T5Small                            
2025-03-14T04:39:09.2263910Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:09.6165374Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:10.1329821Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:20.0306808Z Compilation time (from dynamo_timed): 8.321940319
2025-03-14T04:39:20.0435990Z pass
2025-03-14T04:39:20.0441289Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:20.0443044Z TIMING: _recursive_pre_grad_passes:0.00995 async_compile.wait:0.00525 backend_compile:5.89819 entire_frame_compile:8.32194 gc:0.00074 total_wall_time:8.32194
2025-03-14T04:39:20.0443547Z STATS: call_* op count: 799 | FakeTensorMode.__torch_dispatch__:2264
2025-03-14T04:39:20.0443882Z Dynamo produced 1 graphs covering 799 ops with 0 graph breaks (0 unique)
2025-03-14T04:39:23.6785156Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:39:23.6785956Z   warnings.warn(
2025-03-14T04:39:23.9511100Z 
2025-03-14T04:39:26.2537372Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:39:26.2542026Z loading model: 0it [00:02, ?it/s]
2025-03-14T04:39:26.2545616Z cpu  eval  TrOCRForCausalLM                   
2025-03-14T04:39:26.4272285Z WARNING:common:fp64 golden ref were not generated for TrOCRForCausalLM. Setting accuracy check to cosine
2025-03-14T04:39:26.4612129Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:26.7025624Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:26.9249496Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:42.5187356Z Compilation time (from dynamo_timed): 14.272603978
2025-03-14T04:39:42.5225245Z pass
2025-03-14T04:39:42.5230353Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:42.5233015Z TIMING: _recursive_pre_grad_passes:0.00672 _recursive_joint_graph_passes:0.34206 _recursive_post_grad_passes:0.10918 async_compile.wait:1.2802 code_gen:8.21121 inductor_compile:9.38996 backend_compile:12.29341 entire_frame_compile:14.2726 gc:0.00106 total_wall_time:14.2726
2025-03-14T04:39:42.5234085Z STATS: call_* op count: 479 | FakeTensorMode.__torch_dispatch__:13622 | FakeTensor.__torch_dispatch__:1415 | ProxyTorchDispatchMode.__torch_dispatch__:5585
2025-03-14T04:39:42.5238879Z Dynamo produced 1 graphs covering 479 ops with 0 graph breaks (0 unique)
2025-03-14T04:39:46.5394991Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:39:46.5396204Z   warnings.warn(
2025-03-14T04:39:49.3200751Z 
2025-03-14T04:39:55.2314640Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:39:55.2319580Z loading model: 0it [00:05, ?it/s]
2025-03-14T04:39:55.2331835Z cpu  eval  XGLMForCausalLM                    
2025-03-14T04:39:55.6448702Z WARNING:common:fp64 golden ref were not generated for XGLMForCausalLM. Setting accuracy check to cosine
2025-03-14T04:39:55.7318209Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:56.2214937Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:39:56.7182127Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:40:20.8187676Z Compilation time (from dynamo_timed): 22.257734218
2025-03-14T04:40:20.8296813Z pass
2025-03-14T04:40:20.8301111Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:40:20.8304815Z TIMING: _recursive_pre_grad_passes:0.01202 _recursive_joint_graph_passes:0.82492 _recursive_post_grad_passes:0.20763 async_compile.wait:1.36592 code_gen:10.53917 inductor_compile:12.89489 backend_compile:18.28032 entire_frame_compile:22.25773 gc:0.00065 total_wall_time:22.25773
2025-03-14T04:40:20.8306004Z STATS: call_* op count: 991 | FakeTensorMode.__torch_dispatch__:27111 | FakeTensor.__torch_dispatch__:2817 | ProxyTorchDispatchMode.__torch_dispatch__:11237
2025-03-14T04:40:20.8306555Z Dynamo produced 1 graphs covering 991 ops with 0 graph breaks (0 unique)
2025-03-14T04:40:25.6411125Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:40:25.6412006Z   warnings.warn(
2025-03-14T04:40:25.8358018Z 
2025-03-14T04:40:29.1331704Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:40:29.1335734Z loading model: 0it [00:03, ?it/s]
2025-03-14T04:40:29.1351657Z cpu  eval  XLNetLMHeadModel                   
2025-03-14T04:40:31.4706378Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:40:32.3268913Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:40:33.1797409Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:02.7420508Z Compilation time (from dynamo_timed): 27.535294211
2025-03-14T04:41:02.7452553Z pass
2025-03-14T04:41:02.7454919Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:02.7456565Z TIMING: _recursive_pre_grad_passes:0.01084 _recursive_joint_graph_passes:1.00768 _recursive_post_grad_passes:0.14365 async_compile.wait:1.14073 code_gen:10.19063 inductor_compile:13.8899 backend_compile:22.22485 entire_frame_compile:27.53529 gc:9e-05 total_wall_time:27.53529
2025-03-14T04:41:02.7457804Z STATS: call_* op count: 816 | FakeTensorMode.__torch_dispatch__:52632 | FakeTensor.__torch_dispatch__:4765 | ProxyTorchDispatchMode.__torch_dispatch__:18995
2025-03-14T04:41:02.7458406Z Dynamo produced 1 graphs covering 816 ops with 0 graph breaks (0 unique)
2025-03-14T04:41:07.5616833Z /opt/conda/envs/py_3.9/lib/python3.9/site-packages/huggingface_hub/file_download.py:797: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2025-03-14T04:41:07.5617774Z   warnings.warn(
2025-03-14T04:41:07.9985894Z 
2025-03-14T04:41:09.1285344Z loading model: 0it [00:00, ?it/s]
2025-03-14T04:41:09.1290768Z loading model: 0it [00:01, ?it/s]
2025-03-14T04:41:09.1301459Z cpu  eval  YituTechConvBert                   
2025-03-14T04:41:10.0129468Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:10.2789289Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:10.5490456Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:30.6189532Z Compilation time (from dynamo_timed): 18.600707489
2025-03-14T04:41:30.6239511Z pass
2025-03-14T04:41:30.6242691Z WARNING:common:Trying to call the empty_gpu_cache for device: cpu, which is not in list [cuda, xpu]
2025-03-14T04:41:30.6245707Z TIMING: _recursive_pre_grad_passes:0.00859 _recursive_joint_graph_passes:0.46995 _recursive_post_grad_passes:0.12477 async_compile.wait:1.14114 code_gen:8.71207 inductor_compile:10.62379 backend_compile:14.90513 entire_frame_compile:18.60071 gc:0.00111 total_wall_time:18.60071
2025-03-14T04:41:30.6249239Z STATS: call_* op count: 634 | FakeTensorMode.__torch_dispatch__:21363 | FakeTensor.__torch_dispatch__:1988 | ProxyTorchDispatchMode.__torch_dispatch__:8614
2025-03-14T04:41:30.6251208Z Dynamo produced 1 graphs covering 634 ops with 0 graph breaks (0 unique)
2025-03-14T04:41:32.5092360Z accuracy            pass_rate=95.65%
2025-03-14T04:41:32.5096529Z calls_captured      gmean=0.00x mean=636.022x
2025-03-14T04:41:32.5100058Z unique_graphs       gmean=0.00x mean=1.022x
2025-03-14T04:41:32.5104130Z graph_breaks        gmean=0.00x mean=0.087x
2025-03-14T04:41:32.5107853Z unique_graph_breaks gmean=0.00x mean=0.022x
2025-03-14T04:41:32.5108183Z autograd_captures   gmean=0.00x mean=0.000x
2025-03-14T04:41:32.5108413Z autograd_compiles   gmean=0.00x mean=0.000x
2025-03-14T04:41:32.5108636Z cudagraph_skips     gmean=0.00x mean=1.022x
2025-03-14T04:41:32.5108859Z compilation_latency mean=17.696 seconds
2025-03-14T04:41:33.0908271Z + python benchmarks/dynamo/check_accuracy.py --actual /var/lib/jenkins/workspace/test/test-reports/inference_huggingface.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamic_cpu_inductor_huggingface_inference.csv
2025-03-14T04:41:33.3074069Z AlbertForMaskedLM                   PASS
2025-03-14T04:41:33.3078648Z AlbertForQuestionAnswering          PASS
2025-03-14T04:41:33.3080772Z AllenaiLongformerBase               PASS
2025-03-14T04:41:33.3081183Z BartForCausalLM                     PASS
2025-03-14T04:41:33.3085846Z BartForConditionalGeneration        PASS
2025-03-14T04:41:33.3088516Z BertForMaskedLM                     PASS
2025-03-14T04:41:33.3088919Z BertForQuestionAnswering            PASS
2025-03-14T04:41:33.3093964Z BlenderbotForCausalLM               XFAIL
2025-03-14T04:41:33.3098996Z BlenderbotSmallForCausalLM          PASS
2025-03-14T04:41:33.3099474Z BlenderbotSmallForConditionalGeneration  PASS
2025-03-14T04:41:33.3099792Z CamemBert                           PASS
2025-03-14T04:41:33.3104232Z DebertaForMaskedLM                  PASS
2025-03-14T04:41:33.3106471Z DebertaForQuestionAnswering         PASS
2025-03-14T04:41:33.3106777Z DebertaV2ForMaskedLM                XFAIL
2025-03-14T04:41:33.3108018Z DebertaV2ForQuestionAnswering       PASS
2025-03-14T04:41:33.3108267Z DistilBertForMaskedLM               PASS
2025-03-14T04:41:33.3110377Z DistilBertForQuestionAnswering      PASS
2025-03-14T04:41:33.3120308Z DistillGPT2                         PASS
2025-03-14T04:41:33.3122453Z ElectraForCausalLM                  PASS
2025-03-14T04:41:33.3127125Z ElectraForQuestionAnswering         PASS
2025-03-14T04:41:33.3127513Z GPT2ForSequenceClassification       PASS
2025-03-14T04:41:33.3133568Z GoogleFnet                          PASS
2025-03-14T04:41:33.3137462Z LayoutLMForMaskedLM                 PASS
2025-03-14T04:41:33.3142315Z LayoutLMForSequenceClassification   PASS
2025-03-14T04:41:33.3146470Z M2M100ForConditionalGeneration      PASS
2025-03-14T04:41:33.3146779Z MBartForCausalLM                    PASS
2025-03-14T04:41:33.3147036Z MBartForConditionalGeneration       PASS
2025-03-14T04:41:33.3147272Z MT5ForConditionalGeneration         PASS
2025-03-14T04:41:33.3147499Z MegatronBertForCausalLM             PASS
2025-03-14T04:41:33.3147732Z MegatronBertForQuestionAnswering    PASS
2025-03-14T04:41:33.3149577Z MobileBertForMaskedLM               PASS
2025-03-14T04:41:33.3159821Z MobileBertForQuestionAnswering      PASS
2025-03-14T04:41:33.3163433Z OPTForCausalLM                      PASS
2025-03-14T04:41:33.3165222Z PLBartForCausalLM                   PASS
2025-03-14T04:41:33.3170881Z PLBartForConditionalGeneration      PASS
2025-03-14T04:41:33.3174861Z PegasusForCausalLM                  PASS
2025-03-14T04:41:33.3176983Z PegasusForConditionalGeneration     PASS
2025-03-14T04:41:33.3181726Z RobertaForCausalLM                  PASS
2025-03-14T04:41:33.3187088Z RobertaForQuestionAnswering         PASS
2025-03-14T04:41:33.3187383Z Speech2Text2ForCausalLM             PASS
2025-03-14T04:41:33.3187635Z T5ForConditionalGeneration          PASS
2025-03-14T04:41:33.3187861Z T5Small                             PASS
2025-03-14T04:41:33.3188078Z TrOCRForCausalLM                    PASS
2025-03-14T04:41:33.3188296Z XGLMForCausalLM                     PASS
2025-03-14T04:41:33.3192883Z XLNetLMHeadModel                    PASS
2025-03-14T04:41:33.3204274Z YituTechConvBert                    PASS
2025-03-14T04:41:33.3575665Z + python benchmarks/dynamo/check_graph_breaks.py --actual /var/lib/jenkins/workspace/test/test-reports/inference_huggingface.csv --expected benchmarks/dynamo/ci_expected_accuracy/dynamic_cpu_inductor_huggingface_inference.csv
2025-03-14T04:41:33.5743127Z AlbertForMaskedLM                   PASS
2025-03-14T04:41:33.5744801Z AlbertForQuestionAnswering          PASS
2025-03-14T04:41:33.5745254Z AllenaiLongformerBase               PASS
2025-03-14T04:41:33.5750930Z BartForCausalLM                     PASS
2025-03-14T04:41:33.5752890Z BartForConditionalGeneration        PASS
2025-03-14T04:41:33.5753297Z BertForMaskedLM                     PASS
2025-03-14T04:41:33.5756903Z BertForQuestionAnswering            PASS
2025-03-14T04:41:33.5757330Z BlenderbotForCausalLM               PASS
2025-03-14T04:41:33.5762203Z BlenderbotSmallForCausalLM          PASS
2025-03-14T04:41:33.5766937Z BlenderbotSmallForConditionalGeneration  PASS
2025-03-14T04:41:33.5768893Z CamemBert                           PASS
2025-03-14T04:41:33.5775295Z DebertaForMaskedLM                  PASS
2025-03-14T04:41:33.5780120Z DebertaForQuestionAnswering         PASS
2025-03-14T04:41:33.5784818Z DebertaV2ForMaskedLM                PASS
2025-03-14T04:41:33.5787097Z DebertaV2ForQuestionAnswering       PASS
2025-03-14T04:41:33.5787456Z DistilBertForMaskedLM               PASS
2025-03-14T04:41:33.5788048Z DistilBertForQuestionAnswering      PASS
2025-03-14T04:41:33.5788294Z DistillGPT2                         PASS
2025-03-14T04:41:33.5788520Z ElectraForCausalLM                  PASS
2025-03-14T04:41:33.5788945Z ElectraForQuestionAnswering         PASS
2025-03-14T04:41:33.5791074Z GPT2ForSequenceClassification       PASS
2025-03-14T04:41:33.5803226Z GoogleFnet                          PASS
2025-03-14T04:41:33.5805495Z LayoutLMForMaskedLM                 PASS
2025-03-14T04:41:33.5805883Z LayoutLMForSequenceClassification   PASS
2025-03-14T04:41:33.5811085Z M2M100ForConditionalGeneration      PASS
2025-03-14T04:41:33.5816042Z MBartForCausalLM                    PASS
2025-03-14T04:41:33.5818052Z MBartForConditionalGeneration       PASS
2025-03-14T04:41:33.5818443Z MT5ForConditionalGeneration         PASS
2025-03-14T04:41:33.5823842Z MegatronBertForCausalLM             PASS
2025-03-14T04:41:33.5826668Z MegatronBertForQuestionAnswering    PASS
2025-03-14T04:41:33.5826975Z MobileBertForMaskedLM               PASS
2025-03-14T04:41:33.5827240Z MobileBertForQuestionAnswering      PASS
2025-03-14T04:41:33.5827472Z OPTForCausalLM                      PASS
2025-03-14T04:41:33.5828802Z PLBartForCausalLM                   PASS
2025-03-14T04:41:33.5831813Z PLBartForConditionalGeneration      PASS
2025-03-14T04:41:33.5841825Z PegasusForCausalLM                  PASS
2025-03-14T04:41:33.5845420Z PegasusForConditionalGeneration     PASS
2025-03-14T04:41:33.5849576Z RobertaForCausalLM                  PASS
2025-03-14T04:41:33.5854025Z RobertaForQuestionAnswering         PASS
2025-03-14T04:41:33.5858293Z Speech2Text2ForCausalLM             PASS
2025-03-14T04:41:33.5862401Z T5ForConditionalGeneration          PASS
2025-03-14T04:41:33.5866646Z T5Small                             PASS
2025-03-14T04:41:33.5866944Z TrOCRForCausalLM                    PASS
2025-03-14T04:41:33.5867209Z XGLMForCausalLM                     PASS_BUT_FLAKY
2025-03-14T04:41:33.5867470Z XLNetLMHeadModel                    PASS
2025-03-14T04:41:33.5867711Z YituTechConvBert                    PASS
2025-03-14T04:41:33.6246356Z + cleanup_workspace
2025-03-14T04:41:33.6246996Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.'
2025-03-14T04:41:33.6247521Z sudo may print the following warning message that can be ignored. The chown command will still run.
2025-03-14T04:41:33.6247940Z + echo '    sudo: setrlimit(RLIMIT_STACK): Operation not permitted'
2025-03-14T04:41:33.6248247Z     sudo: setrlimit(RLIMIT_STACK): Operation not permitted
2025-03-14T04:41:33.6248620Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42'
2025-03-14T04:41:33.6248993Z For more details refer to https://github.com/sudo-project/sudo/issues/42
2025-03-14T04:41:33.6249307Z + sudo chown -R 1000 /var/lib/jenkins/workspace
2025-03-14T04:41:33.9690261Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@main
2025-03-14T04:41:33.9690594Z with:
2025-03-14T04:41:33.9690790Z   benchmark-results-dir: test/test-reports
2025-03-14T04:41:33.9691013Z   dry-run: false
2025-03-14T04:41:33.9691194Z   schema-version: v3
2025-03-14T04:41:33.9691566Z   github-token: ***
2025-03-14T04:41:33.9691738Z env:
2025-03-14T04:41:33.9691895Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:33.9692210Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:33.9692518Z ##[endgroup]
2025-03-14T04:41:33.9717924Z ##[group]Run set -eux
2025-03-14T04:41:33.9718135Z set -eux
2025-03-14T04:41:33.9718337Z python3 -mpip install boto3==1.35.33
2025-03-14T04:41:33.9724548Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:33.9724802Z env:
2025-03-14T04:41:33.9724976Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:33.9725315Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:33.9725616Z ##[endgroup]
2025-03-14T04:41:33.9751955Z + python3 -mpip install boto3==1.35.33
2025-03-14T04:41:34.1400982Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T04:41:34.8359900Z Collecting boto3==1.35.33
2025-03-14T04:41:34.8377314Z   Using cached boto3-1.35.33-py3-none-any.whl (139 kB)
2025-03-14T04:41:34.8422595Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.99)
2025-03-14T04:41:34.8425054Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0)
2025-03-14T04:41:34.8426125Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4)
2025-03-14T04:41:34.8468640Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.2)
2025-03-14T04:41:34.8476174Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10)
2025-03-14T04:41:34.8504544Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0)
2025-03-14T04:41:34.9646637Z Installing collected packages: boto3
2025-03-14T04:41:34.9647168Z   Attempting uninstall: boto3
2025-03-14T04:41:34.9648064Z     Found existing installation: boto3 1.35.42
2025-03-14T04:41:34.9708351Z     Uninstalling boto3-1.35.42:
2025-03-14T04:41:34.9715151Z       Successfully uninstalled boto3-1.35.42
2025-03-14T04:41:35.0147452Z Successfully installed boto3-1.35.33
2025-03-14T04:41:35.0835915Z ##[group]Run set -eux
2025-03-14T04:41:35.0836140Z set -eux
2025-03-14T04:41:35.0836313Z 
2025-03-14T04:41:35.0836519Z if [[ -z "${GITHUB_TOKEN}" ]]; then
2025-03-14T04:41:35.0836762Z   echo "Missing github-token input"
2025-03-14T04:41:35.0836976Z   exit 1
2025-03-14T04:41:35.0837137Z fi
2025-03-14T04:41:35.0842811Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.0843077Z env:
2025-03-14T04:41:35.0843255Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.0843565Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.0844154Z   GITHUB_TOKEN: ***
2025-03-14T04:41:35.0844347Z ##[endgroup]
2025-03-14T04:41:35.0878227Z + [[ -z *** ]]
2025-03-14T04:41:35.0960789Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main
2025-03-14T04:41:35.0961070Z with:
2025-03-14T04:41:35.0961366Z   github-token: ***
2025-03-14T04:41:35.0961536Z env:
2025-03-14T04:41:35.0961694Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.0962127Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.0962439Z ##[endgroup]
2025-03-14T04:41:35.0983739Z ##[group]Run set -eux
2025-03-14T04:41:35.0983940Z set -eux
2025-03-14T04:41:35.0984110Z 
2025-03-14T04:41:35.0984414Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}"
2025-03-14T04:41:35.0988125Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.0988392Z env:
2025-03-14T04:41:35.0988552Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.0988844Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.1012079Z   GITHUB_TOKEN: ***
2025-03-14T04:41:35.1012382Z ##[endgroup]
2025-03-14T04:41:35.1033454Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 13849515380 i-049962b53c600fa33
2025-03-14T04:41:35.7898432Z setting job-id=38754841887
2025-03-14T04:41:35.7902448Z setting job-name=linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:41:35.8027370Z ##[group]Run set -eux
2025-03-14T04:41:35.8027626Z set -eux
2025-03-14T04:41:35.8027797Z 
2025-03-14T04:41:35.8028072Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \
2025-03-14T04:41:35.8028399Z   --schema-version "${SCHEMA_VERSION}" \
2025-03-14T04:41:35.8028891Z   --repo "${REPO}" \
2025-03-14T04:41:35.8029111Z   --head-branch "${HEAD_BRANCH}" \
2025-03-14T04:41:35.8029341Z   --head-sha "${HEAD_SHA}" \
2025-03-14T04:41:35.8029572Z   --workflow-id "${WORKFLOW_RUN_ID}" \
2025-03-14T04:41:35.8029814Z   --run-attempt "${RUN_ATTEMPT}" \
2025-03-14T04:41:35.8030034Z   --job-id "${JOB_ID}" \
2025-03-14T04:41:35.8030241Z   --job-name "${JOB_NAME}"
2025-03-14T04:41:35.8034734Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.8034995Z env:
2025-03-14T04:41:35.8035172Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.8035479Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.8035794Z   SCHEMA_VERSION: v3
2025-03-14T04:41:35.8035974Z   REPO: pytorch/pytorch
2025-03-14T04:41:35.8036168Z   HEAD_BRANCH: refs/heads/main
2025-03-14T04:41:35.8036392Z   HEAD_SHA: aed0b7a742a2d7b7901790622829cbd2135049a4
2025-03-14T04:41:35.8036627Z   WORKFLOW_RUN_ID: 13849515380
2025-03-14T04:41:35.8036817Z   RUN_ATTEMPT: 1
2025-03-14T04:41:35.8036986Z   JOB_ID: 38754841887
2025-03-14T04:41:35.8037331Z   JOB_NAME: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:41:35.8037684Z ##[endgroup]
2025-03-14T04:41:35.8152971Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/main --head-sha aed0b7a742a2d7b7901790622829cbd2135049a4 --workflow-id 13849515380 --run-attempt 1 --job-id 38754841887 --job-name 'linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)'
2025-03-14T04:41:35.8408817Z ##[group]Run set -eux
2025-03-14T04:41:35.8409020Z set -eux
2025-03-14T04:41:35.8409192Z 
2025-03-14T04:41:35.8409391Z # TODO (huydhn): Implement this part
2025-03-14T04:41:35.8409634Z echo "runners=[]" >> "${GITHUB_OUTPUT}"
2025-03-14T04:41:35.8413442Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.8413693Z env:
2025-03-14T04:41:35.8413866Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.8414165Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.8414476Z ##[endgroup]
2025-03-14T04:41:35.8437865Z + echo 'runners=[]'
2025-03-14T04:41:35.8480154Z ##[group]Run set -eux
2025-03-14T04:41:35.8480510Z set -eux
2025-03-14T04:41:35.8480688Z 
2025-03-14T04:41:35.8480886Z # TODO (huydhn): Implement this part
2025-03-14T04:41:35.8481151Z echo "dependencies={}" >> "${GITHUB_OUTPUT}"
2025-03-14T04:41:35.8484646Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.8484889Z env:
2025-03-14T04:41:35.8485057Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.8485368Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.8485675Z ##[endgroup]
2025-03-14T04:41:35.8510874Z + echo 'dependencies={}'
2025-03-14T04:41:35.8534402Z ##[group]Run set -eux
2025-03-14T04:41:35.8534619Z set -eux
2025-03-14T04:41:35.8534791Z 
2025-03-14T04:41:35.8534988Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then
2025-03-14T04:41:35.8535282Z   echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping"
2025-03-14T04:41:35.8535601Z   # We don't want the job to fail if the directory doesn't exist
2025-03-14T04:41:35.8535857Z   exit 0
2025-03-14T04:41:35.8536023Z fi
2025-03-14T04:41:35.8536187Z 
2025-03-14T04:41:35.8536370Z if [[ "${DRY_RUN}" == "true" ]]; then
2025-03-14T04:41:35.8536674Z   python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \
2025-03-14T04:41:35.8537014Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2025-03-14T04:41:35.8537392Z     --metadata "${BENCHMARK_METADATA}" \
2025-03-14T04:41:35.8537627Z     --runners "${RUNNER_INFO}" \
2025-03-14T04:41:35.8537861Z     --dependencies "${DEPENDENCIES}" \
2025-03-14T04:41:35.8538081Z     --dry-run
2025-03-14T04:41:35.8538264Z else
2025-03-14T04:41:35.8538507Z   python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \
2025-03-14T04:41:35.8538836Z     --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \
2025-03-14T04:41:35.8539104Z     --metadata "${BENCHMARK_METADATA}" \
2025-03-14T04:41:35.8539335Z     --runners "${RUNNER_INFO}" \
2025-03-14T04:41:35.8539560Z     --dependencies "${DEPENDENCIES}"
2025-03-14T04:41:35.8539774Z fi
2025-03-14T04:41:35.8543315Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:35.8543557Z env:
2025-03-14T04:41:35.8543725Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:35.8544020Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:35.8544351Z   BENCHMARK_RESULTS_DIR: test/test-reports
2025-03-14T04:41:35.8544566Z   DRY_RUN: false
2025-03-14T04:41:35.8545362Z   BENCHMARK_METADATA: {"timestamp": 1741927295, "schema_version": "v3", "name": "linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "aed0b7a742a2d7b7901790622829cbd2135049a4", "workflow_id": 13849515380, "run_attempt": 1, "job_id": 38754841887}
2025-03-14T04:41:35.8546160Z   RUNNER_INFO: []
2025-03-14T04:41:35.8546333Z   DEPENDENCIES: {}
2025-03-14T04:41:35.8546503Z ##[endgroup]
2025-03-14T04:41:35.8566000Z + [[ ! -d test/test-reports ]]
2025-03-14T04:41:35.8566258Z + [[ false == \t\r\u\e ]]
2025-03-14T04:41:35.8567613Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1741927295, "schema_version": "v3", "name": "linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "aed0b7a742a2d7b7901790622829cbd2135049a4", "workflow_id": 13849515380, "run_attempt": 1, "job_id": 38754841887}' --runners '[]' --dependencies '{}'
2025-03-14T04:41:35.9685421Z INFO:root:Upload test/test-reports/inference_huggingface.json to s3://ossci-benchmarks/v3/pytorch/pytorch/13849515380/38754841887/inference_huggingface.json
2025-03-14T04:41:35.9960289Z INFO:botocore.credentials:Found credentials from IAM Role: gh-ci-github-action-runners-runner-role
2025-03-14T04:41:36.1681659Z INFO:root:Upload test/test-reports/inference_huggingface_graph_breaks.json to s3://ossci-benchmarks/v3/pytorch/pytorch/13849515380/38754841887/inference_huggingface_graph_breaks.json
2025-03-14T04:41:36.2894123Z ##[group]Run cat test/**/*_toprint.log || true
2025-03-14T04:41:36.2894403Z cat test/**/*_toprint.log || true
2025-03-14T04:41:36.2898740Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.2898990Z env:
2025-03-14T04:41:36.2899165Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.2899464Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.2899766Z ##[endgroup]
2025-03-14T04:41:36.2957016Z cat: 'test/**/*_toprint.log': No such file or directory
2025-03-14T04:41:36.2992928Z ##[group]Run kill "$MONITOR_SCRIPT_PID"
2025-03-14T04:41:36.2993181Z kill "$MONITOR_SCRIPT_PID"
2025-03-14T04:41:36.2996795Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.2997047Z env:
2025-03-14T04:41:36.2997217Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.2997514Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.2997972Z   MONITOR_SCRIPT_PID: 91074
2025-03-14T04:41:36.2998174Z ##[endgroup]
2025-03-14T04:41:36.3092909Z Prepare all required actions
2025-03-14T04:41:36.3093238Z Getting action download info
2025-03-14T04:41:36.4239259Z Download action repository 'actions/upload-artifact@v4' (SHA:4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1)
2025-03-14T04:41:36.8697971Z ##[group]Run ./.github/actions/upload-test-artifacts
2025-03-14T04:41:36.8698223Z with:
2025-03-14T04:41:36.8698499Z   file-suffix: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:41:36.8698819Z   s3-bucket: gha-artifacts
2025-03-14T04:41:36.8699010Z env:
2025-03-14T04:41:36.8699172Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.8699463Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.8699768Z ##[endgroup]
2025-03-14T04:41:36.8722630Z ##[group]Run # Remove any previous test jsons if they exist
2025-03-14T04:41:36.8722940Z # Remove any previous test jsons if they exist
2025-03-14T04:41:36.8723240Z rm -f test-jsons-*.zip
2025-03-14T04:41:36.8723524Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json'
2025-03-14T04:41:36.8728013Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.8728324Z env:
2025-03-14T04:41:36.8728499Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.8728809Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.8729231Z   FILE_SUFFIX: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:41:36.8729540Z ##[endgroup]
2025-03-14T04:41:36.8832941Z   adding: test/test-reports/inference_huggingface.json (deflated 99%)
2025-03-14T04:41:36.8836830Z   adding: test/test-reports/inference_huggingface_graph_breaks.json (deflated 96%)
2025-03-14T04:41:36.8859242Z ##[group]Run # Remove any previous test reports if they exist
2025-03-14T04:41:36.8859567Z # Remove any previous test reports if they exist
2025-03-14T04:41:36.8859833Z rm -f test-reports-*.zip
2025-03-14T04:41:36.8860148Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv'
2025-03-14T04:41:36.8864023Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.8864265Z env:
2025-03-14T04:41:36.8864422Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.8864714Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.8865123Z   FILE_SUFFIX: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:41:36.8865424Z ##[endgroup]
2025-03-14T04:41:36.8906047Z   adding: test/test-reports/inference_huggingface.csv (deflated 70%)
2025-03-14T04:41:36.8906540Z   adding: test/test-reports/inference_huggingface_graph_breaks.csv (deflated 85%)
2025-03-14T04:41:36.8907043Z   adding: test/test-reports/inference_huggingface_graph_break_deduped.csv (deflated 63%)
2025-03-14T04:41:36.8932539Z ##[group]Run # Remove any previous usage logs if they exist
2025-03-14T04:41:36.8932870Z # Remove any previous usage logs if they exist
2025-03-14T04:41:36.8933113Z rm -f logs-*.zip
2025-03-14T04:41:36.8933412Z # this workflow is also run in bazel build test, but we dont generate usage reports for it
2025-03-14T04:41:36.8933742Z # so check to see if the file exists first
2025-03-14T04:41:36.8933981Z if [ -f 'usage_log.txt' ]; then
2025-03-14T04:41:36.8934230Z     zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt'
2025-03-14T04:41:36.8934460Z fi
2025-03-14T04:41:36.8934711Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then
2025-03-14T04:41:36.8935046Z     zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log'
2025-03-14T04:41:36.8935294Z fi
2025-03-14T04:41:36.8938706Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.8938953Z env:
2025-03-14T04:41:36.8939232Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.8939631Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.8940108Z   FILE_SUFFIX: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:41:36.8940407Z ##[endgroup]
2025-03-14T04:41:36.8988668Z   adding: usage_log.txt (deflated 96%)
2025-03-14T04:41:36.9050596Z ##[group]Run # Remove any previous debugging artifacts if they exist
2025-03-14T04:41:36.9050934Z # Remove any previous debugging artifacts if they exist
2025-03-14T04:41:36.9051198Z rm -f debug-*.zip
2025-03-14T04:41:36.9051401Z if [ -d 'test/debug' ]; then
2025-03-14T04:41:36.9051643Z   zip -r "debug-${FILE_SUFFIX}.zip" test/debug
2025-03-14T04:41:36.9051871Z fi
2025-03-14T04:41:36.9055166Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:36.9055427Z env:
2025-03-14T04:41:36.9055601Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.9055932Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.9056515Z   FILE_SUFFIX: test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887
2025-03-14T04:41:36.9056830Z ##[endgroup]
2025-03-14T04:41:36.9127098Z ##[group]Run seemethere/upload-artifact-s3@v5
2025-03-14T04:41:36.9127332Z with:
2025-03-14T04:41:36.9127507Z   s3-bucket: gha-artifacts
2025-03-14T04:41:36.9127738Z   s3-prefix: pytorch/pytorch/13849515380/1/artifact

2025-03-14T04:41:36.9127974Z   retention-days: 14
2025-03-14T04:41:36.9128158Z   if-no-files-found: warn
2025-03-14T04:41:36.9128351Z   path: test-jsons-*.zip
2025-03-14T04:41:36.9128530Z   name: artifact
2025-03-14T04:41:36.9128700Z   region: us-east-1
2025-03-14T04:41:36.9128857Z env:
2025-03-14T04:41:36.9129013Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:36.9129308Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:36.9129609Z ##[endgroup]
2025-03-14T04:41:37.1980274Z NOTE: s3-prefix specified, ignoring name parameter
2025-03-14T04:41:37.1980870Z With the provided path, there will be 1 file uploaded
2025-03-14T04:41:37.1981328Z Uploading to s3 prefix: pytorch/pytorch/13849515380/1/artifact
2025-03-14T04:41:37.2005889Z Starting upload of test-jsons-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:37.3274643Z Finished upload of test-jsons-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:37.3430839Z ##[group]Run seemethere/upload-artifact-s3@v5
2025-03-14T04:41:37.3431085Z with:
2025-03-14T04:41:37.3431268Z   s3-bucket: gha-artifacts
2025-03-14T04:41:37.3431622Z   s3-prefix: pytorch/pytorch/13849515380/1/artifact

2025-03-14T04:41:37.3431865Z   retention-days: 14
2025-03-14T04:41:37.3432052Z   if-no-files-found: error
2025-03-14T04:41:37.3432254Z   path: test-reports-*.zip
2025-03-14T04:41:37.3432443Z   name: artifact
2025-03-14T04:41:37.3432618Z   region: us-east-1
2025-03-14T04:41:37.3432807Z env:
2025-03-14T04:41:37.3432970Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:37.3433279Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:37.3433585Z ##[endgroup]
2025-03-14T04:41:37.5842455Z NOTE: s3-prefix specified, ignoring name parameter
2025-03-14T04:41:37.5842814Z With the provided path, there will be 1 file uploaded
2025-03-14T04:41:37.5843118Z Uploading to s3 prefix: pytorch/pytorch/13849515380/1/artifact
2025-03-14T04:41:37.5867717Z Starting upload of test-reports-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:37.7074505Z Finished upload of test-reports-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:37.7234509Z ##[group]Run seemethere/upload-artifact-s3@v5
2025-03-14T04:41:37.7234754Z with:
2025-03-14T04:41:37.7234932Z   s3-bucket: gha-artifacts
2025-03-14T04:41:37.7235167Z   s3-prefix: pytorch/pytorch/13849515380/1/artifact

2025-03-14T04:41:37.7235542Z   retention-days: 14
2025-03-14T04:41:37.7235846Z   if-no-files-found: ignore
2025-03-14T04:41:37.7236046Z   path: logs-*.zip
2025-03-14T04:41:37.7236217Z   name: artifact
2025-03-14T04:41:37.7236382Z   region: us-east-1
2025-03-14T04:41:37.7236559Z env:
2025-03-14T04:41:37.7236725Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:37.7237032Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:37.7237343Z ##[endgroup]
2025-03-14T04:41:37.9610402Z NOTE: s3-prefix specified, ignoring name parameter
2025-03-14T04:41:37.9612303Z With the provided path, there will be 1 file uploaded
2025-03-14T04:41:37.9612758Z Uploading to s3 prefix: pytorch/pytorch/13849515380/1/artifact
2025-03-14T04:41:37.9631100Z Starting upload of logs-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:38.0695551Z Finished upload of logs-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:38.0859175Z ##[group]Run seemethere/upload-artifact-s3@v5
2025-03-14T04:41:38.0859415Z with:
2025-03-14T04:41:38.0859611Z   s3-bucket: gha-artifacts
2025-03-14T04:41:38.0859844Z   s3-prefix: pytorch/pytorch/13849515380/1/artifact

2025-03-14T04:41:38.0860079Z   retention-days: 14
2025-03-14T04:41:38.0860262Z   if-no-files-found: ignore
2025-03-14T04:41:38.0860455Z   path: debug-*.zip
2025-03-14T04:41:38.0860626Z   name: artifact
2025-03-14T04:41:38.0860788Z   region: us-east-1
2025-03-14T04:41:38.0860955Z env:
2025-03-14T04:41:38.0861117Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:38.0861414Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:38.0861721Z ##[endgroup]
2025-03-14T04:41:38.3197432Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded.
2025-03-14T04:41:38.3375054Z ##[group]Run # shellcheck disable=SC2156
2025-03-14T04:41:38.3375323Z # shellcheck disable=SC2156
2025-03-14T04:41:38.3375690Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \;
2025-03-14T04:41:38.3380180Z shell: /usr/bin/bash -e {0}
2025-03-14T04:41:38.3380389Z env:
2025-03-14T04:41:38.3380554Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:38.3380861Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:38.3381182Z ##[endgroup]
2025-03-14T04:41:38.4617558Z Prepare all required actions
2025-03-14T04:41:38.4617855Z Getting action download info
2025-03-14T04:41:38.5618875Z ##[group]Run ./.github/actions/upload-utilization-stats
2025-03-14T04:41:38.5619127Z with:
2025-03-14T04:41:38.5619302Z   job_id: 38754841887
2025-03-14T04:41:38.5619659Z   job_name: linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:41:38.5620025Z   workflow_name: inductor
2025-03-14T04:41:38.5620219Z   workflow_run_id: 13849515380
2025-03-14T04:41:38.5620414Z   workflow_attempt: 1
2025-03-14T04:41:38.5620610Z env:
2025-03-14T04:41:38.5620774Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:38.5621066Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:38.5621371Z ##[endgroup]
2025-03-14T04:41:38.5644132Z ##[group]Run echo "workflow_id: 13849515380"
2025-03-14T04:41:38.5644395Z echo "workflow_id: 13849515380"
2025-03-14T04:41:38.5644654Z echo "workflow_attempt: 1"
2025-03-14T04:41:38.5644874Z echo "workflow_Name: inductor"
2025-03-14T04:41:38.5645088Z echo "job_id: 38754841887"
2025-03-14T04:41:38.5645483Z echo "job_name:  linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)"
2025-03-14T04:41:38.5650003Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:38.5650257Z env:
2025-03-14T04:41:38.5650425Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:38.5650730Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:38.5651160Z ##[endgroup]
2025-03-14T04:41:38.5670381Z workflow_id: 13849515380
2025-03-14T04:41:38.5670705Z workflow_attempt: 1
2025-03-14T04:41:38.5670949Z workflow_Name: inductor
2025-03-14T04:41:38.5671132Z job_id: 38754841887
2025-03-14T04:41:38.5671596Z job_name:  linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)
2025-03-14T04:41:38.5704201Z ##[group]Run nick-fields/retry@v3.0.0
2025-03-14T04:41:38.5704429Z with:
2025-03-14T04:41:38.5704595Z   shell: bash
2025-03-14T04:41:38.5704766Z   timeout_minutes: 5
2025-03-14T04:41:38.5704943Z   max_attempts: 5
2025-03-14T04:41:38.5705180Z   retry_wait_seconds: 30
2025-03-14T04:41:38.5705485Z   command: set -eu
python3 -m pip install python-dateutil==2.8.2 boto3==1.35.42 pandas==2.1.3

2025-03-14T04:41:38.5706420Z   polling_interval_seconds: 1
2025-03-14T04:41:38.5706628Z   warning_on_retry: true
2025-03-14T04:41:38.5706815Z   continue_on_error: false
2025-03-14T04:41:38.5707011Z env:
2025-03-14T04:41:38.5707173Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:38.5707471Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:38.5707779Z ##[endgroup]
2025-03-14T04:41:38.8108362Z Defaulting to user installation because normal site-packages is not writeable
2025-03-14T04:41:38.8238605Z Requirement already satisfied: python-dateutil==2.8.2 in /home/ec2-user/.local/lib/python3.9/site-packages (2.8.2)
2025-03-14T04:41:39.4481927Z Collecting boto3==1.35.42
2025-03-14T04:41:39.4498695Z   Using cached boto3-1.35.42-py3-none-any.whl (139 kB)
2025-03-14T04:41:39.4519264Z Requirement already satisfied: pandas==2.1.3 in /home/ec2-user/.local/lib/python3.9/site-packages (2.1.3)
2025-03-14T04:41:39.4529821Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil==2.8.2) (1.15.0)
2025-03-14T04:41:39.4561434Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4)
2025-03-14T04:41:39.4567005Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0)
2025-03-14T04:41:39.4571288Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.99)
2025-03-14T04:41:39.5213726Z Requirement already satisfied: pytz>=2020.1 in /usr/lib/python3.9/site-packages (from pandas==2.1.3) (2022.7.1)
2025-03-14T04:41:39.5218906Z Requirement already satisfied: numpy<2,>=1.22.4 in /home/ec2-user/.local/lib/python3.9/site-packages (from pandas==2.1.3) (1.26.4)
2025-03-14T04:41:39.5223327Z Requirement already satisfied: tzdata>=2022.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from pandas==2.1.3) (2025.1)
2025-03-14T04:41:39.5262558Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10)
2025-03-14T04:41:39.5826499Z Installing collected packages: boto3
2025-03-14T04:41:39.5828147Z   Attempting uninstall: boto3
2025-03-14T04:41:39.5828397Z     Found existing installation: boto3 1.35.33
2025-03-14T04:41:39.5888119Z     Uninstalling boto3-1.35.33:
2025-03-14T04:41:39.5895778Z       Successfully uninstalled boto3-1.35.33
2025-03-14T04:41:39.6324153Z Successfully installed boto3-1.35.42
2025-03-14T04:41:40.6340309Z Command completed after 1 attempt(s).
2025-03-14T04:41:40.6410292Z ##[group]Run python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \
2025-03-14T04:41:40.6410720Z python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \
2025-03-14T04:41:40.6411043Z   --workflow-run-id "13849515380" \
2025-03-14T04:41:40.6411279Z   --workflow-name "inductor" \
2025-03-14T04:41:40.6411506Z   --workflow-run-attempt "1" \
2025-03-14T04:41:40.6411724Z   --job-id "38754841887" \
2025-03-14T04:41:40.6412121Z   --job-name "linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)"
2025-03-14T04:41:40.6416837Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:40.6417093Z env:
2025-03-14T04:41:40.6417271Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:40.6417575Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:40.6417902Z ##[endgroup]
2025-03-14T04:41:41.4377901Z repo: pytorch/pytorch
2025-03-14T04:41:41.4379636Z Downloading logs-test-dynamic_cpu_inductor_huggingface-1-1-linux.8xlarge.amx_38754841887.zip
2025-03-14T04:41:41.4380140Z Converted Log Model: UtilizationMetadata:
2025-03-14T04:41:41.4386087Z  UtilizationMetadata(level='metadata', workflow_id='13849515380', job_id='38754841887', workflow_name='inductor', job_name='linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)', usage_collect_interval=1.0, data_model_version=1.0, start_at=1741925854, gpu_count=0, cpu_count=32, gpu_type='', error=None)
2025-03-14T04:41:41.4387204Z [Db Segments] detected pytest cmd: 9, generated segments: 9
2025-03-14T04:41:41.4387537Z [db model] Peek db timeseries 
2025-03-14T04:41:41.4387779Z :{
2025-03-14T04:41:41.4387987Z     "created_at": 1741927301,
2025-03-14T04:41:41.4388230Z     "type": "utilization",
2025-03-14T04:41:41.4388475Z     "tags": [
2025-03-14T04:41:41.4388704Z         "record"
2025-03-14T04:41:41.4388879Z     ],
2025-03-14T04:41:41.4389116Z     "time_stamp": 1741925854,
2025-03-14T04:41:41.4389367Z     "repo": "pytorch/pytorch",
2025-03-14T04:41:41.4389619Z     "workflow_id": 13849515380,
2025-03-14T04:41:41.4389857Z     "run_attempt": 1,
2025-03-14T04:41:41.4390078Z     "job_id": 38754841887,
2025-03-14T04:41:41.4390312Z     "workflow_name": "inductor",
2025-03-14T04:41:41.4390769Z     "job_name": "linux-jammy-cpu-py3.9-gcc11-inductor / test (dynamic_cpu_inductor_huggingface, 1, 1, linux.8xlarge.amx)",
2025-03-14T04:41:41.4391185Z     "json_data": "{}"
2025-03-14T04:41:41.4391497Z }
2025-03-14T04:41:41.4391861Z Writing 1 documents to S3 ossci-utilization/util_metadata/v_1.0/pytorch/pytorch/13849515380/1/38754841887/metadata
2025-03-14T04:41:41.4392429Z Done! Finish writing document to S3 ossci-utilization/util_metadata/v_1.0/pytorch/pytorch/13849515380/1/38754841887/metadata 
2025-03-14T04:41:41.4393375Z Writing 279 documents to S3 ossci-utilization/util_timeseries/v_1.0/pytorch/pytorch/13849515380/1/38754841887/time_series
2025-03-14T04:41:41.4393993Z Done! Finish writing document to S3 ossci-utilization/util_timeseries/v_1.0/pytorch/pytorch/13849515380/1/38754841887/time_series 
2025-03-14T04:41:41.5351999Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main
2025-03-14T04:41:41.5352327Z with:
2025-03-14T04:41:41.5352512Z env:
2025-03-14T04:41:41.5352702Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:41.5353006Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:41.5353316Z ##[endgroup]
2025-03-14T04:41:41.5377924Z ##[group]Run set -eou pipefail
2025-03-14T04:41:41.5378184Z set -eou pipefail
2025-03-14T04:41:41.5378371Z 
2025-03-14T04:41:41.5378623Z echo "Holding runner for 2 hours until all ssh sessions have logged out"
2025-03-14T04:41:41.5378919Z for _ in $(seq 1440); do
2025-03-14T04:41:41.5379156Z     # Break if no ssh session exists anymore
2025-03-14T04:41:41.5379391Z     if [ "$(who)" = "" ]; then
2025-03-14T04:41:41.5379593Z       break
2025-03-14T04:41:41.5379762Z     fi
2025-03-14T04:41:41.5379974Z     echo "."
2025-03-14T04:41:41.5380147Z     sleep 5
2025-03-14T04:41:41.5380318Z done
2025-03-14T04:41:41.5385128Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:41.5385385Z env:
2025-03-14T04:41:41.5385553Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:41.5385853Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:41.5386273Z ##[endgroup]
2025-03-14T04:41:41.5407556Z Holding runner for 2 hours until all ssh sessions have logged out
2025-03-14T04:41:41.5453473Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T04:41:41.5453835Z # ignore expansion of "docker ps -q" since it could be empty
2025-03-14T04:41:41.5454113Z # shellcheck disable=SC2046
2025-03-14T04:41:41.5454345Z docker stop $(docker ps -q) || true
2025-03-14T04:41:41.5454583Z # Prune all of the docker images
2025-03-14T04:41:41.5454804Z docker system prune -af
2025-03-14T04:41:41.5458530Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:41.5458789Z env:
2025-03-14T04:41:41.5458963Z   GIT_DEFAULT_BRANCH: main
2025-03-14T04:41:41.5459272Z   DOCKER_CONTAINER_ID: 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:41.5459586Z ##[endgroup]
2025-03-14T04:41:52.0189806Z 7adbb43661e0
2025-03-14T04:41:52.3187319Z Deleted Containers:
2025-03-14T04:41:52.3191801Z 7adbb43661e0771169fdba0507f3a6a299f62217fc4be6027f557b2461b0b19b
2025-03-14T04:41:52.3196312Z 
2025-03-14T04:41:55.6107684Z Deleted Images:
2025-03-14T04:41:55.6108647Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks:aa89d6e739080d90fa18625d57297c6734465849
2025-03-14T04:41:55.6109933Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.9-gcc11-inductor-benchmarks@sha256:2f16eb7d476b5dc359eb789543b0cfc9aa5c04fe105d51acd219f91259bad5ab
2025-03-14T04:41:55.6110929Z deleted: sha256:1bab961b3bd90ec6714167a095e5437a0239700971887d1c663377ef708f8526
2025-03-14T04:41:55.6111604Z deleted: sha256:f1c70fafa21653c183da3a27b152e3132edfcc8f536568e599a8a7475a898486
2025-03-14T04:41:55.6112063Z deleted: sha256:257be7015a258302c070c7e2128106874db3320b42c0be587cde8a5c4668eb59
2025-03-14T04:41:55.6112635Z deleted: sha256:948eebb525eda26cfb174529301ea9c21fa30d7c38274102a4e84e8c5fbe8384
2025-03-14T04:41:55.6113150Z deleted: sha256:b9ac7767cf0b17526969b4b0803e8c07d3e794c502cfc420582474375cd9a813
2025-03-14T04:41:55.6113590Z deleted: sha256:80c0b71da98feea65ea51c56635d7acb37ad1eefb862adffe484b0a6ec73d382
2025-03-14T04:41:55.6114103Z deleted: sha256:9211eaf972d93a6b3e1157ed0733c6ef570902faf25a90ffcca263c3ecfe6a71
2025-03-14T04:41:55.6114591Z deleted: sha256:770a3a228550db1ce19da1d84c8ab8f7422a2d6b2177a744f04869331fdc011f
2025-03-14T04:41:55.6115161Z deleted: sha256:ca765c3fb3c14963c38334372443d928ed9dd142026ae5d3163a46c734f59f17
2025-03-14T04:41:55.6116547Z deleted: sha256:c693226c9ece102dfdf509e7a30f3389f47d01eb5736741dd7e5fa024b375eb6
2025-03-14T04:41:55.6117127Z deleted: sha256:d1f6e2d14a7b04693929aea0e661fb71482e5aa1b532a7125191965991fda143
2025-03-14T04:41:55.6117699Z deleted: sha256:07993bec321dd3bb3b1494aaa59c9394f9fcc3410757bd99f69589239a44725f
2025-03-14T04:41:55.6118260Z deleted: sha256:055322257b5cf41cb1a718868e89f759cdd0ff049e292ac7ef1d2a53ca86becd
2025-03-14T04:41:55.6118840Z deleted: sha256:252ed6634b114d7f66233d28c6ad76465b3644f087d340899c7e951999871bdc
2025-03-14T04:41:55.6119429Z deleted: sha256:1f4bc6481e6b53fcffa3231415bb421a166650c5c85cc8815fc631940944134d
2025-03-14T04:41:55.6120154Z deleted: sha256:757e553e71a5e40e7d79542c8fba96d32a5d5d2cc83dabe0a0873d2ae30a6760
2025-03-14T04:41:55.6120763Z deleted: sha256:c73d008283448cd7f9af3b7e93fa7224c699fb8bf57ea48bfa9bfa70b7d0899c
2025-03-14T04:41:55.6121313Z deleted: sha256:8f1f72b72763b40f294d9a61548ab4361197ad009b424337cbbab4b686e31b5e
2025-03-14T04:41:55.6121693Z deleted: sha256:457542c336f851527a24474a65464edf810bb01fc59d14a134de0966f2da22b5
2025-03-14T04:41:55.6122066Z deleted: sha256:0b068011d230ca630e8e88da9706397abab719e1e0f01458c050ab3dc266fb69
2025-03-14T04:41:55.6122453Z deleted: sha256:6b7611c1a0fe36fb64f6f38852ab7dd7128544ebd5b79fd1dae59588d01f1999
2025-03-14T04:41:55.6122830Z deleted: sha256:58418894fc257c7e5594b550bb7984c65bc6d459312f9a9ea6455c2a1ff7913f
2025-03-14T04:41:55.6123191Z deleted: sha256:9b8936eac0cf72c19f68e982a4114c32058b6f70c748a778848403779f2656a7
2025-03-14T04:41:55.6123730Z deleted: sha256:4f5c047819041836387aae08ee2b5f13239a3994f0ea2320ef272b2478dc8ef4
2025-03-14T04:41:55.6124117Z deleted: sha256:ed9af6f191cd384d7fe4ba6ff77a2314ce8f02d6eb65f4c22af24979dcab65f9
2025-03-14T04:41:55.6124511Z deleted: sha256:147d2ba7ff1f79138609e78e537e545abf74b6d35f8ce6e7631cd947cc97e4eb
2025-03-14T04:41:55.6124894Z deleted: sha256:c0383887a64b287af7ffb85f9e90ca26024838dee5135f0daa0f521e3c9f4700
2025-03-14T04:41:55.6125272Z deleted: sha256:d458cfd4d3050444c825537087bc07c1959e7fb8a3e339e109479a808f9aa3d7
2025-03-14T04:41:55.6125651Z deleted: sha256:185e72f4c05edf1cfb429debc32253ec9d900149e814f8109a0487b439c6499d
2025-03-14T04:41:55.6126035Z deleted: sha256:35a932e808caf02132ebe5708af4779e3a3bbb0d0f0d9dd768e042700dd6f1ac
2025-03-14T04:41:55.6126413Z deleted: sha256:b7ab9bb1ef36a3632cc73431e5f66d93a8a6b8606ceaac43a6530aef41d043be
2025-03-14T04:41:55.6126791Z deleted: sha256:98446da4367bce4c693b76a2c0dfe3e5d92337c68c3628411ed5a9d3e75e3001
2025-03-14T04:41:55.6127199Z deleted: sha256:2fa7934e407325f3915810fc60f7264a0e37d1fc3025dfe317ad47dfa736a596
2025-03-14T04:41:55.6127567Z deleted: sha256:5826059d955a5b42eb58fac9d3b728ea9b86c24950e455b575d0d675595fdb83
2025-03-14T04:41:55.6127938Z deleted: sha256:d0c120734162460fdbec1bc231b58beb664f44f28eb4faa45148425510538786
2025-03-14T04:41:55.6128311Z deleted: sha256:694a490b82d77b3cd2d35e952e32c6faad294ddc6437f5a3177f77b1e3c7617d
2025-03-14T04:41:55.6128687Z deleted: sha256:8098d7ec4fc850921ae016dac5183c08eac3cfdd64e5c4fb59f8bd4edf7db18b
2025-03-14T04:41:55.6129067Z deleted: sha256:e3ba634c3ec74783be198d136bf23bb929a7fb93e62ab20a1bcefd82c944dae3
2025-03-14T04:41:55.6129436Z deleted: sha256:6c787593e1088a677c18a8428fb718af38a8730c671b85e4ed3a15ad64cc655d
2025-03-14T04:41:55.6129801Z deleted: sha256:e513913d353704462a90df83aac640c6c5d894dd4dc2651954be291287b8c22b
2025-03-14T04:41:55.6130166Z deleted: sha256:a191277f29357fe043dd2122c9a4b78cd3ed9bfb92e7963cca9a9d101f575ba6
2025-03-14T04:41:55.6130543Z deleted: sha256:59f43ce6f7edc380dcc444b56e00f2dc9ef23196590e453e73e68295498f25b5
2025-03-14T04:41:55.6130914Z deleted: sha256:9e059d039c42b907d3b772990000dd155e0a8e82727705db50bd91a3fee87f72
2025-03-14T04:41:55.6131278Z deleted: sha256:369472d11d5b1bd72071cb5c2e5098082c7d7fc672aa13bd89d7102ef120fb14
2025-03-14T04:41:55.6131652Z deleted: sha256:2d910764023ddf5d12701abdd2fee664955fc097db5f24da2c109f3fc9ae07e8
2025-03-14T04:41:55.6132034Z deleted: sha256:e9b8a74eae78cdde6378061a2db467b6576d02ad41f9be215b0d9caca6e38aff
2025-03-14T04:41:55.6132469Z deleted: sha256:2dba6a95777543f0c4d7f5438367153b3d413e3fe0a67c67f5c616a48b52513a
2025-03-14T04:41:55.6132848Z deleted: sha256:f6342f36954b412d64fa5fcfeed36153e1864fb91a07d355a86421f24025fb26
2025-03-14T04:41:55.6133221Z deleted: sha256:2f42c8962a9681df48e3f6db2b6aebc67070be224ce48397934c362230e7b25a
2025-03-14T04:41:55.6133598Z deleted: sha256:7b16cb1a08ae455e502b2cc5eb9797f88ae1065ac3ef10d58b07cbc92320abed
2025-03-14T04:41:55.6134008Z deleted: sha256:53f49fe06b7e72120214392e1d0b5e349602569da8dd320124014e47170b1443
2025-03-14T04:41:55.6134384Z deleted: sha256:ab72286eb578c1e0ebb7f93a5033a70fa2987820d475ac58b94b9cda1d97d1f8
2025-03-14T04:41:55.6134760Z deleted: sha256:0f2284231d71ecf5b661c70c76f59235283ebea2109eeb9c930f28de80c25db7
2025-03-14T04:41:55.6135140Z deleted: sha256:c17a9c11f5fa0dd2fb6aa76c4d226ca4920a4814da35d11a23132c8cddea56de
2025-03-14T04:41:55.6135521Z deleted: sha256:5e7b289a68c88c68aaae9f774d75ef2c3560726dcb0bb68c40b83476f5279fc3
2025-03-14T04:41:55.6135898Z deleted: sha256:54383c657e0814e9df4dfeb9e439b4e9d961ea5567b5a8dd1fb8dcd274e6a542
2025-03-14T04:41:55.6136282Z deleted: sha256:23c598cb49f1778286c6dd9d3ad8fd6a5dda3723759aff290c57b9b4b33a5254
2025-03-14T04:41:55.6136664Z deleted: sha256:151e4be891c683a58b369e2a381d56d890726f130c1034198bafa486874d5f3c
2025-03-14T04:41:55.6137043Z deleted: sha256:67d27664ba27792cc2a3be862a7785db4b2e94e90cd475f1b4c3583420af54b2
2025-03-14T04:41:55.6137431Z deleted: sha256:444db72c2c6410fa918f5239d9f40f8d60bacc2a930c1d2e88e55ba7e90dd190
2025-03-14T04:41:55.6137862Z deleted: sha256:e5956c73e6ed7735c73c96aedb3facef946e7d8e8c7d575586f3984e2a088cd3
2025-03-14T04:41:55.6138228Z deleted: sha256:1161ba2320dc98f34e89e2b2cb247532b5b751d06388cef74c3d223d91c8a54f
2025-03-14T04:41:55.6138603Z deleted: sha256:636533db6e096cfee9d15fccffa860f852e36a17de826d1faa6437a8b4c2f07c
2025-03-14T04:41:55.6138975Z deleted: sha256:f17858d33b62b794fe3b08f18497295725959fce7165892d91022e21f4a58d35
2025-03-14T04:41:55.6139341Z deleted: sha256:f55340aa88fce044fd887201e56e51a56ca87457b6a9f6f9a9a62f80747cb592
2025-03-14T04:41:55.6139801Z deleted: sha256:c613727faed9b4df57f35fd72a70cc58fd88381934d9d791a2df9f7eb487949c
2025-03-14T04:41:55.6140194Z deleted: sha256:5202841bb151e8fbce051a8b8b8f4f5b7e85ecb6c850b69b598b89a274183357
2025-03-14T04:41:55.6140621Z deleted: sha256:d7be908f71f3b9bf7e4a187792e5bac7003dcd822e6cb7b37e8433357a424385
2025-03-14T04:41:55.6141002Z deleted: sha256:449c13d02298fc8bc6feed4fb489f32abb05d2b75276f53b3420f21ef4e5491b
2025-03-14T04:41:55.6141379Z deleted: sha256:f31347f63f35b34e452b270d28b824e9a4e2d0253c13f1dca0ddf8a215f44f00
2025-03-14T04:41:55.6141750Z deleted: sha256:807f08b2b423031a7d17dbbcd56df41066b0120a860db8bbb66d27623edc912d
2025-03-14T04:41:55.6142120Z deleted: sha256:9d014db3c35f5c903d5ec3aeedc2eb3f569b530ff55db80068e67279f389df4a
2025-03-14T04:41:55.6142491Z deleted: sha256:8ec9904b6ea8685f42923ea8255de513a06216a8d79d3e3ccda1a784f8bd87b3
2025-03-14T04:41:55.6142863Z deleted: sha256:d52c246bd07bfddac4b07ce20e1a71945bae916d4368fb5d428399401af72671
2025-03-14T04:41:55.6143611Z deleted: sha256:d3cc357f8bbe14bbbe61457d5b4f8965a24bb075da1e5587aac9ae3c795a8bcd
2025-03-14T04:41:55.6144007Z deleted: sha256:26b82bcc6a1cc00d5754a8546f1dcea0af13297161ad9c1ae9e69eb5ad77f45c
2025-03-14T04:41:55.6144386Z deleted: sha256:286d6fa3b60884a3f41e875ae31941ea7e573a833e6583fcc4322f6fe1f517a1
2025-03-14T04:41:55.6144764Z deleted: sha256:ce07ff180683bb03ff3bc34cd53532e4e226c1c315e6098a00fe6cef4a27778c
2025-03-14T04:41:55.6145150Z deleted: sha256:53f0f725132031f901b12e35d8c9cf4acaa8e2a2fd0ef6d5cde2300b948c8d6c
2025-03-14T04:41:55.6145533Z deleted: sha256:c5bf6f7b5a9c3ea1474f8c18b9576ee713beedd36681d88737b27cf67b65b8ca
2025-03-14T04:41:55.6145905Z deleted: sha256:cea84c16acbc664f0623251d326133807364242d4aa71b4043453c1ed04e34ca
2025-03-14T04:41:55.6146273Z deleted: sha256:947031bb2881adeacf7b5f11cd5795a50586936496113c72e65c084e283c0a2e
2025-03-14T04:41:55.6146640Z deleted: sha256:22d6d8480d3a77305df9afb31c18b2dd268f4fbbf54fc12986f3845b8b1c7181
2025-03-14T04:41:55.6147023Z deleted: sha256:cd0e364d2e6c89b30a70b5d41f89e8a6c9f852c3a62a25a340d413054bfdd489
2025-03-14T04:41:55.6147437Z deleted: sha256:5bfe8c860d56369c402728193b8d376f8b0948c947641e07b0460f168551c79b
2025-03-14T04:41:55.6147812Z deleted: sha256:bc3fd16e729f1b8fba3e121a50a01a62da3545c16492a2e57b3643fe60fd3836
2025-03-14T04:41:55.6148189Z deleted: sha256:0f94ad47e1720472ec7bbb4402d3e432ae769355ffe2a2411547955af4dea876
2025-03-14T04:41:55.6148563Z deleted: sha256:70e1d9f64d002c2498c5c48a25a306eeb36b26f9ed6300be8e2ca7c79097b9b3
2025-03-14T04:41:55.6148946Z deleted: sha256:73809ebb8d79f0f0b155a8845fcea4dd4828ed8509691978b263210ee358a6a6
2025-03-14T04:41:55.6149332Z deleted: sha256:e5e7b86dfe19031f1ab2b7cb20da98206fba3b4ebdd974bfdd35d0b4b80d5377
2025-03-14T04:41:55.6149725Z deleted: sha256:c64c0c772aad31d1c419f82c9e7a5bfa822e4ca9676b669d4f1fe131ea63ec49
2025-03-14T04:41:55.6150119Z deleted: sha256:270a1170e7e398434ff1b31e17e233f7d7b71aa99a40473615860068e86720af
2025-03-14T04:41:55.6150336Z 
2025-03-14T04:41:55.6150437Z Total reclaimed space: 33.53GB
2025-03-14T04:41:55.6208429Z Post job cleanup.
2025-03-14T04:41:55.6241262Z Post job cleanup.
2025-03-14T04:41:55.6995039Z [command]/usr/bin/git version
2025-03-14T04:41:55.7029837Z git version 2.47.1
2025-03-14T04:41:55.7057322Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/98987b03-a1eb-4169-9f00-e4a89f5a2a3c/.gitconfig'
2025-03-14T04:41:55.7082123Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/98987b03-a1eb-4169-9f00-e4a89f5a2a3c' before making global git config changes
2025-03-14T04:41:55.7083319Z Adding repository directory to the temporary git global config as a safe directory
2025-03-14T04:41:55.7092918Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2025-03-14T04:41:55.7149732Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-03-14T04:41:55.7182166Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-03-14T04:41:55.7476151Z Entering 'android/libs/fbjni'
2025-03-14T04:41:55.7524691Z Entering 'third_party/FP16'
2025-03-14T04:41:55.7570597Z Entering 'third_party/FXdiv'
2025-03-14T04:41:55.7617146Z Entering 'third_party/NNPACK'
2025-03-14T04:41:55.7668003Z Entering 'third_party/NVTX'
2025-03-14T04:41:55.7712640Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:41:55.7766636Z Entering 'third_party/XNNPACK'
2025-03-14T04:41:55.7825455Z Entering 'third_party/benchmark'
2025-03-14T04:41:55.7872542Z Entering 'third_party/composable_kernel'
2025-03-14T04:41:55.7927755Z Entering 'third_party/cpp-httplib'
2025-03-14T04:41:55.7978564Z Entering 'third_party/cpuinfo'
2025-03-14T04:41:55.8028583Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:41:55.8086522Z Entering 'third_party/cutlass'
2025-03-14T04:41:55.8141637Z Entering 'third_party/eigen'
2025-03-14T04:41:55.8189861Z Entering 'third_party/fbgemm'
2025-03-14T04:41:55.8233760Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:41:55.8284460Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:41:55.8330482Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:41:55.8377243Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:41:55.8436763Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:41:55.8498542Z Entering 'third_party/flash-attention'
2025-03-14T04:41:55.8538792Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:41:55.8584100Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:41:55.8649403Z Entering 'third_party/flatbuffers'
2025-03-14T04:41:55.8692722Z Entering 'third_party/fmt'
2025-03-14T04:41:55.8788701Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:41:55.8829391Z Entering 'third_party/gloo'
2025-03-14T04:41:55.8912034Z Entering 'third_party/googletest'
2025-03-14T04:41:55.8934034Z Entering 'third_party/ideep'
2025-03-14T04:41:55.8982787Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:41:55.9038470Z Entering 'third_party/ittapi'
2025-03-14T04:41:55.9086496Z Entering 'third_party/kineto'
2025-03-14T04:41:55.9134224Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:41:55.9179027Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:41:55.9225807Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:41:55.9270941Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:41:55.9320509Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:41:55.9366557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:41:55.9416026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:41:55.9462925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:41:55.9513307Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:41:55.9562062Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:41:55.9609581Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:41:55.9654536Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:41:55.9707332Z Entering 'third_party/kleidiai'
2025-03-14T04:41:55.9751929Z Entering 'third_party/mimalloc'
2025-03-14T04:41:55.9806369Z Entering 'third_party/nlohmann'
2025-03-14T04:41:55.9851737Z Entering 'third_party/onnx'
2025-03-14T04:41:55.9910496Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:41:55.9962094Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:41:56.0007839Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:41:56.0054080Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:41:56.0103124Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:41:56.0148563Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:41:56.0197282Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:41:56.0243115Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:41:56.0289571Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:41:56.0336291Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:41:56.0385092Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:41:56.0450907Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:41:56.0516917Z Entering 'third_party/pocketfft'
2025-03-14T04:41:56.0566481Z Entering 'third_party/protobuf'
2025-03-14T04:41:56.0614536Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:41:56.0662397Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:41:56.0711177Z Entering 'third_party/psimd'
2025-03-14T04:41:56.0760819Z Entering 'third_party/pthreadpool'
2025-03-14T04:41:56.0807408Z Entering 'third_party/pybind11'
2025-03-14T04:41:56.0853436Z Entering 'third_party/python-peachpy'
2025-03-14T04:41:56.0902450Z Entering 'third_party/sleef'
2025-03-14T04:41:56.0947313Z Entering 'third_party/tensorpipe'
2025-03-14T04:41:56.0996179Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:41:56.1045289Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:41:56.1092879Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:41:56.1142178Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:41:56.1189804Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:41:56.1260026Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-03-14T04:41:56.1281605Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1290741Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2025-03-14T04:41:56.1322987Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-03-14T04:41:56.1612882Z Entering 'android/libs/fbjni'
2025-03-14T04:41:56.1642501Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1673792Z Entering 'third_party/FP16'
2025-03-14T04:41:56.1703959Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1736140Z Entering 'third_party/FXdiv'
2025-03-14T04:41:56.1768335Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1803937Z Entering 'third_party/NNPACK'
2025-03-14T04:41:56.1836026Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1865574Z Entering 'third_party/NVTX'
2025-03-14T04:41:56.1896834Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1933003Z Entering 'third_party/VulkanMemoryAllocator'
2025-03-14T04:41:56.1965614Z http.https://github.com/.extraheader
2025-03-14T04:41:56.1995548Z Entering 'third_party/XNNPACK'
2025-03-14T04:41:56.2027232Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2070441Z Entering 'third_party/benchmark'
2025-03-14T04:41:56.2101674Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2134007Z Entering 'third_party/composable_kernel'
2025-03-14T04:41:56.2165666Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2205884Z Entering 'third_party/cpp-httplib'
2025-03-14T04:41:56.2233380Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2269077Z Entering 'third_party/cpuinfo'
2025-03-14T04:41:56.2300412Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2335225Z Entering 'third_party/cudnn_frontend'
2025-03-14T04:41:56.2364898Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2396019Z Entering 'third_party/cutlass'
2025-03-14T04:41:56.2427943Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2467640Z Entering 'third_party/eigen'
2025-03-14T04:41:56.2498381Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2527420Z Entering 'third_party/fbgemm'
2025-03-14T04:41:56.2562483Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2597563Z Entering 'third_party/fbgemm/third_party/asmjit'
2025-03-14T04:41:56.2626178Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2660741Z Entering 'third_party/fbgemm/third_party/cpuinfo'
2025-03-14T04:41:56.2685872Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2723332Z Entering 'third_party/fbgemm/third_party/cutlass'
2025-03-14T04:41:56.2751120Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2790528Z Entering 'third_party/fbgemm/third_party/googletest'
2025-03-14T04:41:56.2823247Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2853016Z Entering 'third_party/fbgemm/third_party/hipify_torch'
2025-03-14T04:41:56.2890758Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2923509Z Entering 'third_party/flash-attention'
2025-03-14T04:41:56.2953112Z http.https://github.com/.extraheader
2025-03-14T04:41:56.2986786Z Entering 'third_party/flash-attention/csrc/composable_kernel'
2025-03-14T04:41:56.3016429Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3057127Z Entering 'third_party/flash-attention/csrc/cutlass'
2025-03-14T04:41:56.3084456Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3123825Z Entering 'third_party/flatbuffers'
2025-03-14T04:41:56.3154950Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3189376Z Entering 'third_party/fmt'
2025-03-14T04:41:56.3220708Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3250441Z Entering 'third_party/gemmlowp/gemmlowp'
2025-03-14T04:41:56.3285052Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3317347Z Entering 'third_party/gloo'
2025-03-14T04:41:56.3344479Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3379721Z Entering 'third_party/googletest'
2025-03-14T04:41:56.3410683Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3441098Z Entering 'third_party/ideep'
2025-03-14T04:41:56.3469764Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3502721Z Entering 'third_party/ideep/mkl-dnn'
2025-03-14T04:41:56.3531796Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3570693Z Entering 'third_party/ittapi'
2025-03-14T04:41:56.3598882Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3631140Z Entering 'third_party/kineto'
2025-03-14T04:41:56.3663902Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3695666Z Entering 'third_party/kineto/libkineto/third_party/dynolog'
2025-03-14T04:41:56.3724995Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3756982Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
2025-03-14T04:41:56.3787296Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3822603Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
2025-03-14T04:41:56.3850190Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3882993Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
2025-03-14T04:41:56.3913366Z http.https://github.com/.extraheader
2025-03-14T04:41:56.3947651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
2025-03-14T04:41:56.3979385Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4008858Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
2025-03-14T04:41:56.4040308Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4070271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
2025-03-14T04:41:56.4100379Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4133681Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
2025-03-14T04:41:56.4166028Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4198553Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
2025-03-14T04:41:56.4225953Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4257198Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
2025-03-14T04:41:56.4288041Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4327027Z Entering 'third_party/kineto/libkineto/third_party/fmt'
2025-03-14T04:41:56.4354720Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4389494Z Entering 'third_party/kineto/libkineto/third_party/googletest'
2025-03-14T04:41:56.4419486Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4454089Z Entering 'third_party/kleidiai'
2025-03-14T04:41:56.4483162Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4512902Z Entering 'third_party/mimalloc'
2025-03-14T04:41:56.4545186Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4580026Z Entering 'third_party/nlohmann'
2025-03-14T04:41:56.4610864Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4644133Z Entering 'third_party/onnx'
2025-03-14T04:41:56.4676203Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4719653Z Entering 'third_party/onnx/third_party/pybind11'
2025-03-14T04:41:56.4750359Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4786601Z Entering 'third_party/opentelemetry-cpp'
2025-03-14T04:41:56.4818017Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4850302Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark'
2025-03-14T04:41:56.4882109Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4910563Z Entering 'third_party/opentelemetry-cpp/third_party/googletest'
2025-03-14T04:41:56.4940505Z http.https://github.com/.extraheader
2025-03-14T04:41:56.4974879Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl'
2025-03-14T04:41:56.5002360Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5034386Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
2025-03-14T04:41:56.5065433Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5100204Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
2025-03-14T04:41:56.5129632Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5161182Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
2025-03-14T04:41:56.5189362Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5223886Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
2025-03-14T04:41:56.5253652Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5289366Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
2025-03-14T04:41:56.5321659Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5354345Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
2025-03-14T04:41:56.5385788Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5422809Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg'
2025-03-14T04:41:56.5452595Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5503987Z Entering 'third_party/pocketfft'
2025-03-14T04:41:56.5533946Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5564973Z Entering 'third_party/protobuf'
2025-03-14T04:41:56.5595234Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5631265Z Entering 'third_party/protobuf/third_party/benchmark'
2025-03-14T04:41:56.5663349Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5690923Z Entering 'third_party/protobuf/third_party/googletest'
2025-03-14T04:41:56.5721821Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5753925Z Entering 'third_party/psimd'
2025-03-14T04:41:56.5788645Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5825129Z Entering 'third_party/pthreadpool'
2025-03-14T04:41:56.5853766Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5888710Z Entering 'third_party/pybind11'
2025-03-14T04:41:56.5919234Z http.https://github.com/.extraheader
2025-03-14T04:41:56.5950948Z Entering 'third_party/python-peachpy'
2025-03-14T04:41:56.5985876Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6019407Z Entering 'third_party/sleef'
2025-03-14T04:41:56.6049637Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6086243Z Entering 'third_party/tensorpipe'
2025-03-14T04:41:56.6116452Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6147219Z Entering 'third_party/tensorpipe/third_party/googletest'
2025-03-14T04:41:56.6179551Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6214706Z Entering 'third_party/tensorpipe/third_party/libnop'
2025-03-14T04:41:56.6244319Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6272922Z Entering 'third_party/tensorpipe/third_party/libuv'
2025-03-14T04:41:56.6302087Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6337025Z Entering 'third_party/tensorpipe/third_party/pybind11'
2025-03-14T04:41:56.6365767Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6397925Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang'
2025-03-14T04:41:56.6426698Z http.https://github.com/.extraheader
2025-03-14T04:41:56.6580550Z A job completed hook has been configured by the self-hosted runner administrator
2025-03-14T04:41:56.6602330Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh'
2025-03-14T04:41:56.6605488Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2025-03-14T04:41:56.6605753Z ##[endgroup]
2025-03-14T04:41:56.6686848Z [!ALERT!] Swap in detected! [!ALERT!]
2025-03-14T04:42:04.6183114Z [!ALERT!] Swap out detected [!ALERT!]
2025-03-14T04:42:17.1876109Z Cleaning up orphan processes